-- Logs begin at Mon 2022-05-23 12:24:31 UTC, end at Mon 2022-05-23 14:26:45 UTC. -- May 23 13:21:54.935624 dv-cinder-825492-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 13:21:54.944743 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 13:21:54 2022] *** May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: nodename: dv-cinder-825492-14-iscsi May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: machine: x86_64 May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: clock source: unix May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: pcre jit disabled May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: detected number of CPU cores: 4 May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: current working directory: / May 23 13:21:54.946710 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: detected binary path: /usr/bin/uwsgi-core May 23 13:21:54.947394 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: your processes number limit is 47680 May 23 13:21:54.947394 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: your memory page size is 4096 bytes May 23 13:21:54.947394 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: detected max file descriptor number: 2048 May 23 13:21:54.947394 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: lock engine: pthread robust mutexes May 23 13:21:54.947394 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: thunder lock: enabled May 23 13:21:54.947394 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 13:21:54.947394 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 13:21:54.992673 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: Python main interpreter initialized at 0x55b9908089c0 May 23 13:21:54.992673 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: python threads support enabled May 23 13:21:54.992673 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: your server socket listen backlog is limited to 100 connections May 23 13:21:54.992673 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: your mercy for graceful operations on workers is 90 seconds May 23 13:21:54.993094 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: mapped 403077 bytes (393 KB) for 2 cores May 23 13:21:54.993094 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: *** Operational MODE: preforking *** May 23 13:21:54.993391 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: *** uWSGI is running in multiple interpreter mode *** May 23 13:21:54.993391 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: spawned uWSGI master process (pid: 103684) May 23 13:21:54.993605 dv-cinder-825492-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 13:21:54.994639 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: spawned uWSGI worker 1 (pid: 103685, cores: 1) May 23 13:21:54.994639 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: spawned uWSGI worker 2 (pid: 103686, cores: 1) May 23 13:21:54.994804 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 13:21:56.179778 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 13:21:56.180373 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 13:21:56.914127 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 13:21:56.914127 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: from cryptography.utils import int_from_bytes May 23 13:21:56.914468 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 13:21:56.914468 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: from cryptography.utils import int_from_bytes May 23 13:21:56.915475 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 13:21:56.915475 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: from cryptography.utils import int_from_bytes May 23 13:21:56.915816 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 13:21:56.915816 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: from cryptography.utils import int_from_bytes May 23 13:21:59.546817 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 13:21:59.547345 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 13:21:59.547503 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 13:21:59.547868 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 13:21:59.548121 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 13:21:59.548443 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 13:21:59.548861 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.548947 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 13:21:59.549073 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.549197 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.549296 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 13:21:59.549593 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.549700 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 13:21:59.549851 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 13:21:59.549945 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.550244 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.550345 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.550579 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.550671 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.550907 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.551000 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.551230 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.551355 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.551565 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.551659 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.551950 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.552053 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.552353 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-14-iscsi {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.552535 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.552807 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.552905 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.553121 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.553246 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.553436 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.553529 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.553755 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.553843 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.554062 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.554164 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-14-iscsi {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.554389 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.554536 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.554783 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.555074 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.555189 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.556435 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.556636 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.556781 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.556910 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.557041 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.557154 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.557281 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.557419 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.557592 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.557738 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.557859 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.557991 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.558123 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.558246 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.558368 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.558495 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.558618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.558739 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.558868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.558990 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.559112 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.559239 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-14-iscsi {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.559360 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.559482 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.559603 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.559723 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.559851 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.559972 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.560102 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.560231 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.560353 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-14-iscsi {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.560480 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.560638 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.560765 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.560900 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.561023 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.561218 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.561345 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.561611 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.561738 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.561938 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.562157 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.562305 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.562427 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.562548 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.562669 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.562860 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.562988 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.563161 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.563263 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.563466 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.563564 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.563772 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.563877 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.564089 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.564186 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.564392 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.564480 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.564717 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.564821 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.565010 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.565110 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.565271 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.565361 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.565590 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.565680 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.565907 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.565992 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.566226 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.566334 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.566477 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.566576 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.566721 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.566817 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.567034 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.567133 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.567350 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.568039 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.568337 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.568779 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.568864 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.568966 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.569049 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.569129 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.569216 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.569305 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.569497 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.569589 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.569815 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.569902 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.570132 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.570221 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.570436 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.570525 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.570746 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.570832 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.571057 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.571152 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.571406 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.571502 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.571670 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.571756 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.571979 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.572083 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.572304 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.572398 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.572624 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.572730 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.572928 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.573027 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.573265 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.573378 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.573577 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.573665 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.573883 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.574197 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.574293 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.574512 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.574601 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.575064 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.575171 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.575265 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.575348 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.575463 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.575552 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.575778 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.575881 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.576098 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.576214 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.576404 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.576594 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.576683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.576777 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.576963 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.577088 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.577266 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.577403 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.577583 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.577727 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.577885 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.578056 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.578189 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.578367 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.578492 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.578624 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.578788 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.578930 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.579091 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.579240 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.579394 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.579565 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.579695 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.579875 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.579996 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.580187 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.580284 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.580499 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.580729 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.580864 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.580954 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.581177 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.581355 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.581488 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.581695 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.581791 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.581980 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.582096 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.582296 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.582405 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.582600 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.582714 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.582903 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.583023 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.583831 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.584029 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.584156 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.584372 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.584544 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.584681 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.584899 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.584998 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.585236 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.585325 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.585556 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.585644 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.585873 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.585960 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.586183 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.586284 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.586485 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.586572 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.586789 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.586886 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.587104 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.587201 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.587404 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.587491 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.587706 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.587795 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.588019 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.588106 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.588328 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.588427 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.588654 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.588756 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.588958 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.589053 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.589257 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.589363 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.589557 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.589659 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.589859 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.589952 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.590158 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.590329 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.590455 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.590550 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.590760 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.590847 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.591075 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.591169 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.591385 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.591473 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.591689 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.591775 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.591992 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.592082 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.592291 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.592378 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.592613 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.592701 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.592926 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.593016 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.593233 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.593320 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.593555 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.593649 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.593879 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.593967 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.594199 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.594302 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.594507 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.594594 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.594816 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.594905 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.595125 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.595209 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:21:59.595437 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.595533 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.595760 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.595847 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.596070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.596164 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.596383 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.596479 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.596715 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.596807 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.597034 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.597123 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.597350 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.597451 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.597675 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.597763 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.597989 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.598089 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.598303 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.598392 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.598617 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.598772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.599315 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.599417 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.599417 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.599589 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.599677 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.599758 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.599890 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.600069 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.600197 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.600408 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.600543 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.600773 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.600903 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.601100 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.601219 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.601424 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.601542 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.601743 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.601864 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.602069 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.602166 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.602404 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.602492 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.602734 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.602823 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.603053 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.603151 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.603395 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.603482 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.603709 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.603814 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.604027 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.604124 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.604342 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.604443 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.604676 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.604791 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.604992 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.605088 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.605307 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.605395 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.605620 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.605709 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.605944 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.606032 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.606259 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.606345 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.606575 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.606673 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.606887 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.606989 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.607201 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.607290 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.607511 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.607606 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.607822 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.607912 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.608133 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.608220 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.608436 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.608537 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.608762 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.608852 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.609068 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.609155 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.609378 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.609480 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.609681 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.609776 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.610000 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.610088 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.610325 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.610422 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.610638 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.610734 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.610953 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.611040 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.611260 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.611354 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.611569 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.611655 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.611875 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.611962 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.612185 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.612275 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.612489 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.612619 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.612823 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.612912 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.613134 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.613234 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.613440 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.613529 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.613761 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.613849 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.614072 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.614169 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.614991 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.615112 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.615335 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.615430 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.615642 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.615745 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.615948 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.616048 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.616263 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.616363 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.616592 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.616689 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.616900 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.616989 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.617210 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.617312 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.617538 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.617673 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.617828 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.617914 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.618139 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.618235 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.618450 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.618539 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.618758 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.618844 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.619079 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.619175 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.619390 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.619476 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.619705 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.619798 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.620024 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.620112 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.620339 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.620425 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.620668 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.620772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.620977 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.621068 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.621281 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.621371 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.621584 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.621671 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.621885 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.621974 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.622191 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.622279 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.622495 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.622584 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.622799 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.622888 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.623101 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.623194 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.623403 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.623506 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.623705 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.623794 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.624023 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.624110 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.624330 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.624428 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.624655 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.624747 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.624964 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.625080 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.625267 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.625378 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.625604 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.625695 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.625908 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.625996 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.626216 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.626311 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.626527 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.626615 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.626854 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.626943 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.627170 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.627259 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.627478 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.627572 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.627784 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.627888 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.628092 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.628180 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.628402 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.628497 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.628734 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.628826 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.629046 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.629137 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.629365 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.629453 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.629674 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.629763 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.630047 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.630679 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.631142 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.631236 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.631318 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.631397 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.631592 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.631690 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.631912 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.632008 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.632226 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.632322 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.632821 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.632921 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.633147 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.633233 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.633467 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.633565 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.633782 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.633869 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.634099 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.634186 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.634408 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.634503 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.634722 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.634812 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.635032 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.635189 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.635341 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.635446 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.635650 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.635738 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.635960 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.636055 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.636279 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.636375 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.636603 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.636696 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.636926 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.637025 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.637239 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.637330 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.637560 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.637647 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.637869 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.637958 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.638183 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.638271 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.638484 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.638570 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.638798 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.638887 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.639117 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.639204 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.639434 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.639529 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.639742 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.639828 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.640052 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.640149 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.640375 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.640463 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.640710 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.640814 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.641024 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.641111 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.641332 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.641425 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.641636 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.641732 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.641940 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.642029 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.642248 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.642335 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.642562 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.642659 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.642870 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.642959 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.643178 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.643272 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.643480 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.643648 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.643792 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.643880 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.644097 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.644184 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.644400 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.644489 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.644725 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.644846 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.645036 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.645124 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.645354 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.645445 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.645692 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.646294 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.646387 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.646467 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.646559 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.646642 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.646722 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.646810 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.647030 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.647118 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.647345 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.647443 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.647650 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.647740 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.647953 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.648051 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.648257 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.648352 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.648558 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.648682 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.648917 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.649019 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.649228 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.649324 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.649533 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.649621 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.649842 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.649942 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.650160 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.650245 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.650469 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.650556 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.650776 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.650871 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.651082 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.651176 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.651386 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.651473 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.651703 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.651800 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.652013 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.652102 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.652321 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.652408 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.652664 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.652757 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.652993 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.653089 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.653303 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.653391 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.653613 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.653703 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.653928 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.654015 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.654234 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.654320 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.654556 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.654650 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.654878 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.654966 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.655180 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.655279 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.655489 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.655590 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.655804 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.655938 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.656116 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.656378 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.656468 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.656736 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.656839 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.657052 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.657142 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.657370 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.657459 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.657684 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.657770 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.657996 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.658085 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.658314 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.658404 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.658636 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.658722 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.658976 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.659206 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.659309 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.659547 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.659637 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.659872 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.659960 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.660175 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.660261 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.660484 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.660603 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.660818 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.660907 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.661126 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.661288 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.661767 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.661866 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.661985 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.662075 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.662167 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.662259 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.662349 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.662565 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.662655 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.662881 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.662969 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.663193 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.663294 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.663512 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.663600 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.663819 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.663907 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.664124 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.664221 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.664434 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.664522 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.664766 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.664867 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.665070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.665172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.665373 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.665517 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.665676 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.665764 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.665983 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.666078 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.666305 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.666394 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.666618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.666706 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.666938 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.667034 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.667249 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.667349 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.667563 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.667658 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.667868 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.667959 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.668177 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.668272 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.668480 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.668619 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.668808 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.668900 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.669111 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.669199 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.669417 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.669516 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.669723 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.669812 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.670025 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.670113 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.670332 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.670429 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.670643 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.670733 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.670950 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.671040 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.671257 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.671355 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.671556 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.671645 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.671863 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.671952 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.672165 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.672262 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.672476 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.672583 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.672806 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.672895 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.673109 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.673199 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.673410 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.673500 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.673717 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.673805 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.674023 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.674112 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.674323 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.674419 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.674630 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.674718 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.674931 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.675021 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.675245 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.675330 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.675544 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.675630 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.675846 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.675942 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.676146 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.676235 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.676451 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.676620 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.676781 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.677549 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678048 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678135 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678214 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678311 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678402 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678492 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678581 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678663 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678849 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.678954 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.679159 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.679249 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.679462 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.679563 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.679766 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.679869 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.680073 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.680162 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.680393 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.680490 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.680734 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.680826 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.681037 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.681126 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.681345 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.681433 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.681648 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.681833 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.681953 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.682052 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.682257 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.682346 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.682564 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.682654 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.682865 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.682955 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.683174 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.683269 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.683490 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.683579 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.683795 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.683885 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.684097 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.684203 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.684410 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.684497 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.684747 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.684841 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.685050 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.685151 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.685353 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.685443 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.685655 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.685743 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.685963 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.686060 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.686273 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.686362 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.686583 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.686671 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.686894 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.686992 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.687204 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.687292 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.687521 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.687615 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.687831 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.687926 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.688138 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.688225 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.688445 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.688531 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.688771 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.688861 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.689085 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.689182 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.689395 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.689491 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.689707 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.689804 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.690010 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.690106 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.690311 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.690399 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.690638 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.690736 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.690948 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.691037 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.691256 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.691355 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.691573 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.691662 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.691882 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.691976 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.692199 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.692295 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.693103 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.693745 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.693839 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.693929 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.694012 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.694101 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.694215 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.694327 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.694430 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.694515 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.694628 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.694733 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.694945 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.695043 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.695255 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.695342 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.695565 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.695662 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.695877 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.695969 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.696186 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.696274 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.696493 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.696610 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.696827 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.696916 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.697135 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.697222 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.697441 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.697546 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.697754 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.697842 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.698066 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.698171 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.698369 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.698458 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.698677 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.698773 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.698980 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.699067 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.699289 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.699378 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.699594 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.699683 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.699908 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.700004 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.700224 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.700310 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.700535 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.700658 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.700891 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.700997 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.701211 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.701299 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.701519 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.701603 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.701832 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.701966 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.702142 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.702235 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.702443 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.702528 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.702754 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.702853 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.703151 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.703236 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.703458 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.703554 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.703769 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.703857 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.704071 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.704157 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.704373 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.704462 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.704710 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.704802 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.705030 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.705115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.705332 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.705429 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.705634 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.705730 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.705937 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.706095 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.706257 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.706387 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.706560 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.706707 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.706879 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.707026 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.707293 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.707405 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.707601 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.707689 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.707904 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.707992 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.708279 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.708438 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.708619 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.708784 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.708936 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.709097 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.709249 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.709420 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.709577 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.709742 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.709888 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.710063 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.710216 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.710370 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.710641 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.710728 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.710959 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.711062 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.711276 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.711393 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.711605 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.711707 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.711913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.712090 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.712227 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.712317 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.712532 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.712671 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.712883 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.713038 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.713202 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.713293 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.713517 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.713618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.713837 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.713933 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.714173 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.714263 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.714502 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.714591 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.714834 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.714922 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.715153 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.715240 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.715475 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.715570 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.715782 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.715870 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.716087 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.716232 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.716399 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.716487 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.716727 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.716818 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.717037 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.717144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.717359 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.717481 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.717670 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.717796 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.717976 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.718113 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.718284 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.718442 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.718592 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.718773 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.718896 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.719086 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.719200 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.719397 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.719521 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.719716 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.719836 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.720030 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.720118 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.720344 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.720430 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.720697 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.720803 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.721009 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.721097 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.721325 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.721412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.721642 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.721742 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.721959 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.722045 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.722268 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.722357 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.722571 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.722668 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.722873 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.722961 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.723190 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.723285 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.723506 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.723593 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.723858 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.723991 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.724179 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.724329 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.724484 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.724596 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.724824 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.724913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.725153 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.725242 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.725472 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.725558 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.725781 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.725868 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.726090 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.726224 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.726401 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.726490 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.726705 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.726799 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.727007 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.727105 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.727316 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.727405 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.727621 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.727715 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.727924 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.728070 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.728229 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.728318 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.728536 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.728673 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.728866 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.728972 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.729169 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.729265 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.729499 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.729602 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.729794 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.729884 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.730100 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.730187 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.730427 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.730523 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.730737 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.730827 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.731041 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.731129 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.731345 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.731432 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.731646 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.731736 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.731962 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.732055 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.732271 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.732359 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.732597 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.732690 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.732910 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.732997 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.733237 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.733337 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.733546 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.733635 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.733855 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.733941 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.734172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.734266 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.734482 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.734573 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.734792 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.734880 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.735100 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.735201 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.735411 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.735497 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.735724 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.735812 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.736035 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.736151 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.736331 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.736419 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.736671 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.736799 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.736988 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.737154 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.737300 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.737388 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.737619 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.737707 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.737965 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.738162 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.738284 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.738489 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.738603 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.738803 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.738906 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.739115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.739208 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.740013 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.740160 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.740352 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.740638 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.740727 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.740944 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.741032 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.741268 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.741368 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.741577 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.741667 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.741885 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.741973 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.742210 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.742440 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.742530 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.742773 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.742861 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.743093 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.743182 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.743413 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.743501 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.743732 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.743820 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.744051 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.744138 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.744360 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.744448 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.744703 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.744797 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.745023 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.745128 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.745338 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.745437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.745652 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.745752 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.745964 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.746059 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.746279 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.746415 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.746588 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.746677 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.746896 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.746985 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.747214 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.747334 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.747522 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.747611 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.747834 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.747926 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.748142 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.748276 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.748454 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.748543 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.748859 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.748949 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.749170 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.749256 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.749493 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.749593 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.749811 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.749906 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.750121 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.750208 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.750433 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.750530 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.750747 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.750832 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.751068 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.751260 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.751389 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.751572 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.751708 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.751903 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.752027 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.752226 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.752347 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.752548 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.752695 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.752899 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.753035 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.753209 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.753322 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.753532 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.753652 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.753839 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.753973 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.754144 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.754292 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.754455 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.754615 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.754798 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.755709 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.755860 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.756001 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.756187 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.756313 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.756535 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.756721 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.756898 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.757031 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.757233 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.757321 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.757816 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.758015 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.758145 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.758364 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.758483 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.758677 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.758797 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.759003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.759150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.759324 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.759412 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.759636 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.759723 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.759943 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.760033 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.760263 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.760350 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.760585 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.760728 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.760901 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.760991 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.761217 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.761305 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.761527 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.761614 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.761830 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.762102 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.762190 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.762429 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.762515 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.762737 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.762826 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.763040 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.763137 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.763348 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.763444 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.763651 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.763739 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.763972 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.764059 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.764277 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.764373 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.764599 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.764691 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.764906 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.764993 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.765216 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.765303 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.765521 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.765618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.765824 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.765911 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.766126 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.766223 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.766429 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.766516 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.766739 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.766876 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.767041 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.767137 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.767352 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.767447 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.767653 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.767748 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.767961 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.768134 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.768263 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.768360 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.768583 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.768678 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.768910 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.769009 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.769228 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.769315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.769538 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.769636 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.769843 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.769973 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.770152 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.770238 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.770459 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.770545 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.770857 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.770945 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.771173 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.771343 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.771482 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.771675 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.771825 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.771989 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.772140 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.772309 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.772681 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.772782 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.772964 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.773053 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.773327 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.773417 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.773658 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.773754 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.773972 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.774059 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.774277 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.774362 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.774584 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.774681 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.774891 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.774979 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.775214 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.775302 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.775522 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.775618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.775831 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.775942 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.776140 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.776229 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.776449 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.776551 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.776782 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.777048 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.777136 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.777389 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.777493 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.777696 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.777783 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.778004 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.778090 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.778312 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.778408 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.778621 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.778716 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.778926 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.779014 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.779238 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.779334 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.779573 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.779659 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.779888 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.779974 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.780202 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.780288 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.780513 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.780612 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.780858 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.780945 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.781167 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.781265 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.781476 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.781564 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.781793 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.782001 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.782101 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.782184 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.782389 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.782484 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.782701 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.782787 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.783013 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.783108 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.783317 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.783404 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.783632 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.783730 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.783978 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.784066 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.784302 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.784390 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.784650 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.784755 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.784977 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.785080 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.785292 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.785380 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.785606 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.785701 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.785914 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.786008 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.786264 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.786352 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.786578 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.786819 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.786966 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.787157 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.787246 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.787496 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.787598 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.787818 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.787933 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.788134 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.788231 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.788433 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.788578 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.788760 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.788908 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.789069 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.789240 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.789385 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.789569 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.789694 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.789890 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.789997 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.790218 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.790314 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.790546 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.790634 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.790867 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.790953 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.791171 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.791266 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.791473 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.791569 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.791774 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.791861 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.792078 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.792166 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.792377 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.792465 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.792738 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.792893 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.792989 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.793124 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.793292 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.793440 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.793593 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.793752 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.793894 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.794069 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.794200 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.794396 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.794502 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.794712 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.794808 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.795025 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.795112 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.795335 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.795421 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.795654 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.795749 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.795971 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.796057 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.796285 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.796388 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.796614 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.796705 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.796973 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.797121 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.797234 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.797320 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.797543 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.797631 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.797849 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.797934 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.798156 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.798249 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.798466 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.798562 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.798776 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.798862 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.799086 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.799193 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.799397 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.799486 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.799702 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.799789 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.800012 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.800106 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.800318 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.800404 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.800648 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.800739 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.800958 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.801059 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.801266 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.801363 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.801589 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.801677 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.802447 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.802556 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.802976 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.803302 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.803397 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.803633 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.803729 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.803951 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.804038 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.804280 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.804365 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.804631 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.804733 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.804957 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.805045 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.805274 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.805368 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.805584 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.805684 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.805898 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.805986 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.806214 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.806301 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.806524 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.806613 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.806834 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.806921 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.807148 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.807282 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.807462 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.807550 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.807787 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.807877 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.808114 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.808201 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.808422 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.808508 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.808769 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.808895 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.809091 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.809190 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.809418 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.809513 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.809734 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.809819 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.810047 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.810141 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.810383 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.810469 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.810693 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.810777 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.811004 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.811102 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.811322 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.811409 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.811582 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 13:21:59.811675 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.811941 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.812263 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.812601 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.812937 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.813298 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.813585 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.813916 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.814250 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.814601 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.814920 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.815269 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.815602 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.815924 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.816242 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.816560 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:21:59.816835 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 13:21:59.870678 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO dbcounter [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Registered counter for database nova_api May 23 13:21:59.876617 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO dbcounter [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Registered counter for database nova_api May 23 13:21:59.892096 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_db.sqlalchemy.engines [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:21:59.898891 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG oslo_db.sqlalchemy.engines [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:21:59.899045 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writer thread running {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:21:59.905503 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writer thread running {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:21:59.957859 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.context [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dc388de-d5ca-467c-ab01-a163e12270ad(cell1) {{(pid=103685) load_cells /opt/stack/nova/nova/context.py:464}} May 23 13:21:59.962428 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:21:59.964008 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:21:59.964973 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:21:59.967279 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:21:59.969279 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO dbcounter [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Registered counter for database nova_cell0 May 23 13:21:59.971153 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.context [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dc388de-d5ca-467c-ab01-a163e12270ad(cell1) {{(pid=103686) load_cells /opt/stack/nova/nova/context.py:464}} May 23 13:21:59.973389 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO dbcounter [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Registered counter for database nova_cell1 May 23 13:21:59.976152 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:21:59.977791 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:21:59.978605 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:21:59.980629 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:21:59.981683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_db.sqlalchemy.engines [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:21:59.982731 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO dbcounter [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Registered counter for database nova_cell0 May 23 13:21:59.983357 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_db.sqlalchemy.engines [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:21:59.986802 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO dbcounter [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Registered counter for database nova_cell1 May 23 13:21:59.990908 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writer thread running {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:21:59.991244 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writer thread running {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:21:59.994920 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG oslo_db.sqlalchemy.engines [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:21:59.996105 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG oslo_db.sqlalchemy.engines [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:22:00.002680 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writer thread running {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:22:00.004363 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writer thread running {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:22:00.138255 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO dbcounter [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Registered counter for database nova_cell0 May 23 13:22:00.146997 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_db.sqlalchemy.engines [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:22:00.151371 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writer thread running {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:22:00.153464 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO dbcounter [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Registered counter for database nova_cell0 May 23 13:22:00.162428 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG oslo_db.sqlalchemy.engines [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:22:00.166821 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writer thread running {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:22:00.640294 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: WARNING keystonemiddleware.auth_token [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 13:22:00.651294 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: WARNING keystonemiddleware.auth_token [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 13:22:00.693711 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: WARNING keystonemiddleware.auth_token [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 13:22:00.701396 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: WARNING keystonemiddleware.auth_token [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 13:22:01.002299 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: WARNING keystonemiddleware.auth_token [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 13:22:01.009308 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: WARNING keystonemiddleware.auth_token [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 13:22:01.014612 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b9908089c0 pid: 103685 (default app) May 23 13:22:01.016759 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:22:01.019653 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001797 May 23 13:22:01.019653 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Mon May 23 13:22:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:22:01.049603 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: WARNING keystonemiddleware.auth_token [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 13:22:01.056444 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: WARNING keystonemiddleware.auth_token [None req-c23d3e49-508e-4877-940b-6bb80006acff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 13:22:01.061956 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b9908089c0 pid: 103686 (default app) May 23 13:23:24.919209 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:24.921560 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 May 23 13:23:24.924024 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:24.935217 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_api:SELECT=3 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:23:24.936586 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_cell0:SELECT=3 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:23:24.937975 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_cell1:SELECT=3 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:23:24.939126 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:23:25.394690 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-ea2444b0-5ba1-454b-803b-c68695b8f1ea admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:25.425331 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-ea2444b0-5ba1-454b-803b-c68695b8f1ea admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.495476 May 23 13:23:25.426574 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 1/3] 10.222.0.70 () {60 vars in 1291 bytes} [Mon May 23 13:23:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:23:27.744627 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:27.745623 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-586c4be8-c67a-426f-8e76-3368593b6118 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 23 13:23:27.746011 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 3/4] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:27.810303 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-42b1718f-3de3-4849-a8e8-1f4336aa869e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "id": "c1"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:27.829405 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 13:23:27.829405 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: warnings.warn(msg) May 23 13:23:27.956532 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-42b1718f-3de3-4849-a8e8-1f4336aa869e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.204117 May 23 13:23:27.971265 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_api:SELECT=3 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:23:27.972443 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_cell1:SELECT=3 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:23:27.973599 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_cell0:SELECT=3 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:23:27.974677 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 2/5] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:23:27.974794 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:23:28.178089 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-848a4b45-096c-41f6-925c-bcde3cb8829c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:28.180533 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 13:23:28.180533 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: warnings.warn(msg) May 23 13:23:28.326561 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-848a4b45-096c-41f6-925c-bcde3cb8829c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361086 May 23 13:23:28.327874 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 4/6] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 23 13:23:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:23:30.677306 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-42b1718f-3de3-4849-a8e8-1f4336aa869e admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:30.678396 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-42b1718f-3de3-4849-a8e8-1f4336aa869e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 May 23 13:23:30.679506 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 3/7] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:30.789485 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-0b663408-26a4-4ac0-aea4-20740aa4ae8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:30.807636 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 13:23:30.807636 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: warnings.warn(msg) May 23 13:23:30.902759 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-0b663408-26a4-4ac0-aea4-20740aa4ae8f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.217423 May 23 13:23:30.903329 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 5/8] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:23:30.916262 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-5b73194d-153b-4c0d-a988-be0ca5fb01aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:30.918039 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 13:23:30.918039 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: warnings.warn(msg) May 23 13:23:31.058832 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-5b73194d-153b-4c0d-a988-be0ca5fb01aa admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146275 May 23 13:23:31.059952 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 4/9] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 23 13:23:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:23:33.402787 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-0b663408-26a4-4ac0-aea4-20740aa4ae8f admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:33.403796 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-0b663408-26a4-4ac0-aea4-20740aa4ae8f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 23 13:23:33.404194 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:33.474559 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-8b289bdd-e277-4ac6-a9f1-970387858ec1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "ram": 1024}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:33.620416 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-8b289bdd-e277-4ac6-a9f1-970387858ec1 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.208569 May 23 13:23:33.621279 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 5/11] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:23:33.633638 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-cafa9f35-3364-42f5-911c-e093931429f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:33.864478 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-cafa9f35-3364-42f5-911c-e093931429f5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.234551 May 23 13:23:33.865502 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 7/12] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 23 13:23:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:23:36.209397 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-8b289bdd-e277-4ac6-a9f1-970387858ec1 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:36.210421 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-8b289bdd-e277-4ac6-a9f1-970387858ec1 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 May 23 13:23:36.210827 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 6/13] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:36.273938 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-bfd7ad5e-1b3a-4419-ae1b-584acd45f201 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:36.578615 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-bfd7ad5e-1b3a-4419-ae1b-584acd45f201 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.358107 May 23 13:23:36.578615 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 8/14] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:23:36.587933 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-b035ebef-6b48-4fa0-8fe8-017f0fa92255 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:36.739617 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-b035ebef-6b48-4fa0-8fe8-017f0fa92255 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.155293 May 23 13:23:36.740386 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 7/15] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 23 13:23:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:23:39.043436 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-bfd7ad5e-1b3a-4419-ae1b-584acd45f201 admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:39.044434 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-bfd7ad5e-1b3a-4419-ae1b-584acd45f201 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 23 13:23:39.045626 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 9/16] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:39.111082 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-59a2c703-a374-4d01-a678-3ebf3c3b3b7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:39.250596 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-59a2c703-a374-4d01-a678-3ebf3c3b3b7b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.199339 May 23 13:23:39.251183 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 8/17] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:23:39.263261 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-4eb4831c-c2b2-47e0-9426-6a92a5cb6239 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:39.595476 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-4eb4831c-c2b2-47e0-9426-6a92a5cb6239 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.335693 May 23 13:23:39.608599 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 10/18] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 23 13:23:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:23:41.912250 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-59a2c703-a374-4d01-a678-3ebf3c3b3b7b admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:41.913292 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-59a2c703-a374-4d01-a678-3ebf3c3b3b7b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 23 13:23:41.913692 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 9/19] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:41.976901 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-7f464540-c8dd-4b71-b81a-86f6495fb74e admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:42.003019 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-7f464540-c8dd-4b71-b81a-86f6495fb74e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081750 May 23 13:23:42.003746 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 11/20] 10.222.0.70 () {60 vars in 1291 bytes} [Mon May 23 13:23:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:23:44.519713 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-59a2c703-a374-4d01-a678-3ebf3c3b3b7b admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:44.520794 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-59a2c703-a374-4d01-a678-3ebf3c3b3b7b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 23 13:23:44.521275 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 10/21] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:44.583450 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-362b4b93-ab24-41da-8cad-5a0ba8673adf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:44.672544 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-362b4b93-ab24-41da-8cad-5a0ba8673adf admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.145095 May 23 13:23:44.673104 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 12/22] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:23:44.686873 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-fdfc66f3-b57f-4726-a34d-2513b4c9df8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:44.819884 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-fdfc66f3-b57f-4726-a34d-2513b4c9df8e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138260 May 23 13:23:44.820763 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 11/23] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 23 13:23:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:23:47.150859 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-362b4b93-ab24-41da-8cad-5a0ba8673adf admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:47.152505 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-362b4b93-ab24-41da-8cad-5a0ba8673adf admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 May 23 13:23:47.152940 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:47.223047 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-9a51d8e0-a78c-47ef-b5e8-a3d357815fbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "id": "2", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:47.336396 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-9a51d8e0-a78c-47ef-b5e8-a3d357815fbc admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.176746 May 23 13:23:47.337065 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 12/25] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:23:47.352241 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-c71ca57d-c9fe-4872-a6dd-17e8228e21c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:47.457943 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-c71ca57d-c9fe-4872-a6dd-17e8228e21c2 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109502 May 23 13:23:47.458549 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 14/26] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 23 13:23:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:23:49.920897 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-9a51d8e0-a78c-47ef-b5e8-a3d357815fbc admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:49.922040 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-9a51d8e0-a78c-47ef-b5e8-a3d357815fbc admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 May 23 13:23:49.922523 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 13/27] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:49.983718 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-015be878-7b87-40f1-be4a-128ed5e7446a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "id": "3"}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:50.100209 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-015be878-7b87-40f1-be4a-128ed5e7446a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.171206 May 23 13:23:50.100446 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 15/28] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:23:50.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-5da827e9-8bff-4f32-8646-bccd74f30d00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:50.218839 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-5da827e9-8bff-4f32-8646-bccd74f30d00 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109805 May 23 13:23:50.219436 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 14/29] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 23 13:23:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:23:52.589306 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-015be878-7b87-40f1-be4a-128ed5e7446a admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:52.591607 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-015be878-7b87-40f1-be4a-128ed5e7446a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002754 May 23 13:23:52.592083 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 16/30] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:52.654035 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-73126205-787e-4cc7-8de9-91dd5905d05f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "swap": 0, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:52.728203 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-73126205-787e-4cc7-8de9-91dd5905d05f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.130137 May 23 13:23:52.728798 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:23:52.740908 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-b1482b0d-8a45-44fd-9e04-ca6bb66cd068 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:52.846092 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-b1482b0d-8a45-44fd-9e04-ca6bb66cd068 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108732 May 23 13:23:52.846588 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 17/32] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 23 13:23:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:23:55.326595 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-73126205-787e-4cc7-8de9-91dd5905d05f admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:23:55.328291 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-73126205-787e-4cc7-8de9-91dd5905d05f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002133 May 23 13:23:55.328795 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 16/33] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:23:55.393081 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-fa794d42-0838-4fb6-97fc-3a1fe3ce96c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:55.516098 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-fa794d42-0838-4fb6-97fc-3a1fe3ce96c5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.181257 May 23 13:23:55.517004 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 18/34] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 23 13:23:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:23:55.528962 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-13010f53-ae00-4b46-8a6b-c270a837451e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:23:55.536242 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:23:55.690734 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-13010f53-ae00-4b46-8a6b-c270a837451e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.164676 May 23 13:23:55.690734 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 17/35] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 23 13:23:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:24:20.403413 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-fa794d42-0838-4fb6-97fc-3a1fe3ce96c5 admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:20.404419 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-fa794d42-0838-4fb6-97fc-3a1fe3ce96c5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 23 13:24:20.404858 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:24:20.464956 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-eee31d97-326d-4fb3-84dc-859103f282e1 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:20.481982 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-eee31d97-326d-4fb3-84dc-859103f282e1 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071269 May 23 13:24:20.482527 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1291 bytes} [Mon May 23 13:24:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:24:21.490943 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-fa794d42-0838-4fb6-97fc-3a1fe3ce96c5 admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:21.491937 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-fa794d42-0838-4fb6-97fc-3a1fe3ce96c5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 23 13:24:21.492337 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:24:21.697227 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-c39254b0-7770-4be4-b685-b713f026a838 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:21.704149 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.wsgi [None req-c39254b0-7770-4be4-b685-b713f026a838 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-c39254b0-7770-4be4-b685-b713f026a838 admin admin] Request method failure captured: May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Accept: application/json May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Accept-Encoding: gzip, deflate May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Connection: keep-alive May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Content-Length: 0 May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Host: 10.222.0.70 May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Openstack-Api-Version: compute 2.90 May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Openstack-System-Scope: None May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: User-Agent: python-novaclient May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Auth-Token: gAAAAABii4sF9pfQtJqA5MtBLP6035S3gRbU3waA1i6_8IFfhxV3jj-DD8Su7j9jcn-EUUxHPxLFSR6aiHgbwXRb0gEAwA23N_DjwyFKpDqWoopZByv4MFxlOz3XVRi3d6wE-J3s69QkdO4rHyT60fvskqcW1Tae7pCuBJiXj8C7ZHbwqG28t1Q May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Domain-Id: None May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Domain-Name: None May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Identity-Status: Confirmed May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Is-Admin-Project: True May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Openstack-Nova-Api-Version: 2.90 May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Domain-Id: default May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Domain-Name: Default May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Name: admin May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Role: member,admin,reader May 23 13:24:21.707471 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Roles: member,admin,reader May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8db400662d744ef19141527de1d2418c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8db400662d744ef19141527de1d2418c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}] May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Tenant: admin May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Tenant-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Tenant-Name: admin May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User: admin May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Domain-Id: default May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Domain-Name: Default May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Id: 5acd460bee394e719cdafd0e39f18395 May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Name: admin May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: method: > May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: exception: Flavor 42 could not be found. May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: action_args: {'id': '42'} May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:24:21.709150 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:21.710251 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:21.711780 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-c39254b0-7770-4be4-b685-b713f026a838 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:24:21.713118 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-c39254b0-7770-4be4-b685-b713f026a838 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065852 May 23 13:24:21.713118 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 19/39] 10.222.0.70 () {60 vars in 1190 bytes} [Mon May 23 13:24:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 13:24:21.720608 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-6cf6ea40-07fa-43c6-a395-1b388de38fdc admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:21.723608 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:24:21.742759 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-6cf6ea40-07fa-43c6-a395-1b388de38fdc admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025771 May 23 13:24:21.743311 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 21/40] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 23 13:24:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:24:21.754310 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-809d7ce5-957d-4f35-8cc5-48428a983f8d admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:21.777242 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-809d7ce5-957d-4f35-8cc5-48428a983f8d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025371 May 23 13:24:21.777242 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 20/41] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 23 13:24:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:24:21.788445 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-192c7148-4b40-4655-a408-7d4ae4b62dd5 admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:21.794945 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.wsgi [None req-192c7148-4b40-4655-a408-7d4ae4b62dd5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-192c7148-4b40-4655-a408-7d4ae4b62dd5 admin admin] Request method failure captured: May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Accept: application/json May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Accept-Encoding: gzip, deflate May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Connection: keep-alive May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Content-Length: 0 May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Host: 10.222.0.70 May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Openstack-Api-Version: compute 2.90 May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Openstack-System-Scope: None May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: User-Agent: python-novaclient May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Auth-Token: gAAAAABii4sF9pfQtJqA5MtBLP6035S3gRbU3waA1i6_8IFfhxV3jj-DD8Su7j9jcn-EUUxHPxLFSR6aiHgbwXRb0gEAwA23N_DjwyFKpDqWoopZByv4MFxlOz3XVRi3d6wE-J3s69QkdO4rHyT60fvskqcW1Tae7pCuBJiXj8C7ZHbwqG28t1Q May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Domain-Id: None May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Domain-Name: None May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Identity-Status: Confirmed May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Is-Admin-Project: True May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Openstack-Nova-Api-Version: 2.90 May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Domain-Id: default May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Domain-Name: Default May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Name: admin May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Role: member,admin,reader May 23 13:24:21.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Roles: member,admin,reader May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8db400662d744ef19141527de1d2418c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8db400662d744ef19141527de1d2418c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}] May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Tenant: admin May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Tenant-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Tenant-Name: admin May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User: admin May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Domain-Id: default May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Domain-Name: Default May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Id: 5acd460bee394e719cdafd0e39f18395 May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Name: admin May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: method: > May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: exception: Flavor 42 could not be found. May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: action_args: {'id': '42'} May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:24:21.799780 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:21.806683 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:21.808358 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-192c7148-4b40-4655-a408-7d4ae4b62dd5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:24:21.809499 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-192c7148-4b40-4655-a408-7d4ae4b62dd5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014928 May 23 13:24:21.809499 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 22/42] 10.222.0.70 () {60 vars in 1190 bytes} [Mon May 23 13:24:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 13:24:22.681310 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-809d7ce5-957d-4f35-8cc5-48428a983f8d admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:22.682847 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-809d7ce5-957d-4f35-8cc5-48428a983f8d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 23 13:24:22.683323 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:24:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:24:22.887177 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-dfec5640-c4b5-4c77-9b36-7f062eb30368 admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:22.892522 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.wsgi [None req-dfec5640-c4b5-4c77-9b36-7f062eb30368 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-dfec5640-c4b5-4c77-9b36-7f062eb30368 admin admin] Request method failure captured: May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Accept: application/json May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Accept-Encoding: gzip, deflate May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Connection: keep-alive May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Content-Length: 0 May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Host: 10.222.0.70 May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Openstack-Api-Version: compute 2.90 May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Openstack-System-Scope: None May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: User-Agent: python-novaclient May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Auth-Token: gAAAAABii4sG8DegWXogS_4C-IARF4RYfGkutZ4x-6h-rh11oVU6KRApuar5cEB0jPnc3bd_v1GeHesIhGay4yRx0LukQKHcGB_6NnF_3iZlDjddLo4HXP-5_6z_2NTYLg2RE5QBx3nINqdJI2zBaEimFp-ea1nbJcblxxeZKnM2JqclFp75f6Q May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Domain-Id: None May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Domain-Name: None May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Identity-Status: Confirmed May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Is-Admin-Project: True May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Openstack-Nova-Api-Version: 2.90 May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Domain-Id: default May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Domain-Name: Default May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Name: admin May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Role: member,admin,reader May 23 13:24:22.894003 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Roles: member,admin,reader May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8db400662d744ef19141527de1d2418c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8db400662d744ef19141527de1d2418c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}] May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Tenant: admin May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Tenant-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Tenant-Name: admin May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User: admin May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Domain-Id: default May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Domain-Name: Default May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Id: 5acd460bee394e719cdafd0e39f18395 May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Name: admin May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: method: > May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: exception: Flavor 84 could not be found. May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: action_args: {'id': '84'} May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:24:22.895412 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:22.897070 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:22.898407 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-dfec5640-c4b5-4c77-9b36-7f062eb30368 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:24:22.899727 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-dfec5640-c4b5-4c77-9b36-7f062eb30368 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070815 May 23 13:24:22.899727 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1190 bytes} [Mon May 23 13:24:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 13:24:22.905660 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-9cbfd8f4-2260-4094-ba3f-d9c209bc0404 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:22.921506 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-9cbfd8f4-2260-4094-ba3f-d9c209bc0404 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019535 May 23 13:24:22.922074 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 23 13:24:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:24:22.931816 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-4d955fc3-c2e7-4f75-83c8-f1467042476d admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:22.946352 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-4d955fc3-c2e7-4f75-83c8-f1467042476d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018110 May 23 13:24:22.946829 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 23 13:24:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:24:22.956187 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-f5a90fb0-e315-4ed7-b9c8-4eccc5829037 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:22.961598 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.wsgi [None req-f5a90fb0-e315-4ed7-b9c8-4eccc5829037 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-f5a90fb0-e315-4ed7-b9c8-4eccc5829037 admin admin] Request method failure captured: May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Accept: application/json May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Accept-Encoding: gzip, deflate May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Connection: keep-alive May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Content-Length: 0 May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Host: 10.222.0.70 May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Openstack-Api-Version: compute 2.90 May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Openstack-System-Scope: None May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: User-Agent: python-novaclient May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Auth-Token: gAAAAABii4sG8DegWXogS_4C-IARF4RYfGkutZ4x-6h-rh11oVU6KRApuar5cEB0jPnc3bd_v1GeHesIhGay4yRx0LukQKHcGB_6NnF_3iZlDjddLo4HXP-5_6z_2NTYLg2RE5QBx3nINqdJI2zBaEimFp-ea1nbJcblxxeZKnM2JqclFp75f6Q May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Domain-Id: None May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Domain-Name: None May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Identity-Status: Confirmed May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Is-Admin-Project: True May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Openstack-Nova-Api-Version: 2.90 May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Domain-Id: default May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Domain-Name: Default May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Name: admin May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Role: member,admin,reader May 23 13:24:22.963144 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Roles: member,admin,reader May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8db400662d744ef19141527de1d2418c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8db400662d744ef19141527de1d2418c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}] May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Tenant: admin May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Tenant-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Tenant-Name: admin May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User: admin May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Domain-Id: default May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Domain-Name: Default May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Id: 5acd460bee394e719cdafd0e39f18395 May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Name: admin May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: method: > May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: exception: Flavor 84 could not be found. May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: action_args: {'id': '84'} May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:24:22.964868 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:22.965772 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:22.967032 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-f5a90fb0-e315-4ed7-b9c8-4eccc5829037 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:24:22.968285 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-f5a90fb0-e315-4ed7-b9c8-4eccc5829037 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012524 May 23 13:24:22.968285 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 23/47] 10.222.0.70 () {60 vars in 1190 bytes} [Mon May 23 13:24:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 13:24:23.850856 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-4d955fc3-c2e7-4f75-83c8-f1467042476d admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:23.851793 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-4d955fc3-c2e7-4f75-83c8-f1467042476d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 23 13:24:23.852186 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 25/48] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:24:24.044359 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-6226fb65-68a8-405a-b9d7-8c9680d01230 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:24.050120 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.wsgi [None req-6226fb65-68a8-405a-b9d7-8c9680d01230 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-6226fb65-68a8-405a-b9d7-8c9680d01230 admin admin] Request method failure captured: May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Accept: application/json May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Accept-Encoding: gzip, deflate May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Connection: keep-alive May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Content-Length: 0 May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Host: 10.222.0.70 May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Openstack-Api-Version: compute 2.90 May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Openstack-System-Scope: None May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: User-Agent: python-novaclient May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Auth-Token: gAAAAABii4sH0mIsw4hj0Qt8lDLRtpzMSVP7GtBxIS7qwDkk4CoV1e-R93JPJGqFxEFyyd8-frHTAsGn6UXX2I0f3YiTWrSaLsgrr5li_QFKhx1nhy-nhHvnDC4FXjrgckCSGDFgY-AppTYcCV7GOpIkeQaEF3STdg-zGOj67r_JTQJBcii6-4c May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Domain-Id: None May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Domain-Name: None May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Identity-Status: Confirmed May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Is-Admin-Project: True May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Openstack-Nova-Api-Version: 2.90 May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Domain-Id: default May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Domain-Name: Default May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Project-Name: admin May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Role: member,admin,reader May 23 13:24:24.051618 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Roles: member,admin,reader May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8db400662d744ef19141527de1d2418c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8db400662d744ef19141527de1d2418c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}] May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Tenant: admin May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Tenant-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-Tenant-Name: admin May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User: admin May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Domain-Id: default May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Domain-Name: Default May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Id: 5acd460bee394e719cdafd0e39f18395 May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: X-User-Name: admin May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: method: > May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: exception: Flavor 451 could not be found. May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: action_args: {'id': '451'} May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:24:24.053163 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:24.054172 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi May 23 13:24:24.055437 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-6226fb65-68a8-405a-b9d7-8c9680d01230 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:24:24.056725 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-6226fb65-68a8-405a-b9d7-8c9680d01230 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062417 May 23 13:24:24.056725 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 24/49] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 23 13:24:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 13:24:24.066715 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-a526e5ed-44da-4c30-9359-d077ce5f104e admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:24.081264 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-a526e5ed-44da-4c30-9359-d077ce5f104e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017972 May 23 13:24:24.081837 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 26/50] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 23 13:24:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:24:24.091958 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:24.106194 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018074 May 23 13:24:24.106820 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 23 13:24:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:24:24.116650 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-bb8e8276-2362-4d9a-8a57-22556f216cf0 admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:24.122998 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.wsgi [None req-bb8e8276-2362-4d9a-8a57-22556f216cf0 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-bb8e8276-2362-4d9a-8a57-22556f216cf0 admin admin] Request method failure captured: May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Accept: application/json May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Accept-Encoding: gzip, deflate May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Connection: keep-alive May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Content-Length: 0 May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Host: 10.222.0.70 May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Openstack-Api-Version: compute 2.90 May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Openstack-System-Scope: None May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: User-Agent: python-novaclient May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Auth-Token: gAAAAABii4sH0mIsw4hj0Qt8lDLRtpzMSVP7GtBxIS7qwDkk4CoV1e-R93JPJGqFxEFyyd8-frHTAsGn6UXX2I0f3YiTWrSaLsgrr5li_QFKhx1nhy-nhHvnDC4FXjrgckCSGDFgY-AppTYcCV7GOpIkeQaEF3STdg-zGOj67r_JTQJBcii6-4c May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Domain-Id: None May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Domain-Name: None May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Identity-Status: Confirmed May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Is-Admin-Project: True May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Openstack-Nova-Api-Version: 2.90 May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Domain-Id: default May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Domain-Name: Default May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Project-Name: admin May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Role: member,admin,reader May 23 13:24:24.124913 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Roles: member,admin,reader May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8db400662d744ef19141527de1d2418c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8db400662d744ef19141527de1d2418c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8db400662d744ef19141527de1d2418c"}]}] May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Tenant: admin May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Tenant-Id: 8db400662d744ef19141527de1d2418c May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-Tenant-Name: admin May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User: admin May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Domain-Id: default May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Domain-Name: Default May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Id: 5acd460bee394e719cdafd0e39f18395 May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: X-User-Name: admin May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: method: > May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: exception: Flavor 451 could not be found. May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: action_args: {'id': '451'} May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:24:24.126188 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:24.127022 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: ERROR nova.api.openstack.wsgi May 23 13:24:24.128115 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-bb8e8276-2362-4d9a-8a57-22556f216cf0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:24:24.129180 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-bb8e8276-2362-4d9a-8a57-22556f216cf0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013344 May 23 13:24:24.129180 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 27/52] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 23 13:24:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 13:24:25.026697 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:25.027704 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 May 23 13:24:25.028103 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:24:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:24:25.218879 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-57a545ac-3b22-4939-969f-5dbbf6c503a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:24:25.333423 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-57a545ac-3b22-4939-969f-5dbbf6c503a7 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.168974 May 23 13:24:25.333878 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 28/54] 10.222.0.70 () {64 vars in 1235 bytes} [Mon May 23 13:24:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:24:26.201229 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:26.202266 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 23 13:24:26.202692 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:24:26.395736 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-1ba6a511-825e-48a3-9638-8c08137dceb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:24:26.526720 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-1ba6a511-825e-48a3-9638-8c08137dceb4 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.183041 May 23 13:24:26.527321 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 29/56] 10.222.0.70 () {64 vars in 1235 bytes} [Mon May 23 13:24:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:24:27.402795 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:27.403818 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 May 23 13:24:27.404210 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:24:27.598573 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-bbf0f457-cf88-4ac1-949b-3680751c4a1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:24:27.732496 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-bbf0f457-cf88-4ac1-949b-3680751c4a1d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.186977 May 23 13:24:27.733076 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1235 bytes} [Mon May 23 13:24:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:24:28.603124 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:28.604500 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 May 23 13:24:28.604935 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 29/59] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:24:28.801034 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-ae144239-cc54-45fc-a3b4-6628fb7d2435 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:24:28.903768 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-ae144239-cc54-45fc-a3b4-6628fb7d2435 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.162689 May 23 13:24:28.904316 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 31/60] 10.222.0.70 () {64 vars in 1235 bytes} [Mon May 23 13:24:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:24:29.789893 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:29.791006 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 23 13:24:29.792000 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 30/61] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:24:29.990447 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-51a996df-cead-4907-97f4-941704d7d589 admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:24:30.011215 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-51a996df-cead-4907-97f4-941704d7d589 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072784 May 23 13:24:30.011775 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 32/62] 10.222.0.70 () {60 vars in 1202 bytes} [Mon May 23 13:24:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:25:34.037950 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:25:34.038944 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-46ae5f5c-348f-41ef-bc00-dc51d31334d4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 23 13:25:34.039347 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 23 13:25:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:25:34.046768 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:25:34.100461 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-5ba75a86-e0fd-4ceb-b595-094d6fbefadb admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:25:34.119865 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-5ba75a86-e0fd-4ceb-b595-094d6fbefadb admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074450 May 23 13:25:34.120682 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 33/64] 10.222.0.70 () {60 vars in 1291 bytes} [Mon May 23 13:25:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:25:34.140925 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:25:34.144650 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-290efe1c-6514-4cfa-8d8f-56d2afeac848 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:25:34.152920 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-290efe1c-6514-4cfa-8d8f-56d2afeac848 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013470 May 23 13:25:34.153734 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 32/65] 10.222.0.70 () {60 vars in 1282 bytes} [Mon May 23 13:25:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:25:34.165473 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-5eae0309-5bdc-4863-8f10-57db93b32017 admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:25:34.173565 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-5eae0309-5bdc-4863-8f10-57db93b32017 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012434 May 23 13:25:34.174081 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 34/66] 10.222.0.70 () {60 vars in 1285 bytes} [Mon May 23 13:25:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:25:34.188301 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:25:34.194367 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012347 May 23 13:25:34.194905 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1285 bytes} [Mon May 23 13:25:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:25:34.207839 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-670dbba8-09a5-408e-8c36-a57595aef24a admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:25:34.217096 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-670dbba8-09a5-408e-8c36-a57595aef24a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012942 May 23 13:25:34.221850 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 35/68] 10.222.0.70 () {60 vars in 1282 bytes} [Mon May 23 13:25:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:29:25.599160 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:29:25.600281 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 May 23 13:29:25.600712 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 34/69] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:29:25.768151 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_api:SELECT=6 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:29:25.899905 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-cf9f9c28-5b6b-42b4-920e-7e08529569eb admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:29:25.901202 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 13:29:25.901202 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: warnings.warn(msg) May 23 13:29:25.902422 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-cf9f9c28-5b6b-42b4-920e-7e08529569eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:29:25.902894 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-cf9f9c28-5b6b-42b4-920e-7e08529569eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:29:25.903677 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-cf9f9c28-5b6b-42b4-920e-7e08529569eb admin admin] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:29:25.904105 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-cf9f9c28-5b6b-42b4-920e-7e08529569eb admin admin] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:29:25.939934 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-cf9f9c28-5b6b-42b4-920e-7e08529569eb admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.173197 May 23 13:29:25.940504 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 36/70] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 23 13:29:25 2022] GET /compute/v2.1/os-services => generated 794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:29:26.865254 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:29:26.866525 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 May 23 13:29:26.866876 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 35/71] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:29:27.063795 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-d14e3182-b1e9-4c2e-a742-4a37a4fb63ab admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:29:27.064930 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 13:29:27.064930 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: warnings.warn(msg) May 23 13:29:27.066162 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-d14e3182-b1e9-4c2e-a742-4a37a4fb63ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:29:27.066606 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-d14e3182-b1e9-4c2e-a742-4a37a4fb63ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:29:27.067442 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-d14e3182-b1e9-4c2e-a742-4a37a4fb63ab admin admin] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:29:27.068466 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-d14e3182-b1e9-4c2e-a742-4a37a4fb63ab admin admin] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:29:27.088348 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-d14e3182-b1e9-4c2e-a742-4a37a4fb63ab admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080961 May 23 13:29:27.088950 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 37/72] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 23 13:29:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:29:38.540519 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:29:38.541613 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 May 23 13:29:38.542123 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 36/73] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:29:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:29:38.693008 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_cell0:SELECT=4 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:29:38.694038 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_cell1:SELECT=4 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:29:38.694716 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG dbcounter [-] [103685] Writing DB stats nova_api:SELECT=8 {{(pid=103685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:29:38.756799 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-5343a3af-61e6-461c-9dfe-515382f4d3fb admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:29:38.759126 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 13:29:38.759126 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: warnings.warn(msg) May 23 13:29:38.761305 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-5343a3af-61e6-461c-9dfe-515382f4d3fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:29:38.762073 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-5343a3af-61e6-461c-9dfe-515382f4d3fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:29:38.763444 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-5343a3af-61e6-461c-9dfe-515382f4d3fb admin admin] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:29:38.764187 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-5343a3af-61e6-461c-9dfe-515382f4d3fb admin admin] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:29:38.802737 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-5343a3af-61e6-461c-9dfe-515382f4d3fb admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.114224 May 23 13:29:38.803463 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 38/74] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 23 13:29:38 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:29:39.739774 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:29:39.741407 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-0adac2e8-052d-4727-acfb-663679acb8aa admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 May 23 13:29:39.741826 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 37/75] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 23 13:29:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:29:39.945601 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG nova.api.openstack.wsgi [None req-9be8ebe1-764d-4c28-9102-0c39a91e6592 admin admin] Calling method '>' {{(pid=103685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:29:39.946715 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 13:29:39.946715 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: warnings.warn(msg) May 23 13:29:39.947917 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-9be8ebe1-764d-4c28-9102-0c39a91e6592 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:29:39.948439 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-9be8ebe1-764d-4c28-9102-0c39a91e6592 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:29:39.949205 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-9be8ebe1-764d-4c28-9102-0c39a91e6592 admin admin] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:29:39.949633 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: DEBUG oslo_concurrency.lockutils [None req-9be8ebe1-764d-4c28-9102-0c39a91e6592 admin admin] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:29:39.971971 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: INFO nova.api.openstack.requestlog [None req-9be8ebe1-764d-4c28-9102-0c39a91e6592 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083167 May 23 13:29:39.972619 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: [pid: 103685|app: 0|req: 39/76] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 23 13:29:39 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:30:40.547636 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: Mon May 23 13:30:40 2022 - graceful shutdown triggered... May 23 13:30:40.547977 dv-cinder-825492-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 23 13:30:40.548808 dv-cinder-825492-14-iscsi devstack@n-api.service[103686]: Gracefully killing worker 2 (pid: 103686)... May 23 13:30:40.549202 dv-cinder-825492-14-iscsi devstack@n-api.service[103685]: Gracefully killing worker 1 (pid: 103685)... May 23 13:30:41.549988 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: worker 1 buried after 1 seconds May 23 13:30:41.549988 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: worker 2 buried after 1 seconds May 23 13:30:41.549988 dv-cinder-825492-14-iscsi devstack@n-api.service[103684]: goodbye to uWSGI. May 23 13:30:41.551518 dv-cinder-825492-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 23 13:30:41.552150 dv-cinder-825492-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 23 13:30:41.554911 dv-cinder-825492-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 13:30:41.576283 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 13:30:41.607725 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 13:30:41 2022] *** May 23 13:30:41.608628 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 13:30:41.608829 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 13:30:41.609017 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: nodename: dv-cinder-825492-14-iscsi May 23 13:30:41.609204 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: machine: x86_64 May 23 13:30:41.609380 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: clock source: unix May 23 13:30:41.609567 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: pcre jit disabled May 23 13:30:41.609752 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: detected number of CPU cores: 4 May 23 13:30:41.609924 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: current working directory: / May 23 13:30:41.610095 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: detected binary path: /usr/bin/uwsgi-core May 23 13:30:41.610331 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: your processes number limit is 47680 May 23 13:30:41.610567 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: your memory page size is 4096 bytes May 23 13:30:41.610778 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: detected max file descriptor number: 2048 May 23 13:30:41.611002 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: lock engine: pthread robust mutexes May 23 13:30:41.611451 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: thunder lock: enabled May 23 13:30:41.611978 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 13:30:41.612334 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 13:30:41.661362 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: Python main interpreter initialized at 0x5627e13229c0 May 23 13:30:41.661362 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: python threads support enabled May 23 13:30:41.661362 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: your server socket listen backlog is limited to 100 connections May 23 13:30:41.661362 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: your mercy for graceful operations on workers is 90 seconds May 23 13:30:41.662062 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: mapped 403077 bytes (393 KB) for 2 cores May 23 13:30:41.662062 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: *** Operational MODE: preforking *** May 23 13:30:41.662062 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: *** uWSGI is running in multiple interpreter mode *** May 23 13:30:41.662062 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: spawned uWSGI master process (pid: 124817) May 23 13:30:41.662333 dv-cinder-825492-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 13:30:41.663094 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: spawned uWSGI worker 1 (pid: 124830, cores: 1) May 23 13:30:41.663502 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: spawned uWSGI worker 2 (pid: 124831, cores: 1) May 23 13:30:41.663668 dv-cinder-825492-14-iscsi devstack@n-api.service[124817]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 13:30:42.914465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 13:30:42.929092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 13:30:43.718495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 13:30:43.718495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: from cryptography.utils import int_from_bytes May 23 13:30:43.718946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 13:30:43.718946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: from cryptography.utils import int_from_bytes May 23 13:30:43.968904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 13:30:43.968904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: from cryptography.utils import int_from_bytes May 23 13:30:43.969490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 13:30:43.969490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: from cryptography.utils import int_from_bytes May 23 13:30:46.431710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 13:30:46.432816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 13:30:46.433559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 13:30:46.433950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 13:30:46.434226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 13:30:46.434605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.434943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.435289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.435607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.435946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.436266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.436617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.436956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.437406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.437730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.438165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.438455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-14-iscsi {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.438792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.439107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.439444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.439751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.440186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.440398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.440742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.452770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.452770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.452770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.452770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.452770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.452770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-14-iscsi {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.453959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.454610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.454610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.454610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.454610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.454610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.454610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.454610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.454610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.455856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.456358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.456358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.456358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.456358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.457674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.457674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.457674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.457674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.458325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.458325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.458750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.458750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.459055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.460068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.460693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.461255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.461750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.462127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.462422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.462767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.463181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.463521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.463880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.464143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.464527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.464893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.465416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.465736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.466059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.466383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.466747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.467097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.467569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.468058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.468387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.468801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.469132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.469453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.469834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.470309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.470814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.471335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.471917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.472398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.473010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.473590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.474163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.474717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.475342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.475842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.476356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.476876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.484423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.484423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.484423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.484423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.484423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.484423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.484423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.484423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.485930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.486240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.486792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.487299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.487931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.488634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.489280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.489809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.490148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.490997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.491772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.492201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.492685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.493022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.493351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.493687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.494021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.494520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.495080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.495625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.496012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.496343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.496747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.497601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.498331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.498871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.499304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.499875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.500210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.500592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.500956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.501289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.501725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.502143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.502564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.502919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.503261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.503575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.503999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.504357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.504744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.505076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.505853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.506352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.506815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.507156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.507480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.507850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.508267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.508783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.509132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.509537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.509861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.510360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.511519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.512099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.512750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.518063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.518063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.518063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.518063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.518063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.518063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.518063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.518063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.519068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.519068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.519068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.519068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.519068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.519068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.519068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.519880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.520298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 13:30:46.520298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 13:30:46.521179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.521179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.521316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 13:30:46.521399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.521481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 13:30:46.521561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.522183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 13:30:46.522275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.522364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.522704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.522863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.523076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.523534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.523662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.523905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.524013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.524283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.524434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.524634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.524773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.525053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.525265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.525426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.525674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.525842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.526004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.526186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.526355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.526509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.526703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.526847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.527051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-14-iscsi {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.527228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.527418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.527565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.527732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.527900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.528083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.528236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.528429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.528643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.528816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.528989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.529149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.529316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.529460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.529602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.530450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.530676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.530837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.530992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.531181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.531326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.531476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.531632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.531802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.531955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.532100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.532242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.532393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.532736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.532903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.533069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.533387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.533536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.533536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.533889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.534057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-14-iscsi {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.535243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.535404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.535560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.535826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.536034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.536225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.536382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.536382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.536716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.536868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.537022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.537022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.538637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.538637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.539010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.539010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.539365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.539566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.539732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.540818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.541022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.541174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.541336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.541535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.541742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.541742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.543121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.543305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.543305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.543879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.543879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.544228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.544381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.544575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.544731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.544896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.545148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.545148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.545468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.545649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.545828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.546020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.546349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.546503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.546912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.547064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.547217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.547411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.547563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.547732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.547889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.548437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.548607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.556229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.556402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.556551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.556698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.556824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.556824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.557005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.557095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.557189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.557285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.557368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.557460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.557551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.557643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.557742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.557835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.557927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.558020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.558104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.558194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.558285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.558368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.558450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.558546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.558637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.558745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.558836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.558922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.559039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.559146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.559239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.559332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.559412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.559491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.559577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.559662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.559747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.559836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.559836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.559991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.560082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.560166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.560245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.560323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.560419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.560419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.560602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.560697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.560779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.560852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.560921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.561006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.561086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.561169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.561250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.561336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.561422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.561512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.561597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.561680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.561768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.561854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.561933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.562022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.562106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.562197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.562288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.562379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.562463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.562551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.562645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.562731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.562804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.562889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.562971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.563058 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.563462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.563562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.563653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.563738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.563983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.564087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.564173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.564256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.564347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.564431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.564527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.564655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.564750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.564843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.564935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.565028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.565121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.565213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.565298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.565382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.565465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.565561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.565662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.565747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.565836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.565933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.566025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.566116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.566207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.566302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.566387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.566482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.566574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.566659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.566766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.566887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.566887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.567048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.567142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.567254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.567337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.567419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.567511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.567596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.567679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.567769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.567861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.567951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.568045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.568137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.568230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.568314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.568749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.568919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.569112 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.569219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.569313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.569313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.569465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.569552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.569650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.569744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.569834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.569918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.570002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.570093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.570186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.570270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.570353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.570424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.570514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.570660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.570753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.570884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.571020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.571149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.571269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.571368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 13:30:46.571454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.571545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.571643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.571735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.571820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.571820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.571971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.572092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.572308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.572397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.572489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.572591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.572591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.572864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.572999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.573119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.573298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.573626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.573722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.573901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.574964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.575939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.576020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.576020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.576156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.576156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.576299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.576475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.576597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.577655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.577826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.577993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.578152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.578302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.578449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.578612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.578769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.578918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.579064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.579064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.579359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.579514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.579671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.579819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.579973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.579973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.580261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.580416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.580631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.580789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.580937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.581093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.581248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.581398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.581559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.581717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.581812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.581904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.581996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.582095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.582184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.582350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.582561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.582666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.582799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.582900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.582986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.583065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.583226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.583308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.583380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.583461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.583852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.584017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.584215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.584354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.584454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.584553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.584670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.584756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.584906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.585301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.585530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.585643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.585729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.585841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.586048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.586177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.586362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.586516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.586645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.586824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.586979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.587382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.587546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.587644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.587793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.587958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.588050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.588178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.588280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.588500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.588694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.588846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.588950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.589161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.589262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.589483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.589576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.589850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.590006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.590160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.590304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.590472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.590572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.590801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.590949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.591110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.591212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.591421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.591610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.591788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.591932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.592084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.592222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.592358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.592486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.592669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.592819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.592978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.593138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.593275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.593402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.593589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.593767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.594121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.594279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.594470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.594631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.594767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.594927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.595064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.595219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.595339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.595456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.595625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.595818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.596007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.596148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.596148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.596405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.596658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.596797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.596797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.597116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.597290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.597420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.597556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.597692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.597844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.598097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.598097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.598354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.598560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.598758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.598956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.599160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.599374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.599538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.600250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.600457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.600637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.600789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.600906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.601090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.601090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.601345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.601482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.601601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.601721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.601849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.602027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.602183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.602318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.602446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.602572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.602717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.602855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.603020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.603162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.603278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.603406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.603546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.603697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.603828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.603956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.604135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.604422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.604735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.604881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.605019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.605168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.605330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.605587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.605729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.605865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.606048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.606243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.606429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.606630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.606820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.607011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.607218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.607433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.607574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.607847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.607982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.608117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.608351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.608524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.608747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.608747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.609054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.609191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.609313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.609465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.609653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.609848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.610035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.610172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.610292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.610292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.610292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.610748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.610864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.610980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.611089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.611254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.611418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.611565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.611759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.611886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.612035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.612207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.612399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.612607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.612811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.612990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.613165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.613454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.613637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.613833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.614005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.614179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.614389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.614743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.614947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.615143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.615304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.615533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.615533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.615986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.615986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.615986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.615986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.616947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.617104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.617267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.617433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.617642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.617810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.617976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.618154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.618324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.618516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.618726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.618904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.618904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.619230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.619402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.619567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.619567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.619906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.619906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.620207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.620338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.620489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.621448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.621642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.621824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.621977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.622126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.622255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.622425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.622606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.622811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.623007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.623223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.623515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.623721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.623919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.624081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.624257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.624456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.624720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.624925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.625119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.625346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.625551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.625736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.625870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.625998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.626125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.626321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.626491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.626622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.626756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.626884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.627020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.627157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.627294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.627432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.627591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.627769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.627936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.628074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.628210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.628357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.628490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.628727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.628954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.629166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.629365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.629572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.629756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.629898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.630068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.630251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.630402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.630531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.630667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.630848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.631698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.631857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.632057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.632201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.632338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.632501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.632691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.632822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.632995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.633193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.633396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.633622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.633829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.634041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.634245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.634447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.634645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.634865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.635082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.635279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.635492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.635700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.635920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.636136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.636333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.636541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.636785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.636785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.637204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.637433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.637643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.637845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.638047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.638240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.638454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.638652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.638849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.639059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.639264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.639467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.639684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.639890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.640093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.640294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.640497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.640739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.640954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.641171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.641385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.641602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.641814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.642015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.642223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.642427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.642638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.642860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.643057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.643259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.643459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.643662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.643894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.644101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.644313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.644509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.644722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.644818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.645891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.646054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.646467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.646636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.646848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.646977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.648288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.648517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.648842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.648932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.649979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.650122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.650240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.650240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.650471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.650471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.650656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.650734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.650813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.650946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.651094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.651248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.651394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.651542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.651689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.651836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.651983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.652143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.652281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.652431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.652841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.653950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.654020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.654099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.654181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.654181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.654584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.654699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.654809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.654934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.655057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.655179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.655291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.655400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.655516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.655635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.655755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.655879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.656710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.656844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.656965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.657085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.657197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.657322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.657435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.657553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.657665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.657783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.658013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.658168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.658313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.658457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.658910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.659075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.659188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.659306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.659306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.659545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.659694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.659824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.659945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.660059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.660151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.660294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.660399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.660494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.660607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.660684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.660768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.660947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.661938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.662204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.662913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.663015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.663103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.663216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.663307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.663516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.663622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.663719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.663806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.663934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.664039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.664213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.664306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.664380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.664459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.664531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.664681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.664878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.665000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.665112 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.665223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.665340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.665464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.665629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.665743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.665854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.665854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.666095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.667124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.667253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.667376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.667489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.667670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.667800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.667800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.668128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.668128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.668345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.668456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.668708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.668860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.669158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.669342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.669481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.669481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.669481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.669850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.669980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.669980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.670225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.670511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.670607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.670870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.671214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.671468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.671698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.671833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.672163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.672277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.672512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.672647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.672892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.672991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.673215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.673324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.673526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.673618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.673862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.673972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.674182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.674309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.674495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.674700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.674851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.674965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.675188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.675347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.675587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.675811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.675969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.676075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.676302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.676516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.676651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.676877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.677052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.677230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.677452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.677552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.678019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.678242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.678414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.678741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.678843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.679081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.679986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.680103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.680262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.680373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.680462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.680584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.680677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.680762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.680863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.680940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.681178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.681379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.681505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.681692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.682016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.682131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.682344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.682507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.682710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.682911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.683237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.683383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.683485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.683660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.683880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.683985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.684245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.684346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.684667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.684770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.684920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.685080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.685275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.685421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.685639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.685728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.686074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.686188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.686413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.686545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.686877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.687076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.687076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.687398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.687574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.687744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.687835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.687983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.688145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.688371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.688501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.688639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.688744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.689055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.689313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.689473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.689702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.689916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.690064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.690169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.690392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.690528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.690721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.690889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.691056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.691152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.691415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.691586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.691743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.691938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.692209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.692406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.692719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.692859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.693069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.693235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.693331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.694079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.694219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.694334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.694437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.694651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.694801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.694990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.695116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.695312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.695455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.695633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.695741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.695952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.696048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.696294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.696411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.696642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.697501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.697712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.699182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.699350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.699501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.699656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.699928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.700140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.700524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.700779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.700924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.700924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.701200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.701330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.701508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.701649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.702874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.703961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.703961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.703961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.704493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.704493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.704795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.704947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.705097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.705249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.705409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.705550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.705702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.705840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.705982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.706528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.706691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.706831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.706980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.707132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.707282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.707452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.707678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.707948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.708095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.708257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.708424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.708424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.708786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.709206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.709374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.709539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.709902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.710073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.710287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.710483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.710686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.710876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.711155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.711465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.711465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.711950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.712167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.712414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.712670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.712884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.712884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.713277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.713482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.713690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.713918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.714127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.714343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.714547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.714748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.714748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.715142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.715340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.715555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.715767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.715979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.716191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.716403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.716659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.716859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.717067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.717265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.717480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.717726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.717932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.718129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.718339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.718538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.718750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.718954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.719149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.719335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.719525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.719723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.720064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.720272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.720469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.720687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.720904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.721133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.721340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.721545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.721744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.721944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.722135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.722345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.722553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.722764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.722965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.723171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.723369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.723592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.723797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.724005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.724206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.724412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.724726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.725506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.725714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.725922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.726277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.726482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.726776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.726998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.727289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.727496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.727702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.727896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.728101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.728841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.729039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.729039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.729455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.729668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.729891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.730244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.730452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.730643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.730827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.731031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.731220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.731407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.731658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.731843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.732040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.732246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.732450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.732782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.732984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.733188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.733380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.733764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.733956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.734160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.734351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.734551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.734735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.734735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.735125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.735389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.735611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.735834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.736060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.736060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.736461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.736714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.736714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.736714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.737273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.737479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.737683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.737885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.737885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.738241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.738455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.738649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.738849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.739034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.739293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.739293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.739293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.739847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.740042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.740042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.740856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.741305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.741858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.742066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.742269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.742533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.742804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.743056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.743247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.743443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.743633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.743839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.744057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.744261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.744451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.744662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.744886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 13:30:46.745092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.745092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.745092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.745092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.745092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.745092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.745092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.745092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.746667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.746667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.746667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.746667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.746667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.746667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.746667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.746667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.748220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.748220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.748220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.748220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.748220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.748220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.748220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.748220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.749655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.749655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.749655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.749655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.749655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.749655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.749655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.749655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.751219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.751219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.751219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.751219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.751219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.751219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.751219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.751219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.752742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.752742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.752742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.752742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.752742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.752742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.752742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.754321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.754321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.754321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.754321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.754988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.754988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.755355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.755355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.755717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.755948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.757129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.757363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.757785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.758140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.758534 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.758896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.759218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.759549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.759871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.760199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.760716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.761095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.761342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.761656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.761996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.762321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.762661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.762990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.763317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.763744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.764054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.764716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.765071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.765411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.765767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.766114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.766437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.766754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.767120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.767578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.767844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.768083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.768361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.768714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.769040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.769364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.769691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.770013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.770337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.770792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.771330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.771330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.771856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.772283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.772844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.773184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.773518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.773851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.774329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.774576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.774856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.775238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.775494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.775888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.776216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.776538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.777017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.777344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.777821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.778240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.778473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.778791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.779039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.779283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.779602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.780016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.780398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.780785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.781436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.781436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.781914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.782153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.782392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.782690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.783022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.783344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.783659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.783975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.784299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.784702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.784947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.785258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.785571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.785892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.786931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.788275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.789076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.789076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.789581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.789832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.790072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.790320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.790651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.790970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.791291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.792321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.792321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.792800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.793078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.793319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.793546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.793847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.794119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.794461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.794894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.795153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.795418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.795773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.796098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.796423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.797077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.797405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.797730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.798055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.798526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.798911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.799634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.799634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.800104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.800353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Registered counter for database nova_api May 23 13:30:46.800625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.800625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.801100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.801100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.801564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.801798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.802060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.802747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.802747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.803276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.803746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.804094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.804437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.804787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.805192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.805441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.805816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.806141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.806504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.807116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.807379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.807661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.807981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 13:30:46.808225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 13:30:46.822283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:30:46.836332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:30:46.874980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Registered counter for database nova_api May 23 13:30:46.896862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:30:46.904650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:30:46.948902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.context [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dc388de-d5ca-467c-ab01-a163e12270ad(cell1) {{(pid=124831) load_cells /opt/stack/nova/nova/context.py:464}} May 23 13:30:46.957206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:30:46.961540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:30:46.963332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:30:46.966730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.context [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dc388de-d5ca-467c-ab01-a163e12270ad(cell1) {{(pid=124830) load_cells /opt/stack/nova/nova/context.py:464}} May 23 13:30:46.967524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:30:46.971149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:30:46.971674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Registered counter for database nova_cell0 May 23 13:30:46.972816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:30:46.973665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:30:46.976164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:30:46.978258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Registered counter for database nova_cell0 May 23 13:30:46.980023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Registered counter for database nova_cell1 May 23 13:30:46.982356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Registered counter for database nova_cell1 May 23 13:30:46.990191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:30:46.993984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:30:46.998380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:30:47.000444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:30:47.007302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:30:47.009896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:30:47.150332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:30:47.156883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:30:47.168201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Registered counter for database nova_cell0 May 23 13:30:47.169806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Registered counter for database nova_cell0 May 23 13:30:47.178437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:30:47.180275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 13:30:47.185947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:30:47.186224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 13:30:47.525222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 13:30:47.532643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 13:30:47.643379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 13:30:47.651260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 13:30:47.886577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 13:30:47.892734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-4388294c-f41a-489c-9365-aa5067714ebb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 13:30:47.898699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5627e13229c0 pid: 124830 (default app) May 23 13:30:48.000785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 13:30:48.007794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-17c87cc6-156f-47cb-bf74-6712639ee28d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 13:30:48.013485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5627e13229c0 pid: 124831 (default app) May 23 13:31:34.701407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:34.702437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:34.703185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:34.704194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:35.964683 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fe07f37e-cec3-4ae7-8d32-a75589e02913 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Action: 'create', calling method: .version_select at 0x7effb4693b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1787497592", "metadata": {"Type": "work"}}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fe07f37e-cec3-4ae7-8d32-a75589e02913 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Request method failure captured: May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 122 May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4y27QlqQ8uIEL58yxR0-BWv2Qw0MMGvM4BioY-ZdZ5jMimk46J8-unYmdGiAk46pXOML_EsUV4JppbMQ26uPJd-j_I8U3Vbi90r8bOavdk8cgXDsK9PqU9Wllz4eWuOOBaXWn6H-qpofGUzCGib2Yy3oYg9ymMmMXU-EWNeFtcKTrc May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:31:35.991720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}] May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-1583766592 May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 3aac0dd890184a748ce19248bc9caf4d May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1787497592", "metadata": {"Type": "work"}}} May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: May 23 13:31:35.993776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1787497592', 'metadata': {'Type': 'work'}}}} May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise error May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi '#$%' May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:31:35.994719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 13:31:35.997359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 13:31:35.998664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 13:31:35.998664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:36.002123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fe07f37e-cec3-4ae7-8d32-a75589e02913 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:31:36.003344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fe07f37e-cec3-4ae7-8d32-a75589e02913 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.307573 May 23 13:31:36.004543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1155 bytes} [Mon May 23 13:31:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1311 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:31:36.018288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:36.019164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:36.020352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:36.021123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:36.341762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-717648a6-3ac3-4ff2-ab67-7008e529e829 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Action: 'create', calling method: .version_select at 0x7effb46ad940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1818981811", "metadata": {"Type": "work"}}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-717648a6-3ac3-4ff2-ab67-7008e529e829 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Request method failure captured: May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 120 May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4y27QlqQ8uIEL58yxR0-BWv2Qw0MMGvM4BioY-ZdZ5jMimk46J8-unYmdGiAk46pXOML_EsUV4JppbMQ26uPJd-j_I8U3Vbi90r8bOavdk8cgXDsK9PqU9Wllz4eWuOOBaXWn6H-qpofGUzCGib2Yy3oYg9ymMmMXU-EWNeFtcKTrc May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:31:36.346534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}] May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesNegativeTest-1583766592 May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 3aac0dd890184a748ce19248bc9caf4d May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1818981811", "metadata": {"Type": "work"}}} May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: May 23 13:31:36.348096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1818981811', 'metadata': {'Type': 'work'}}}} May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise error May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi '0' May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:31:36.349002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 13:31:36.350583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 13:31:36.353441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 13:31:36.353441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:36.353441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-717648a6-3ac3-4ff2-ab67-7008e529e829 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:31:36.353441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-717648a6-3ac3-4ff2-ab67-7008e529e829 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.336618 May 23 13:31:36.354799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1/2] 10.222.0.70 () {60 vars in 1155 bytes} [Mon May 23 13:31:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 345 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:31:36.372779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b62b4b80-fa05-4cf0-93e1-deaf87a9364d tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Action: 'create', calling method: .version_select at 0x7effb4597e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2077421615", "metadata": {"Type": "work"}}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b62b4b80-fa05-4cf0-93e1-deaf87a9364d tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Request method failure captured: May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 119 May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4y27QlqQ8uIEL58yxR0-BWv2Qw0MMGvM4BioY-ZdZ5jMimk46J8-unYmdGiAk46pXOML_EsUV4JppbMQ26uPJd-j_I8U3Vbi90r8bOavdk8cgXDsK9PqU9Wllz4eWuOOBaXWn6H-qpofGUzCGib2Yy3oYg9ymMmMXU-EWNeFtcKTrc May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:31:36.376538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}] May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-1583766592 May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 3aac0dd890184a748ce19248bc9caf4d May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2077421615", "metadata": {"Type": "work"}}} May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: May 23 13:31:36.378457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2077421615', 'metadata': {'Type': 'work'}}}} May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise error May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi '' May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:31:36.379244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 13:31:36.380783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 13:31:36.382041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 13:31:36.382041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:36.383123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b62b4b80-fa05-4cf0-93e1-deaf87a9364d tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:31:36.384184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b62b4b80-fa05-4cf0-93e1-deaf87a9364d tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027599 May 23 13:31:36.384998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1155 bytes} [Mon May 23 13:31:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:31:36.404795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50078a02-153d-4f65-849d-2c3c10b22de7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Calling method '.version_select at 0x7effb4eac310>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:37.044979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-50078a02-153d-4f65-849d-2c3c10b22de7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] HTTP exception thrown: Volume tempest-invalid-1282310840 could not be found. May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50078a02-153d-4f65-849d-2c3c10b22de7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Request method failure captured: May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1282310840 HTTP/1.1 May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4y27QlqQ8uIEL58yxR0-BWv2Qw0MMGvM4BioY-ZdZ5jMimk46J8-unYmdGiAk46pXOML_EsUV4JppbMQ26uPJd-j_I8U3Vbi90r8bOavdk8cgXDsK9PqU9Wllz4eWuOOBaXWn6H-qpofGUzCGib2Yy3oYg9ymMmMXU-EWNeFtcKTrc May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:31:37.047486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}] May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesNegativeTest-1583766592 May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 3aac0dd890184a748ce19248bc9caf4d May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Volume tempest-invalid-1282310840 could not be found. May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': 'tempest-invalid-1282310840'} May 23 13:31:37.050725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1282310840 could not be found. (HTTP 404) (Request-ID: req-a1f7717c-e43f-40a9-b7a1-8d4c35b2532e) May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:37.056520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 13:31:37.058621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1282310840 could not be found. May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:31:37.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1282310840 could not be found. May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1282310840 could not be found. May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50078a02-153d-4f65-849d-2c3c10b22de7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Returning 404 to user: Volume tempest-invalid-1282310840 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50078a02-153d-4f65-849d-2c3c10b22de7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1282310840" status: 404 len: 99 microversion: 2.1 time: 0.656544 May 23 13:31:37.062401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1217 bytes} [Mon May 23 13:31:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1282310840 => generated 99 bytes in 658 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 23 13:31:37.063609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3f19f4de-812f-4de7-8679-477ef91e47d5 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005248 May 23 13:31:37.067080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 3/5] 10.222.0.70 () {58 vars in 1139 bytes} [Mon May 23 13:31:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 13:31:37.075899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4d451b27-2fd1-4059-830f-ae2f07c713f5 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007542 May 23 13:31:37.076672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 3/6] 10.222.0.70 () {58 vars in 1136 bytes} [Mon May 23 13:31:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 23 13:31:37.094890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c1b4cc60-9ef9-402b-bc3d-77bd689d80e3 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Calling method '.version_select at 0x7effb4693ca0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:37.344092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-c1b4cc60-9ef9-402b-bc3d-77bd689d80e3 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] HTTP exception thrown: Volume cff064bc-d314-4656-bbc1-ec2a41198f73 could not be found. May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c1b4cc60-9ef9-402b-bc3d-77bd689d80e3 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Request method failure captured: May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/os-volumes/cff064bc-d314-4656-bbc1-ec2a41198f73 HTTP/1.1 May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4y27QlqQ8uIEL58yxR0-BWv2Qw0MMGvM4BioY-ZdZ5jMimk46J8-unYmdGiAk46pXOML_EsUV4JppbMQ26uPJd-j_I8U3Vbi90r8bOavdk8cgXDsK9PqU9Wllz4eWuOOBaXWn6H-qpofGUzCGib2Yy3oYg9ymMmMXU-EWNeFtcKTrc May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:31:37.347982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}] May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-1583766592 May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 3aac0dd890184a748ce19248bc9caf4d May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Volume cff064bc-d314-4656-bbc1-ec2a41198f73 could not be found. May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'cff064bc-d314-4656-bbc1-ec2a41198f73'} May 23 13:31:37.349143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cff064bc-d314-4656-bbc1-ec2a41198f73 could not be found. (HTTP 404) (Request-ID: req-cb60e83b-352b-40b8-a42d-b8552697171c) May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:37.349950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 13:31:37.350997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cff064bc-d314-4656-bbc1-ec2a41198f73 could not be found. May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 13:31:37.352093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cff064bc-d314-4656-bbc1-ec2a41198f73 could not be found. May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cff064bc-d314-4656-bbc1-ec2a41198f73 could not be found. May 23 13:31:37.353201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:31:37.355709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c1b4cc60-9ef9-402b-bc3d-77bd689d80e3 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Returning 404 to user: Volume cff064bc-d314-4656-bbc1-ec2a41198f73 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:31:37.357286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c1b4cc60-9ef9-402b-bc3d-77bd689d80e3 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/cff064bc-d314-4656-bbc1-ec2a41198f73" status: 404 len: 109 microversion: 2.1 time: 0.271994 May 23 13:31:37.358007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 13:31:37 2022] DELETE /compute/v2.1/os-volumes/cff064bc-d314-4656-bbc1-ec2a41198f73 => generated 109 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 13:31:37.371335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d9a8deb-8b20-4b36-a1f1-1ac1ecb1def7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Calling method '.version_select at 0x7effb462f0d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:37.621055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-6d9a8deb-8b20-4b36-a1f1-1ac1ecb1def7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] HTTP exception thrown: Volume 8c9d81df-a663-48c3-ae07-486dd47749ae could not be found. May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d9a8deb-8b20-4b36-a1f1-1ac1ecb1def7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Request method failure captured: May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/os-volumes/8c9d81df-a663-48c3-ae07-486dd47749ae HTTP/1.1 May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4y27QlqQ8uIEL58yxR0-BWv2Qw0MMGvM4BioY-ZdZ5jMimk46J8-unYmdGiAk46pXOML_EsUV4JppbMQ26uPJd-j_I8U3Vbi90r8bOavdk8cgXDsK9PqU9Wllz4eWuOOBaXWn6H-qpofGUzCGib2Yy3oYg9ymMmMXU-EWNeFtcKTrc May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:31:37.622532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/195b606304014f5189b7c349b1c3a7cb"}]}] May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesNegativeTest-1583766592 May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 195b606304014f5189b7c349b1c3a7cb May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesNegativeTest-1583766592 May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 3aac0dd890184a748ce19248bc9caf4d May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesNegativeTest-1583766592-project May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Volume 8c9d81df-a663-48c3-ae07-486dd47749ae could not be found. May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '8c9d81df-a663-48c3-ae07-486dd47749ae'} May 23 13:31:37.623897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c9d81df-a663-48c3-ae07-486dd47749ae could not be found. (HTTP 404) (Request-ID: req-0dd7f913-2ecc-4150-9606-bfcb7f8e2839) May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:37.624907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 13:31:37.625874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c9d81df-a663-48c3-ae07-486dd47749ae could not be found. May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 13:31:37.626760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c9d81df-a663-48c3-ae07-486dd47749ae could not be found. May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c9d81df-a663-48c3-ae07-486dd47749ae could not be found. May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d9a8deb-8b20-4b36-a1f1-1ac1ecb1def7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] Returning 404 to user: Volume 8c9d81df-a663-48c3-ae07-486dd47749ae could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6d9a8deb-8b20-4b36-a1f1-1ac1ecb1def7 tempest-VolumesNegativeTest-1583766592 tempest-VolumesNegativeTest-1583766592-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8c9d81df-a663-48c3-ae07-486dd47749ae" status: 404 len: 109 microversion: 2.1 time: 0.258896 May 23 13:31:37.627587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 13:31:37 2022] GET /compute/v2.1/os-volumes/8c9d81df-a663-48c3-ae07-486dd47749ae => generated 109 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 13:31:39.333651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1301474318", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "networks": [{"uuid": "bf311a5a-c35e-477f-9017-9ffa53b80337"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:31:39.515761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] validate_networks() for [('bf311a5a-c35e-477f-9017-9ffa53b80337', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:31:42.046557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:31:42.047716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:31:42.048561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:31:42.049300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:31:42.049884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:31:42.115334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:42.118426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:42.126460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:42.127906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:42.211206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Getting quotas for project 3f643c268087457e88f3ddabe8715a87. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:31:42.219662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Getting quotas for user 1d30c6c8fd1248908948c1a23ebf15b8 and project 3f643c268087457e88f3ddabe8715a87. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:31:42.234429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:31:42.237807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:31:42.444393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dacf1287-bec5-4a8e-a10e-ddbb2b940694 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.372639 May 23 13:31:42.457084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2715defd-1164-4700-b556-9ac3d2e1516e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:42.459476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 5/9] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:31:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 13:31:42.464100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2715defd-1164-4700-b556-9ac3d2e1516e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:43.176168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2715defd-1164-4700-b556-9ac3d2e1516e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:43.223337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2715defd-1164-4700-b556-9ac3d2e1516e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1215 microversion: 2.1 time: 0.765635 May 23 13:31:43.238339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 5/10] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:42 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1215 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:44.243630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9df01a3c-e3b3-47ec-8d9c-1c6ffc772cc4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:44.244256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9df01a3c-e3b3-47ec-8d9c-1c6ffc772cc4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:44.404837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9df01a3c-e3b3-47ec-8d9c-1c6ffc772cc4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:44.438914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9df01a3c-e3b3-47ec-8d9c-1c6ffc772cc4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1215 microversion: 2.1 time: 0.200054 May 23 13:31:44.449145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 6/11] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:44 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:45.455738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1e51ef9-ba1e-46d9-aeca-52d8de9e0361 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:45.457352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1e51ef9-ba1e-46d9-aeca-52d8de9e0361 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:45.575761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1e51ef9-ba1e-46d9-aeca-52d8de9e0361 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:45.587040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1e51ef9-ba1e-46d9-aeca-52d8de9e0361 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1215 microversion: 2.1 time: 0.134937 May 23 13:31:45.601803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:45 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:46.605744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-247d51fa-50df-4a8a-bd78-77fbad9c1201 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:46.607375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-247d51fa-50df-4a8a-bd78-77fbad9c1201 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:46.615017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-247d51fa-50df-4a8a-bd78-77fbad9c1201 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:46.616004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-247d51fa-50df-4a8a-bd78-77fbad9c1201 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:46.626642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-247d51fa-50df-4a8a-bd78-77fbad9c1201 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:46.628654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-247d51fa-50df-4a8a-bd78-77fbad9c1201 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:47.158224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-247d51fa-50df-4a8a-bd78-77fbad9c1201 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:47.192593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-247d51fa-50df-4a8a-bd78-77fbad9c1201 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1219 microversion: 2.1 time: 0.592222 May 23 13:31:47.211552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:46 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1219 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:48.217648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c757541d-7bc6-416d-9a1a-0ffb08e5baa5 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:48.219191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c757541d-7bc6-416d-9a1a-0ffb08e5baa5 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:48.230105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c757541d-7bc6-416d-9a1a-0ffb08e5baa5 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:48.230987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c757541d-7bc6-416d-9a1a-0ffb08e5baa5 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:48.233523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c757541d-7bc6-416d-9a1a-0ffb08e5baa5 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:48.234203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c757541d-7bc6-416d-9a1a-0ffb08e5baa5 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:48.518941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c757541d-7bc6-416d-9a1a-0ffb08e5baa5 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:48.546402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c757541d-7bc6-416d-9a1a-0ffb08e5baa5 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1219 microversion: 2.1 time: 0.333450 May 23 13:31:48.546985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 7/14] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:48 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1219 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:49.563398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-47c1a126-f4eb-4170-94a4-fcb462edd141 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:49.563927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-47c1a126-f4eb-4170-94a4-fcb462edd141 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:49.577874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47c1a126-f4eb-4170-94a4-fcb462edd141 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:49.578338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47c1a126-f4eb-4170-94a4-fcb462edd141 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:49.580291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47c1a126-f4eb-4170-94a4-fcb462edd141 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:49.581341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47c1a126-f4eb-4170-94a4-fcb462edd141 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:49.788777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-47c1a126-f4eb-4170-94a4-fcb462edd141 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:49.810505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-47c1a126-f4eb-4170-94a4-fcb462edd141 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1219 microversion: 2.1 time: 0.245555 May 23 13:31:49.811184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 8/15] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:49 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1219 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:50.828701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c80997df-cd9f-4020-9843-9d6c7017d67f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:50.829438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c80997df-cd9f-4020-9843-9d6c7017d67f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:50.842425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80997df-cd9f-4020-9843-9d6c7017d67f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:50.842896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80997df-cd9f-4020-9843-9d6c7017d67f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:50.844986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80997df-cd9f-4020-9843-9d6c7017d67f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:50.845453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80997df-cd9f-4020-9843-9d6c7017d67f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:51.064409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c80997df-cd9f-4020-9843-9d6c7017d67f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:51.076903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c80997df-cd9f-4020-9843-9d6c7017d67f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1211 microversion: 2.1 time: 0.252131 May 23 13:31:51.089574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:50 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1211 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:52.097664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4aa92c23-f8c9-4e4d-9f47-95e8f38dab28 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:52.099426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4aa92c23-f8c9-4e4d-9f47-95e8f38dab28 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:52.149005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4aa92c23-f8c9-4e4d-9f47-95e8f38dab28 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:52.149194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4aa92c23-f8c9-4e4d-9f47-95e8f38dab28 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:52.155151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4aa92c23-f8c9-4e4d-9f47-95e8f38dab28 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:52.158158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4aa92c23-f8c9-4e4d-9f47-95e8f38dab28 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:52.164089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:52.289307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0a62e132-0b2c-427a-872d-76de8f5c4907 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'create', calling method: .version_select at 0x7effb32aa310>, body: {"keypair": {"name": "tempest-keypair-1977509464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJowj87sJ3/+xh1NEnifmQw5kGCGvCbKlhrXKVFCdaioI8GaWCY9PVB2y1+hyhwRkN+5l+yXaIxG4zmMHVaZY8eqV32krFmUq4VqgTAtnepvx3X46d3h6cB9FF90gF2HJg=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:31:52.349004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-0a62e132-0b2c-427a-872d-76de8f5c4907 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Getting quotas for project 611e3a80618d4d4dbfb150456f0d3502. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:31:52.370277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-0a62e132-0b2c-427a-872d-76de8f5c4907 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Getting quotas for user b3eae736c69843ceadc6cbdb258b7195 and project 611e3a80618d4d4dbfb150456f0d3502. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:31:52.573284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0a62e132-0b2c-427a-872d-76de8f5c4907 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.840106 May 23 13:31:52.580313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 9/17] 10.222.0.70 () {62 vars in 1199 bytes} [Mon May 23 13:31:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 849 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 13:31:52.682494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5b5534a-b808-4638-88fb-aa39d4ca47fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: .version_select at 0x7effb32aa3a0>, body: {"keypair": {"name": "tempest-keypair-1917221040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf6ldGh4CgarSwn/aPzMQdHmKT7QWmwP0hCAe+xugw7J5n1kmptHFoIWct6TTD7J7l50ce2Zcw2NoXW/wSTGZpCgovUV03X6FYn/x8GOLq/bgT0WXNpy/eBO7+8Op/XKw=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:31:52.750493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f5b5534a-b808-4638-88fb-aa39d4ca47fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for project 7649fa9a0ae4411aabf060f99e691520. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:31:52.768396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f5b5534a-b808-4638-88fb-aa39d4ca47fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for user cf30fa512142489a8dea40ce426a5f36 and project 7649fa9a0ae4411aabf060f99e691520. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:31:52.941192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5b5534a-b808-4638-88fb-aa39d4ca47fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.354707 May 23 13:31:52.941192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 10/18] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 13:31:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:31:53.236448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4aa92c23-f8c9-4e4d-9f47-95e8f38dab28 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:53.257954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4aa92c23-f8c9-4e4d-9f47-95e8f38dab28 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1275 microversion: 2.1 time: 1.164991 May 23 13:31:53.262588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 9/19] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:52 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1275 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:54.277426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e82ba7dc-9707-45da-a0e4-126e4317cff2 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:54.278208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e82ba7dc-9707-45da-a0e4-126e4317cff2 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:54.322288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82ba7dc-9707-45da-a0e4-126e4317cff2 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:54.325286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82ba7dc-9707-45da-a0e4-126e4317cff2 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:54.326263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82ba7dc-9707-45da-a0e4-126e4317cff2 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:54.331215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82ba7dc-9707-45da-a0e4-126e4317cff2 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:55.439036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e82ba7dc-9707-45da-a0e4-126e4317cff2 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:55.439036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e82ba7dc-9707-45da-a0e4-126e4317cff2 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1273 microversion: 2.1 time: 1.089258 May 23 13:31:55.439036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 11/20] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:54 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1273 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:56.321711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:31:56.452078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6bce19f7-aa34-4971-8bac-299c4fa86300 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:56.464065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6bce19f7-aa34-4971-8bac-299c4fa86300 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:56.503992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bce19f7-aa34-4971-8bac-299c4fa86300 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:56.517643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bce19f7-aa34-4971-8bac-299c4fa86300 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:56.519789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bce19f7-aa34-4971-8bac-299c4fa86300 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:56.524964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bce19f7-aa34-4971-8bac-299c4fa86300 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:56.549169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b8adba60-2733-4f16-b0eb-baeae9a3efef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Action: 'create', calling method: .version_select at 0x7effb447d820>, body: {"keypair": {"name": "tempest-keypair-1797391439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbnz2UygU50ttS5XykplljbWu0DcL0CF2altauNYqJhj/TDcZpnLmtapt0PV7mSLMn+ipyEmj6ArGaU4AXpuzohIEGs74mxRjqihkhdCgdM14dV3DtRyHOV6raqd7tn6w=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:31:56.689794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-b8adba60-2733-4f16-b0eb-baeae9a3efef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Getting quotas for project 6bb9e74e9b64480a80d45a03945ea51f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:31:56.714862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-b8adba60-2733-4f16-b0eb-baeae9a3efef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Getting quotas for user a58edb91d7b641298e40dd356eec9eac and project 6bb9e74e9b64480a80d45a03945ea51f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:31:56.914874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b8adba60-2733-4f16-b0eb-baeae9a3efef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.603156 May 23 13:31:56.916092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 10/21] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 13:31:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:31:57.606352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6bce19f7-aa34-4971-8bac-299c4fa86300 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:31:57.616408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6bce19f7-aa34-4971-8bac-299c4fa86300 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 1.172705 May 23 13:31:57.626037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 12/22] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:56 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:31:58.654657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d87fb8d7-2307-44ec-bc57-026e8590b8e4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:31:58.676130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d87fb8d7-2307-44ec-bc57-026e8590b8e4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:31:58.676130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d87fb8d7-2307-44ec-bc57-026e8590b8e4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:58.676130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d87fb8d7-2307-44ec-bc57-026e8590b8e4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:58.676130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d87fb8d7-2307-44ec-bc57-026e8590b8e4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:31:58.677231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d87fb8d7-2307-44ec-bc57-026e8590b8e4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:31:59.685614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-692668922", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:31:59.827372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] validate_networks() for [('861d496f-1a1a-40b6-9eb0-bf781ce919c3', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:32:00.303657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d87fb8d7-2307-44ec-bc57-026e8590b8e4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:00.331454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d87fb8d7-2307-44ec-bc57-026e8590b8e4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 1.687573 May 23 13:32:00.345546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 11/23] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:31:58 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:01.372705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e037bd7-1573-430c-ae74-4958e2bf7902 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:01.373446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e037bd7-1573-430c-ae74-4958e2bf7902 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:01.393977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e037bd7-1573-430c-ae74-4958e2bf7902 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:01.401223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e037bd7-1573-430c-ae74-4958e2bf7902 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:01.411558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e037bd7-1573-430c-ae74-4958e2bf7902 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:01.419017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e037bd7-1573-430c-ae74-4958e2bf7902 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:02.763898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e037bd7-1573-430c-ae74-4958e2bf7902 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:02.781537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e037bd7-1573-430c-ae74-4958e2bf7902 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 1.428403 May 23 13:32:02.784626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 12/24] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:01 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:02.805652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=16 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:03.262060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-486a8e2b-fabe-4833-a56d-92acc0abdf84 req-aa0c643c-932b-498a-be1d-8cd653a1a576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f57e8a29-90c4-4305-b5bd-b5d2f22673bb", "tag": "7b9334d3-964c-48c1-bd0f-5cf0f2cccb6f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:03.297420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-486a8e2b-fabe-4833-a56d-92acc0abdf84 req-aa0c643c-932b-498a-be1d-8cd653a1a576 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:03.297898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-486a8e2b-fabe-4833-a56d-92acc0abdf84 req-aa0c643c-932b-498a-be1d-8cd653a1a576 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:03.354086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-486a8e2b-fabe-4833-a56d-92acc0abdf84 req-aa0c643c-932b-498a-be1d-8cd653a1a576 service nova] Creating event network-changed:7b9334d3-964c-48c1-bd0f-5cf0f2cccb6f for instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb on hv-cinder-82549 May 23 13:32:03.354654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-486a8e2b-fabe-4833-a56d-92acc0abdf84 req-aa0c643c-932b-498a-be1d-8cd653a1a576 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 13:32:03.358167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac5a6f88-e510-4a9d-890d-fffb992f6540 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:03.358167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac5a6f88-e510-4a9d-890d-fffb992f6540 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:03.359272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac5a6f88-e510-4a9d-890d-fffb992f6540 None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:03.359741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac5a6f88-e510-4a9d-890d-fffb992f6540 None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:03.384994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.compute.rpcapi [None req-ac5a6f88-e510-4a9d-890d-fffb992f6540 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 13:32:03.387352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac5a6f88-e510-4a9d-890d-fffb992f6540 None None] Releasing lock "compute-rpcapi-router" {{(pid=124831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 13:32:03.460225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ac5a6f88-e510-4a9d-890d-fffb992f6540 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344676 May 23 13:32:03.461439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 13/25] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:03.810967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-179ef98b-9ec9-4031-908e-cf0f52e3a21f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:03.811694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-179ef98b-9ec9-4031-908e-cf0f52e3a21f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:03.833699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179ef98b-9ec9-4031-908e-cf0f52e3a21f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:03.834923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179ef98b-9ec9-4031-908e-cf0f52e3a21f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:03.838160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179ef98b-9ec9-4031-908e-cf0f52e3a21f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:03.840399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179ef98b-9ec9-4031-908e-cf0f52e3a21f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:04.449735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-179ef98b-9ec9-4031-908e-cf0f52e3a21f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:04.471044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-179ef98b-9ec9-4031-908e-cf0f52e3a21f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.664842 May 23 13:32:04.471628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 14/26] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:03 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:04.479533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:32:04.480136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:32:04.480430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:32:04.480880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:32:04.481374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:32:04.494795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:04.495312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:04.496127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:04.496610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:04.523349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Getting quotas for project c4fb50a6ddee45278948b5fed215597b. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:32:04.530062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Getting quotas for user af29f227080147a1a157f88842d39483 and project c4fb50a6ddee45278948b5fed215597b. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:32:04.551296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:32:04.553887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:32:04.850903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f8a18b6a-3a96-420e-9215-2bc7dd5c7a2f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.510457 May 23 13:32:04.854593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 13/27] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:31:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 5518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 13:32:04.867658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-667e78da-a210-40d8-bf98-30a290a0d210 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:04.867658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-667e78da-a210-40d8-bf98-30a290a0d210 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:05.020679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-667e78da-a210-40d8-bf98-30a290a0d210 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:05.034289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-667e78da-a210-40d8-bf98-30a290a0d210 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1221 microversion: 2.1 time: 0.173005 May 23 13:32:05.035510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 15/28] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:04 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:05.501836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-583531ee-77ad-4615-919e-97fe7da290ac tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:05.502522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-583531ee-77ad-4615-919e-97fe7da290ac tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:05.509186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:05.526896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-583531ee-77ad-4615-919e-97fe7da290ac tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:05.527322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-583531ee-77ad-4615-919e-97fe7da290ac tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:05.528163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-583531ee-77ad-4615-919e-97fe7da290ac tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:05.528603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-583531ee-77ad-4615-919e-97fe7da290ac tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:05.531602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=29 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:05.972977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-128907819", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:06.194972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] validate_networks() for [('861d496f-1a1a-40b6-9eb0-bf781ce919c3', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:32:06.273910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-583531ee-77ad-4615-919e-97fe7da290ac tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:06.290761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-583531ee-77ad-4615-919e-97fe7da290ac tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.788485 May 23 13:32:06.290761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 14/29] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:05 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:07.125437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2031214930", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cae33ea1-a43b-4cf1-9bf1-7b749b634f6c"}], "security_groups": [{"name": "tempest-securitygroup--297863344"}], "key_name": "tempest-keypair-1977509464", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:07.842328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] validate_networks() for [('cae33ea1-a43b-4cf1-9bf1-7b749b634f6c', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:32:08.540010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:32:08.540622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:32:08.540974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:32:08.541398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:32:08.542003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:32:08.570603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:08.571520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:08.572489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:08.573039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:08.625152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:32:08.626193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:32:08.626848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:32:08.627616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:32:08.629305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:32:08.637588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Getting quotas for project c4fb50a6ddee45278948b5fed215597b. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:32:08.642957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Getting quotas for user af29f227080147a1a157f88842d39483 and project c4fb50a6ddee45278948b5fed215597b. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:32:08.643997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:08.644458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:08.645320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:08.645843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:08.661152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:32:08.665689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:32:08.675539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Getting quotas for project 611e3a80618d4d4dbfb150456f0d3502. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:32:08.682397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Getting quotas for user b3eae736c69843ceadc6cbdb258b7195 and project 611e3a80618d4d4dbfb150456f0d3502. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:32:08.699826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:32:08.703235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:32:09.723092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4a48a298-ab4f-46de-8fb1-2d240bfa5a8e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.768467 May 23 13:32:09.726685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 16/30] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:32:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 13:32:09.766877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5830f130-35b5-4f9a-88e9-afe22744a534 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:09.775446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5830f130-35b5-4f9a-88e9-afe22744a534 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:09.862103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3c2ea1d0-5d6e-4601-93f0-3eba10412d76 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.673588 May 23 13:32:09.862103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 15/31] 10.222.0.70 () {62 vars in 1187 bytes} [Mon May 23 13:32:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 23 13:32:09.864376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5830f130-35b5-4f9a-88e9-afe22744a534 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:09.864376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5830f130-35b5-4f9a-88e9-afe22744a534 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:09.864376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5830f130-35b5-4f9a-88e9-afe22744a534 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:09.864376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5830f130-35b5-4f9a-88e9-afe22744a534 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:09.866025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2a835612-fbcb-4c65-84d9-29634a010cca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:09.866025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2a835612-fbcb-4c65-84d9-29634a010cca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:10.059239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2a835612-fbcb-4c65-84d9-29634a010cca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:10.069881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2a835612-fbcb-4c65-84d9-29634a010cca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1221 microversion: 2.1 time: 0.265410 May 23 13:32:10.074308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 16/32] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:09 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1221 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:10.094395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46712107-b0e3-45fa-a1d5-57b69bbc4719 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:10.101064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46712107-b0e3-45fa-a1d5-57b69bbc4719 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:10.361423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46712107-b0e3-45fa-a1d5-57b69bbc4719 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:10.386507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46712107-b0e3-45fa-a1d5-57b69bbc4719 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:10.399371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46712107-b0e3-45fa-a1d5-57b69bbc4719 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:10.411001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46712107-b0e3-45fa-a1d5-57b69bbc4719 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1282 microversion: 2.20 time: 0.329572 May 23 13:32:10.412175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 17/33] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:10 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1282 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:10.429082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2041662938", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ebb3f7b-57db-46b5-ba41-00b71beb6e1e"}], "security_groups": [{"name": "tempest-securitygroup--1834052456"}], "key_name": "tempest-keypair-1917221040", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:10.602571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] validate_networks() for [('2ebb3f7b-57db-46b5-ba41-00b71beb6e1e', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:32:10.985649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5830f130-35b5-4f9a-88e9-afe22744a534 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:10.999818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5830f130-35b5-4f9a-88e9-afe22744a534 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 1.271228 May 23 13:32:11.001012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 17/34] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:09 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:11.092110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1aa3e172-01bb-4f5b-bbff-92fbff83adb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:11.093009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1aa3e172-01bb-4f5b-bbff-92fbff83adb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:11.264539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1aa3e172-01bb-4f5b-bbff-92fbff83adb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:11.270136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1aa3e172-01bb-4f5b-bbff-92fbff83adb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1221 microversion: 2.1 time: 0.182740 May 23 13:32:11.271054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 18/35] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:11 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:11.277616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-130088684", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2bea62-f6f1-4527-b917-50977245b156"}], "security_groups": [{"name": "tempest-securitygroup--1735128815"}], "key_name": "tempest-keypair-1797391439", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:11.385170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:32:11.385681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:32:11.386200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:32:11.386621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:32:11.387043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:32:11.401995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:11.402454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:11.404518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:11.408050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:11.425609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] validate_networks() for [('be2bea62-f6f1-4527-b917-50977245b156', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:32:11.447974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for project 7649fa9a0ae4411aabf060f99e691520. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:32:11.461098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for user cf30fa512142489a8dea40ce426a5f36 and project 7649fa9a0ae4411aabf060f99e691520. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:32:11.483147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:32:11.485546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:32:11.822013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0fc94a4d-9561-4eb2-b7e1-26a2d5afee2c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.407800 May 23 13:32:11.822995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 18/36] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:32:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 13:32:11.835102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1666b20a-5ae0-4f04-bcd6-71e524bc8974 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:11.835863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1666b20a-5ae0-4f04-bcd6-71e524bc8974 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:11.959253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1666b20a-5ae0-4f04-bcd6-71e524bc8974 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:11.967482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1666b20a-5ae0-4f04-bcd6-71e524bc8974 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:11.969169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1666b20a-5ae0-4f04-bcd6-71e524bc8974 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:11.970344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1666b20a-5ae0-4f04-bcd6-71e524bc8974 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1282 microversion: 2.20 time: 0.146055 May 23 13:32:11.971179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 19/37] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:11.980001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da1c53e7-6cf3-4841-b599-c3ea6963cbd2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:11.988739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da1c53e7-6cf3-4841-b599-c3ea6963cbd2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:12.093686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da1c53e7-6cf3-4841-b599-c3ea6963cbd2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:12.100613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da1c53e7-6cf3-4841-b599-c3ea6963cbd2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1242 microversion: 2.1 time: 0.128016 May 23 13:32:12.104845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 20/38] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:11 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:12.112206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b49dbd97-c1c2-4c68-9389-f030dff139f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:12.112679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b49dbd97-c1c2-4c68-9389-f030dff139f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:12.123739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49dbd97-c1c2-4c68-9389-f030dff139f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:12.124209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49dbd97-c1c2-4c68-9389-f030dff139f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:12.125049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49dbd97-c1c2-4c68-9389-f030dff139f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:12.129128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49dbd97-c1c2-4c68-9389-f030dff139f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:12.156854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:32:12.157348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:32:12.159173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:32:12.159801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:32:12.160408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:32:12.186262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:12.186802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:12.187750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:12.188302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:12.218966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Getting quotas for project 6bb9e74e9b64480a80d45a03945ea51f. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:32:12.228221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Getting quotas for user a58edb91d7b641298e40dd356eec9eac and project 6bb9e74e9b64480a80d45a03945ea51f. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:32:12.249375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:32:12.251645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:32:12.322520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b49dbd97-c1c2-4c68-9389-f030dff139f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:12.331519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b49dbd97-c1c2-4c68-9389-f030dff139f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.228017 May 23 13:32:12.332115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 21/39] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:12 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:12.338615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f84e0b27-c2f8-4dff-8678-5d3a32b992ba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:12.339247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f84e0b27-c2f8-4dff-8678-5d3a32b992ba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:12.360068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84e0b27-c2f8-4dff-8678-5d3a32b992ba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:12.360068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84e0b27-c2f8-4dff-8678-5d3a32b992ba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:12.360068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84e0b27-c2f8-4dff-8678-5d3a32b992ba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:12.360068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84e0b27-c2f8-4dff-8678-5d3a32b992ba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:12.443844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f84e0b27-c2f8-4dff-8678-5d3a32b992ba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:12.452859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f84e0b27-c2f8-4dff-8678-5d3a32b992ba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1225 microversion: 2.1 time: 0.119201 May 23 13:32:12.486157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 22/40] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:12 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:12.488859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-665ad50e-954b-4c30-9028-0f20cfb822cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.216475 May 23 13:32:12.500915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1320c685-16b0-47c4-82de-641449754ff4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:12.501677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1320c685-16b0-47c4-82de-641449754ff4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:12.504785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 19/41] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:32:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 13:32:12.590987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1320c685-16b0-47c4-82de-641449754ff4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:12.601652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1320c685-16b0-47c4-82de-641449754ff4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1237 microversion: 2.1 time: 0.105174 May 23 13:32:12.610021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 23/42] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:12 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1237 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:12.990051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:12.991512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:12.993993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:12.999854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:13.000777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:13.001591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:13.002359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:13.097758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:13.112148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:13.117037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:13.123213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1187acee-aa30-463b-b753-b8152d877b1c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1286 microversion: 2.20 time: 0.137224 May 23 13:32:13.124886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 20/43] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:13.125350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e0fdcb9-39aa-42b3-b6e5-367c5839b716 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:13.125986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e0fdcb9-39aa-42b3-b6e5-367c5839b716 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:13.231623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e0fdcb9-39aa-42b3-b6e5-367c5839b716 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:13.251511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e0fdcb9-39aa-42b3-b6e5-367c5839b716 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1242 microversion: 2.1 time: 0.130344 May 23 13:32:13.252102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 24/44] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:13 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:13.358264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4417a365-05b0-4b7d-9d36-e380d9cd880a tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:13.359055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4417a365-05b0-4b7d-9d36-e380d9cd880a tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:13.366538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4417a365-05b0-4b7d-9d36-e380d9cd880a tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:13.367182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4417a365-05b0-4b7d-9d36-e380d9cd880a tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:13.368268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4417a365-05b0-4b7d-9d36-e380d9cd880a tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:13.368718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4417a365-05b0-4b7d-9d36-e380d9cd880a tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:13.471728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dfb984f7-2d80-4048-b8df-51d0a5d4b1c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:13.473070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dfb984f7-2d80-4048-b8df-51d0a5d4b1c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:13.481201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfb984f7-2d80-4048-b8df-51d0a5d4b1c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:13.481689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfb984f7-2d80-4048-b8df-51d0a5d4b1c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:13.482546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfb984f7-2d80-4048-b8df-51d0a5d4b1c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:13.483055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfb984f7-2d80-4048-b8df-51d0a5d4b1c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:13.540593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4417a365-05b0-4b7d-9d36-e380d9cd880a tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:13.548516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4417a365-05b0-4b7d-9d36-e380d9cd880a tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.197420 May 23 13:32:13.558995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 21/45] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:13 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:13.582150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dfb984f7-2d80-4048-b8df-51d0a5d4b1c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:13.596889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dfb984f7-2d80-4048-b8df-51d0a5d4b1c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1225 microversion: 2.1 time: 0.128989 May 23 13:32:13.597432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 25/46] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:13 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:13.622316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c5881f6f-e056-4241-8185-271985a16f1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:13.623213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c5881f6f-e056-4241-8185-271985a16f1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:13.685631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c5881f6f-e056-4241-8185-271985a16f1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:13.696391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c5881f6f-e056-4241-8185-271985a16f1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1237 microversion: 2.1 time: 0.077815 May 23 13:32:13.708864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 22/47] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:13 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:14.153722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:14.153722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:14.156940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.158193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.159108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.159724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.246062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:14.258284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:14.260264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:14.261736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bc964f61-34fe-400b-a86a-d88ccb7af0cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1286 microversion: 2.20 time: 0.121635 May 23 13:32:14.263936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 26/48] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:14 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:14.277458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5673a05b-9a41-4624-b045-7692a332d6cb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:14.277458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5673a05b-9a41-4624-b045-7692a332d6cb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:14.285845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5673a05b-9a41-4624-b045-7692a332d6cb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.289259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5673a05b-9a41-4624-b045-7692a332d6cb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.290394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5673a05b-9a41-4624-b045-7692a332d6cb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.291062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5673a05b-9a41-4624-b045-7692a332d6cb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.423098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5673a05b-9a41-4624-b045-7692a332d6cb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:14.433715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5673a05b-9a41-4624-b045-7692a332d6cb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1246 microversion: 2.1 time: 0.166271 May 23 13:32:14.447036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 23/49] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:14 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1246 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:14.569036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-721d0af9-7eb1-40f4-abfd-521044c239ea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:14.570011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-721d0af9-7eb1-40f4-abfd-521044c239ea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:14.586298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-721d0af9-7eb1-40f4-abfd-521044c239ea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.586800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-721d0af9-7eb1-40f4-abfd-521044c239ea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.587620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-721d0af9-7eb1-40f4-abfd-521044c239ea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.588067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-721d0af9-7eb1-40f4-abfd-521044c239ea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.619518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f23bd1e7-05a3-4c25-8edd-d7975b9bb2fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:14.621879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f23bd1e7-05a3-4c25-8edd-d7975b9bb2fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:14.631872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f23bd1e7-05a3-4c25-8edd-d7975b9bb2fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.638121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f23bd1e7-05a3-4c25-8edd-d7975b9bb2fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.638121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f23bd1e7-05a3-4c25-8edd-d7975b9bb2fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.638121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f23bd1e7-05a3-4c25-8edd-d7975b9bb2fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.761688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f23bd1e7-05a3-4c25-8edd-d7975b9bb2fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:14.784925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f23bd1e7-05a3-4c25-8edd-d7975b9bb2fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1217 microversion: 2.1 time: 0.161945 May 23 13:32:14.785668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 24/50] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:14 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:14.799607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff037fc2-28de-4f44-bb4b-eacee8296b7f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:14.800428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff037fc2-28de-4f44-bb4b-eacee8296b7f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:14.810641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff037fc2-28de-4f44-bb4b-eacee8296b7f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.811508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff037fc2-28de-4f44-bb4b-eacee8296b7f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.812330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff037fc2-28de-4f44-bb4b-eacee8296b7f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:14.812954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff037fc2-28de-4f44-bb4b-eacee8296b7f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:14.871510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-721d0af9-7eb1-40f4-abfd-521044c239ea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:14.882980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-721d0af9-7eb1-40f4-abfd-521044c239ea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.320396 May 23 13:32:14.884555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 27/51] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:14 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:14.990553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ff037fc2-28de-4f44-bb4b-eacee8296b7f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:15.004175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff037fc2-28de-4f44-bb4b-eacee8296b7f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1233 microversion: 2.1 time: 0.216742 May 23 13:32:15.017079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 25/52] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:14 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1233 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:15.283913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:15.283913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:15.289079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:15.289525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:15.293839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:15.295620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:15.389889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:15.401840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:15.403693 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:15.404894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a81e954-556f-4e76-ad51-c1d8c8032491 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1334 microversion: 2.20 time: 0.128012 May 23 13:32:15.405789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 28/53] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:15 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1334 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:15.454738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fe3ab9bd-9264-4a76-b901-9ebee688a835 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:15.455424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fe3ab9bd-9264-4a76-b901-9ebee688a835 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:15.464002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe3ab9bd-9264-4a76-b901-9ebee688a835 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:15.464457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe3ab9bd-9264-4a76-b901-9ebee688a835 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:15.465304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe3ab9bd-9264-4a76-b901-9ebee688a835 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:15.465747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe3ab9bd-9264-4a76-b901-9ebee688a835 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:15.542670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe3ab9bd-9264-4a76-b901-9ebee688a835 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:15.550576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fe3ab9bd-9264-4a76-b901-9ebee688a835 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1294 microversion: 2.1 time: 0.099656 May 23 13:32:15.551163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 26/54] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:15 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:15.813315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4a3f6c65-b345-4f48-b49e-a38811057789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:15.814746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4a3f6c65-b345-4f48-b49e-a38811057789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:15.826390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a3f6c65-b345-4f48-b49e-a38811057789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:15.828130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a3f6c65-b345-4f48-b49e-a38811057789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:15.829771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a3f6c65-b345-4f48-b49e-a38811057789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:15.830646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a3f6c65-b345-4f48-b49e-a38811057789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:15.910282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7339e640-8c10-41a6-912c-154dfa88f0de tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:15.911362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7339e640-8c10-41a6-912c-154dfa88f0de tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:15.916548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4a3f6c65-b345-4f48-b49e-a38811057789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:15.924744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7339e640-8c10-41a6-912c-154dfa88f0de tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:15.927042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4a3f6c65-b345-4f48-b49e-a38811057789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1273 microversion: 2.1 time: 0.117563 May 23 13:32:15.935183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 29/55] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:15 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:15.935618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7339e640-8c10-41a6-912c-154dfa88f0de tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:15.935618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7339e640-8c10-41a6-912c-154dfa88f0de tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:15.935618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7339e640-8c10-41a6-912c-154dfa88f0de tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:16.023740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-189ff64a-ee71-4224-a49a-db72a6e155db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:16.024782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-189ff64a-ee71-4224-a49a-db72a6e155db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:16.031770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-189ff64a-ee71-4224-a49a-db72a6e155db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:16.032627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-189ff64a-ee71-4224-a49a-db72a6e155db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:16.033631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-189ff64a-ee71-4224-a49a-db72a6e155db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:16.034313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-189ff64a-ee71-4224-a49a-db72a6e155db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:16.130565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-189ff64a-ee71-4224-a49a-db72a6e155db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:16.140602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-189ff64a-ee71-4224-a49a-db72a6e155db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1289 microversion: 2.1 time: 0.120893 May 23 13:32:16.151456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 30/56] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:16 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:16.289655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7339e640-8c10-41a6-912c-154dfa88f0de tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:16.297691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7339e640-8c10-41a6-912c-154dfa88f0de tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.395627 May 23 13:32:16.298276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 27/57] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:15 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:16.425126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:16.426485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:16.444113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:16.453739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:16.455224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:16.455931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:16.580000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-51e2c412-ab7a-4eae-a8e6-a99fd69ef6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:16.581804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-51e2c412-ab7a-4eae-a8e6-a99fd69ef6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:16.596108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51e2c412-ab7a-4eae-a8e6-a99fd69ef6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:16.596604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51e2c412-ab7a-4eae-a8e6-a99fd69ef6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:16.599505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51e2c412-ab7a-4eae-a8e6-a99fd69ef6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:16.602768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51e2c412-ab7a-4eae-a8e6-a99fd69ef6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:16.751716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:16.760994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:16.762800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:16.764419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b15c2218-5cd3-48ef-95db-8e89d0463663 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1334 microversion: 2.20 time: 0.344764 May 23 13:32:16.765654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 31/58] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1334 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:16.918976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51e2c412-ab7a-4eae-a8e6-a99fd69ef6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:16.928499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-51e2c412-ab7a-4eae-a8e6-a99fd69ef6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1312 microversion: 2.1 time: 0.353999 May 23 13:32:16.944593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ec24efec-9660-480d-a5cb-70dae318a612 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:16.945227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ec24efec-9660-480d-a5cb-70dae318a612 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:16.950457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 28/59] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:16 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1312 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:16.965696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec24efec-9660-480d-a5cb-70dae318a612 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:16.966145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec24efec-9660-480d-a5cb-70dae318a612 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:16.967198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec24efec-9660-480d-a5cb-70dae318a612 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:16.967779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec24efec-9660-480d-a5cb-70dae318a612 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:17.134066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ec24efec-9660-480d-a5cb-70dae318a612 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:17.158929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-09e0eb10-64a7-4430-aa5b-7b58d076bf7a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:17.159889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09e0eb10-64a7-4430-aa5b-7b58d076bf7a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:17.177360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ec24efec-9660-480d-a5cb-70dae318a612 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1281 microversion: 2.1 time: 0.236973 May 23 13:32:17.177614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09e0eb10-64a7-4430-aa5b-7b58d076bf7a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:17.178372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09e0eb10-64a7-4430-aa5b-7b58d076bf7a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:17.179488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09e0eb10-64a7-4430-aa5b-7b58d076bf7a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:17.180083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09e0eb10-64a7-4430-aa5b-7b58d076bf7a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:17.187142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 32/60] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:16 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:17.219910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:17.322309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f108aa1-9028-4197-9fdd-0b737d6bb5bf tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:17.324480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f108aa1-9028-4197-9fdd-0b737d6bb5bf tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:17.347252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f108aa1-9028-4197-9fdd-0b737d6bb5bf tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:17.348335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f108aa1-9028-4197-9fdd-0b737d6bb5bf tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:17.353966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f108aa1-9028-4197-9fdd-0b737d6bb5bf tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:17.357226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f108aa1-9028-4197-9fdd-0b737d6bb5bf tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:17.368773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-09e0eb10-64a7-4430-aa5b-7b58d076bf7a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:17.381824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-09e0eb10-64a7-4430-aa5b-7b58d076bf7a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1295 microversion: 2.1 time: 0.225910 May 23 13:32:17.384444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 29/61] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:17 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1295 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:17.783539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:17.784743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:17.796894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:17.797409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:17.798416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:17.798858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:17.902735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:17.914855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:17.916049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:17.917258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f783c36-ec3b-47c3-8254-cb6b99448418 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1340 microversion: 2.20 time: 0.137361 May 23 13:32:17.918164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 30/62] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1340 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:32:17.952388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-42f2dda4-1dfe-48e2-a809-cb62933d1120 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:17.953089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-42f2dda4-1dfe-48e2-a809-cb62933d1120 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:17.961372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42f2dda4-1dfe-48e2-a809-cb62933d1120 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:17.961966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42f2dda4-1dfe-48e2-a809-cb62933d1120 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:17.962759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42f2dda4-1dfe-48e2-a809-cb62933d1120 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:17.963263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42f2dda4-1dfe-48e2-a809-cb62933d1120 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:18.040510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42f2dda4-1dfe-48e2-a809-cb62933d1120 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:18.053595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-42f2dda4-1dfe-48e2-a809-cb62933d1120 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1300 microversion: 2.1 time: 0.105168 May 23 13:32:18.066053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 31/63] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:17 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:18.072395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f108aa1-9028-4197-9fdd-0b737d6bb5bf tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:18.081256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f108aa1-9028-4197-9fdd-0b737d6bb5bf tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.766640 May 23 13:32:18.082605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 33/64] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:17 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:18.204442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-445fd82c-21f7-42f0-aa0e-dec11a0aa167 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:18.205080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-445fd82c-21f7-42f0-aa0e-dec11a0aa167 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:18.212090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-445fd82c-21f7-42f0-aa0e-dec11a0aa167 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:18.212774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-445fd82c-21f7-42f0-aa0e-dec11a0aa167 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:18.214028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-445fd82c-21f7-42f0-aa0e-dec11a0aa167 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:18.214428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-445fd82c-21f7-42f0-aa0e-dec11a0aa167 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:18.405887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-026a0a2d-8361-4b10-9794-1935650cbb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:18.406782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-026a0a2d-8361-4b10-9794-1935650cbb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:18.413970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-026a0a2d-8361-4b10-9794-1935650cbb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:18.414807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-026a0a2d-8361-4b10-9794-1935650cbb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:18.415822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-026a0a2d-8361-4b10-9794-1935650cbb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:18.416551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-026a0a2d-8361-4b10-9794-1935650cbb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:18.615453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-026a0a2d-8361-4b10-9794-1935650cbb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:18.633704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-026a0a2d-8361-4b10-9794-1935650cbb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1295 microversion: 2.1 time: 0.234799 May 23 13:32:18.637708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 34/65] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:18 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1295 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:18.695895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-445fd82c-21f7-42f0-aa0e-dec11a0aa167 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:18.711670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-445fd82c-21f7-42f0-aa0e-dec11a0aa167 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1279 microversion: 2.1 time: 0.511711 May 23 13:32:18.715741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 32/66] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:18 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1279 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:18.944348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:18.945426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:18.958009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:18.959739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:18.960908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:18.962233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.073400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-622687be-069d-4cf8-8ace-32195acdfa7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:19.074028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-622687be-069d-4cf8-8ace-32195acdfa7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:19.085608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-622687be-069d-4cf8-8ace-32195acdfa7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:19.086059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-622687be-069d-4cf8-8ace-32195acdfa7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.087014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-622687be-069d-4cf8-8ace-32195acdfa7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:19.088006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-622687be-069d-4cf8-8ace-32195acdfa7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.151236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:19.171418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:19.175977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:19.179107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-21310a73-5917-4678-8b9b-041a98bcb673 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1340 microversion: 2.20 time: 0.241343 May 23 13:32:19.180922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 35/67] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:18 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1340 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:19.196507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-49c18a4e-c385-457c-9bf7-2592f00d32ba tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:19.202284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-49c18a4e-c385-457c-9bf7-2592f00d32ba tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:19.218412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49c18a4e-c385-457c-9bf7-2592f00d32ba tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:19.218866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49c18a4e-c385-457c-9bf7-2592f00d32ba tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.223852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49c18a4e-c385-457c-9bf7-2592f00d32ba tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:19.230666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49c18a4e-c385-457c-9bf7-2592f00d32ba tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.550757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-622687be-069d-4cf8-8ace-32195acdfa7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:19.580865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-622687be-069d-4cf8-8ace-32195acdfa7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.497515 May 23 13:32:19.585678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 33/68] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:19 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:19.660454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49c18a4e-c385-457c-9bf7-2592f00d32ba tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:19.672956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-49c18a4e-c385-457c-9bf7-2592f00d32ba tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.488563 May 23 13:32:19.673687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 36/69] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:19 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:19.679508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c9458fa0-0952-4618-871f-185b80705b61 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:19.679668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-b5e7df08-3e91-4f11-ad0a-8a4c8e9e2d82 req-82061fd3-6dc5-4c2e-98af-badddfbcc1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57e8a29-90c4-4305-b5bd-b5d2f22673bb", "name": "network-vif-plugged", "status": "completed", "tag": "7b9334d3-964c-48c1-bd0f-5cf0f2cccb6f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:19.680412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c9458fa0-0952-4618-871f-185b80705b61 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:19.686850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9458fa0-0952-4618-871f-185b80705b61 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:19.687302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9458fa0-0952-4618-871f-185b80705b61 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.688124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9458fa0-0952-4618-871f-185b80705b61 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:19.688722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9458fa0-0952-4618-871f-185b80705b61 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.691540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b5e7df08-3e91-4f11-ad0a-8a4c8e9e2d82 req-82061fd3-6dc5-4c2e-98af-badddfbcc1d7 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:19.692173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b5e7df08-3e91-4f11-ad0a-8a4c8e9e2d82 req-82061fd3-6dc5-4c2e-98af-badddfbcc1d7 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.708319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-b5e7df08-3e91-4f11-ad0a-8a4c8e9e2d82 req-82061fd3-6dc5-4c2e-98af-badddfbcc1d7 service nova] Creating event network-vif-plugged:7b9334d3-964c-48c1-bd0f-5cf0f2cccb6f for instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb on hv-cinder-82549 May 23 13:32:19.716362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-b5e7df08-3e91-4f11-ad0a-8a4c8e9e2d82 req-82061fd3-6dc5-4c2e-98af-badddfbcc1d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119313 May 23 13:32:19.717965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 34/70] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:19.739814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4bcbab07-0e29-4856-9a33-5a9ed0a26779 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:19.741358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4bcbab07-0e29-4856-9a33-5a9ed0a26779 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:19.748325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bcbab07-0e29-4856-9a33-5a9ed0a26779 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:19.748883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bcbab07-0e29-4856-9a33-5a9ed0a26779 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.749664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bcbab07-0e29-4856-9a33-5a9ed0a26779 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:19.750105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bcbab07-0e29-4856-9a33-5a9ed0a26779 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:19.821118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c9458fa0-0952-4618-871f-185b80705b61 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:19.843588 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c9458fa0-0952-4618-871f-185b80705b61 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1295 microversion: 2.1 time: 0.163042 May 23 13:32:19.844739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 37/71] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:19 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1295 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:20.197636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:20.198303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:20.211893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:20.226524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:20.226524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:20.226524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:20.241009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:20.488947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4bcbab07-0e29-4856-9a33-5a9ed0a26779 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:20.498599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4bcbab07-0e29-4856-9a33-5a9ed0a26779 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.764563 May 23 13:32:20.499681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 35/72] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:19 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:20.604918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1af79d6c-a5c1-45e1-84a4-d09598c012d4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:20.605545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1af79d6c-a5c1-45e1-84a4-d09598c012d4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:20.616945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af79d6c-a5c1-45e1-84a4-d09598c012d4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:20.618371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af79d6c-a5c1-45e1-84a4-d09598c012d4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:20.621679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af79d6c-a5c1-45e1-84a4-d09598c012d4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:20.624531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af79d6c-a5c1-45e1-84a4-d09598c012d4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:20.634808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:20.643813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:20.649473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:20.650856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89319a56-64b7-41d6-8efd-74133537935f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.459262 May 23 13:32:20.655657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 38/73] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:32:20.690887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8d40a3cd-62ce-4a13-a570-531d96b4916f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:20.691504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8d40a3cd-62ce-4a13-a570-531d96b4916f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:20.701452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d40a3cd-62ce-4a13-a570-531d96b4916f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:20.701742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d40a3cd-62ce-4a13-a570-531d96b4916f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:20.703750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d40a3cd-62ce-4a13-a570-531d96b4916f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:20.704322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d40a3cd-62ce-4a13-a570-531d96b4916f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:21.333329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8d40a3cd-62ce-4a13-a570-531d96b4916f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:21.343017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8d40a3cd-62ce-4a13-a570-531d96b4916f tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.656375 May 23 13:32:21.344168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 39/74] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:20 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:21.354338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-96369c70-ee73-459f-922f-e746633376ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:21.355608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-96369c70-ee73-459f-922f-e746633376ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:21.364300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96369c70-ee73-459f-922f-e746633376ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:21.366209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96369c70-ee73-459f-922f-e746633376ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:21.367018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96369c70-ee73-459f-922f-e746633376ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:21.367679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96369c70-ee73-459f-922f-e746633376ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:21.433249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:21.448128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1af79d6c-a5c1-45e1-84a4-d09598c012d4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:21.457932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1af79d6c-a5c1-45e1-84a4-d09598c012d4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.859400 May 23 13:32:21.469399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 36/75] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:20 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:21.519174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5c30b4e9-ac74-4a4a-bd98-63e1c2287e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:21.519956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5c30b4e9-ac74-4a4a-bd98-63e1c2287e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:21.528245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c30b4e9-ac74-4a4a-bd98-63e1c2287e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:21.529597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c30b4e9-ac74-4a4a-bd98-63e1c2287e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:21.530559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c30b4e9-ac74-4a4a-bd98-63e1c2287e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:21.531175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c30b4e9-ac74-4a4a-bd98-63e1c2287e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:21.729256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-96369c70-ee73-459f-922f-e746633376ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:21.737476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-96369c70-ee73-459f-922f-e746633376ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.391278 May 23 13:32:21.740895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 40/76] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:21 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:21.752515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:21.753172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:21.778739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:21.780206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:21.781160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:21.781995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:22.051542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5c30b4e9-ac74-4a4a-bd98-63e1c2287e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:22.060801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5c30b4e9-ac74-4a4a-bd98-63e1c2287e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.545658 May 23 13:32:22.073028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 37/77] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:21 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:22.198435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-a401958b-7b4d-4a3c-8eb5-342df9b8c0de req-8b67dd57-9efe-4af5-9cc8-a07cda53b630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc07d7d-03f3-4b89-ae8e-5b898db04e3d", "tag": "1be92243-68d7-42e8-a7dd-2ed34f166ca6"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:22.202452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:22.217009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a401958b-7b4d-4a3c-8eb5-342df9b8c0de req-8b67dd57-9efe-4af5-9cc8-a07cda53b630 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:22.217731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a401958b-7b4d-4a3c-8eb5-342df9b8c0de req-8b67dd57-9efe-4af5-9cc8-a07cda53b630 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:22.247640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-a401958b-7b4d-4a3c-8eb5-342df9b8c0de req-8b67dd57-9efe-4af5-9cc8-a07cda53b630 service nova] Creating event network-changed:1be92243-68d7-42e8-a7dd-2ed34f166ca6 for instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d on hv-cinder-82549 May 23 13:32:22.258992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-a401958b-7b4d-4a3c-8eb5-342df9b8c0de req-8b67dd57-9efe-4af5-9cc8-a07cda53b630 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064252 May 23 13:32:22.260306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 38/78] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:22.276624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:22.293574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:22.295274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:22.296453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90aba392-e2ba-4b7f-ac97-88c14d7f8213 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.553785 May 23 13:32:22.297420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 41/79] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:21 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:22.360787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d7ba0c1e-f469-4c8f-be86-0507748dd863 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:22.361499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d7ba0c1e-f469-4c8f-be86-0507748dd863 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:22.373458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c1e-f469-4c8f-be86-0507748dd863 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:22.374280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c1e-f469-4c8f-be86-0507748dd863 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:22.375445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c1e-f469-4c8f-be86-0507748dd863 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:22.376094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c1e-f469-4c8f-be86-0507748dd863 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:22.476372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c03282f-45dd-4173-a4e3-0af8a67d7e5b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:22.477158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c03282f-45dd-4173-a4e3-0af8a67d7e5b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:22.479447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:22.486131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c03282f-45dd-4173-a4e3-0af8a67d7e5b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:22.488797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c03282f-45dd-4173-a4e3-0af8a67d7e5b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:22.488797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c03282f-45dd-4173-a4e3-0af8a67d7e5b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:22.488797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c03282f-45dd-4173-a4e3-0af8a67d7e5b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:22.949595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c03282f-45dd-4173-a4e3-0af8a67d7e5b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:22.959885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c03282f-45dd-4173-a4e3-0af8a67d7e5b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.488307 May 23 13:32:22.964361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 42/80] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:22 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:22.982010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0aee1fc6-ff50-4678-b7d9-75368dd5a78c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:22.986302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0aee1fc6-ff50-4678-b7d9-75368dd5a78c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:22.999062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0aee1fc6-ff50-4678-b7d9-75368dd5a78c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:23.001261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0aee1fc6-ff50-4678-b7d9-75368dd5a78c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:23.013114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0aee1fc6-ff50-4678-b7d9-75368dd5a78c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:23.018575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0aee1fc6-ff50-4678-b7d9-75368dd5a78c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:23.020465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7ba0c1e-f469-4c8f-be86-0507748dd863 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:23.050053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d7ba0c1e-f469-4c8f-be86-0507748dd863 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.689208 May 23 13:32:23.068232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 39/81] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:22 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:23.097958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fe5a1d76-6d9a-4133-8e5f-8a6bffbda1fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:23.104284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fe5a1d76-6d9a-4133-8e5f-8a6bffbda1fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:23.132983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe5a1d76-6d9a-4133-8e5f-8a6bffbda1fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:23.135471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe5a1d76-6d9a-4133-8e5f-8a6bffbda1fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:23.142683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe5a1d76-6d9a-4133-8e5f-8a6bffbda1fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:23.143158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe5a1d76-6d9a-4133-8e5f-8a6bffbda1fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:23.251155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=30 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:23.555527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0aee1fc6-ff50-4678-b7d9-75368dd5a78c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:23.572671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0aee1fc6-ff50-4678-b7d9-75368dd5a78c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.606935 May 23 13:32:23.573444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 43/82] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:22 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:23.688779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-688463b8-bbd5-46a0-98ae-42a2ba7111a6 req-c146fecb-9ed2-40aa-9c96-49c1f0e634ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f051b3-679a-43af-909b-a4edda1984fa", "tag": "134a119a-a4cc-402e-a0e6-6aa02c073149"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:23.692176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=22 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:23.701043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-688463b8-bbd5-46a0-98ae-42a2ba7111a6 req-c146fecb-9ed2-40aa-9c96-49c1f0e634ab service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:23.701498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-688463b8-bbd5-46a0-98ae-42a2ba7111a6 req-c146fecb-9ed2-40aa-9c96-49c1f0e634ab service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:23.722198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-688463b8-bbd5-46a0-98ae-42a2ba7111a6 req-c146fecb-9ed2-40aa-9c96-49c1f0e634ab service nova] Creating event network-changed:134a119a-a4cc-402e-a0e6-6aa02c073149 for instance 81f051b3-679a-43af-909b-a4edda1984fa on hv-cinder-82549 May 23 13:32:23.722731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-688463b8-bbd5-46a0-98ae-42a2ba7111a6 req-c146fecb-9ed2-40aa-9c96-49c1f0e634ab service nova] Acquired lock "compute-rpcapi-router" {{(pid=124830) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 13:32:23.723856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd0804f5-faaf-488a-8e63-8b6df7ecce3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:23.724496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd0804f5-faaf-488a-8e63-8b6df7ecce3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:23.735183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd0804f5-faaf-488a-8e63-8b6df7ecce3e None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:23.736088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd0804f5-faaf-488a-8e63-8b6df7ecce3e None None] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:23.753994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.compute.rpcapi [None req-fd0804f5-faaf-488a-8e63-8b6df7ecce3e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 13:32:23.756246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd0804f5-faaf-488a-8e63-8b6df7ecce3e None None] Releasing lock "compute-rpcapi-router" {{(pid=124830) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 13:32:23.788950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd0804f5-faaf-488a-8e63-8b6df7ecce3e None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174318 May 23 13:32:23.788950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 44/83] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:23.788950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:23.788950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:23.796612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:23.797076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:23.797883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:23.798320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:23.921075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe5a1d76-6d9a-4133-8e5f-8a6bffbda1fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:23.933333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fe5a1d76-6d9a-4133-8e5f-8a6bffbda1fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.856505 May 23 13:32:23.946103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 40/84] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:23 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:23.958943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:23.970316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:23.972112 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:23.974192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3ffc385c-dfc0-4259-881f-5fe3a0bce648 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.192271 May 23 13:32:23.975238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 45/85] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:23.980935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-582c6ddd-e2d5-47c6-b6f1-5259ce4a6083 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:23.981800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-582c6ddd-e2d5-47c6-b6f1-5259ce4a6083 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:23.999852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582c6ddd-e2d5-47c6-b6f1-5259ce4a6083 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:24.000299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582c6ddd-e2d5-47c6-b6f1-5259ce4a6083 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:24.002616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582c6ddd-e2d5-47c6-b6f1-5259ce4a6083 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:24.002616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582c6ddd-e2d5-47c6-b6f1-5259ce4a6083 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:24.082137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eeafc01c-a366-423f-b240-a58fb110d21e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:24.083329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eeafc01c-a366-423f-b240-a58fb110d21e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:24.090907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeafc01c-a366-423f-b240-a58fb110d21e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:24.091914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeafc01c-a366-423f-b240-a58fb110d21e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:24.093476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeafc01c-a366-423f-b240-a58fb110d21e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:24.094130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeafc01c-a366-423f-b240-a58fb110d21e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:24.818071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eeafc01c-a366-423f-b240-a58fb110d21e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:24.828892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eeafc01c-a366-423f-b240-a58fb110d21e tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1315 microversion: 2.1 time: 0.754989 May 23 13:32:24.861743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 46/86] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:24 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:24.873103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-4754a9db-2a40-4d58-ad47-0802fc6bbc16 req-2676cd65-6333-408b-b095-9ac737401759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f011172-f0cf-4b8a-9791-2535bb8bcaa4", "tag": "8fcc06ea-c028-490c-8ab1-e434a5b0c699"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:24.883082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4754a9db-2a40-4d58-ad47-0802fc6bbc16 req-2676cd65-6333-408b-b095-9ac737401759 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:24.883771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4754a9db-2a40-4d58-ad47-0802fc6bbc16 req-2676cd65-6333-408b-b095-9ac737401759 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:24.899504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-4754a9db-2a40-4d58-ad47-0802fc6bbc16 req-2676cd65-6333-408b-b095-9ac737401759 service nova] Creating event network-changed:8fcc06ea-c028-490c-8ab1-e434a5b0c699 for instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 on hv-cinder-82549 May 23 13:32:24.905709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-4754a9db-2a40-4d58-ad47-0802fc6bbc16 req-2676cd65-6333-408b-b095-9ac737401759 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038447 May 23 13:32:24.906834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 47/87] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:24.914512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-582c6ddd-e2d5-47c6-b6f1-5259ce4a6083 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:24.920508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f9a00d0-e192-496b-9720-25c6fa74e9ab tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:24.925247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-582c6ddd-e2d5-47c6-b6f1-5259ce4a6083 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.949540 May 23 13:32:24.926039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 41/88] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:23 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:24.939748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f9a00d0-e192-496b-9720-25c6fa74e9ab tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:24.939748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f9a00d0-e192-496b-9720-25c6fa74e9ab tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:24.939748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f9a00d0-e192-496b-9720-25c6fa74e9ab tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:24.939748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f9a00d0-e192-496b-9720-25c6fa74e9ab tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:24.940208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f9a00d0-e192-496b-9720-25c6fa74e9ab tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:24.951067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b059c2a-33a6-4c6c-9005-f4c1d7c7b5f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:24.952045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b059c2a-33a6-4c6c-9005-f4c1d7c7b5f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:24.967778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b059c2a-33a6-4c6c-9005-f4c1d7c7b5f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:24.974873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b059c2a-33a6-4c6c-9005-f4c1d7c7b5f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:24.978174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b059c2a-33a6-4c6c-9005-f4c1d7c7b5f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:24.979206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b059c2a-33a6-4c6c-9005-f4c1d7c7b5f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:25.201962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f9a00d0-e192-496b-9720-25c6fa74e9ab tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:25.211849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f9a00d0-e192-496b-9720-25c6fa74e9ab tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.303488 May 23 13:32:25.212742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 48/89] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:24 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:25.219505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:25.220681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:25.228384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:25.229029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:25.229976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:25.230411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:25.315981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b059c2a-33a6-4c6c-9005-f4c1d7c7b5f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:25.325820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b059c2a-33a6-4c6c-9005-f4c1d7c7b5f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.378785 May 23 13:32:25.326338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 42/90] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:24 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:25.381669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:25.392624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:25.394409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:25.395547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-261e19be-794f-4ec8-bd04-0f173e76fd85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.180602 May 23 13:32:25.396113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 49/91] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:25.794307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-69bb9b76-33bb-4ad1-adf5-f4318ad56308 req-cd3ad18e-6e47-4a9e-9a87-ce5470daaa5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6fed39b-8380-4717-a760-06079bdfd66d", "tag": "28defdb2-721b-4ae7-81e4-a7844f3e0baa"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:25.802558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-69bb9b76-33bb-4ad1-adf5-f4318ad56308 req-cd3ad18e-6e47-4a9e-9a87-ce5470daaa5b service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:25.803487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-69bb9b76-33bb-4ad1-adf5-f4318ad56308 req-cd3ad18e-6e47-4a9e-9a87-ce5470daaa5b service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:25.814955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-69bb9b76-33bb-4ad1-adf5-f4318ad56308 req-cd3ad18e-6e47-4a9e-9a87-ce5470daaa5b service nova] Creating event network-changed:28defdb2-721b-4ae7-81e4-a7844f3e0baa for instance b6fed39b-8380-4717-a760-06079bdfd66d on hv-cinder-82549 May 23 13:32:25.820426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-69bb9b76-33bb-4ad1-adf5-f4318ad56308 req-cd3ad18e-6e47-4a9e-9a87-ce5470daaa5b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029953 May 23 13:32:25.821067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 43/92] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:25.875928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d3ec9ce5-4463-4c95-9aff-e5589ed6e3fd tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:25.876504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d3ec9ce5-4463-4c95-9aff-e5589ed6e3fd tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:25.883992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3ec9ce5-4463-4c95-9aff-e5589ed6e3fd tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:25.884446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3ec9ce5-4463-4c95-9aff-e5589ed6e3fd tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:25.885257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3ec9ce5-4463-4c95-9aff-e5589ed6e3fd tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:25.885724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3ec9ce5-4463-4c95-9aff-e5589ed6e3fd tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:25.946087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-806c4daa-7f82-4273-969c-b54857277b4d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:25.946802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-806c4daa-7f82-4273-969c-b54857277b4d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:25.953502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-806c4daa-7f82-4273-969c-b54857277b4d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:25.953967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-806c4daa-7f82-4273-969c-b54857277b4d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:25.954739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-806c4daa-7f82-4273-969c-b54857277b4d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:25.955179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-806c4daa-7f82-4273-969c-b54857277b4d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:26.030460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d3ec9ce5-4463-4c95-9aff-e5589ed6e3fd tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:26.040117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d3ec9ce5-4463-4c95-9aff-e5589ed6e3fd tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1501 microversion: 2.1 time: 0.168035 May 23 13:32:26.040600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 50/93] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:25 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:26.109191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-806c4daa-7f82-4273-969c-b54857277b4d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:26.117093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-806c4daa-7f82-4273-969c-b54857277b4d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.176386 May 23 13:32:26.117706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 44/94] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:25 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:26.229196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d48d8faa-6d40-499a-ba5c-d0d897d63950 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:26.229787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d48d8faa-6d40-499a-ba5c-d0d897d63950 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:26.235746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d48d8faa-6d40-499a-ba5c-d0d897d63950 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:26.236224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d48d8faa-6d40-499a-ba5c-d0d897d63950 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:26.237154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d48d8faa-6d40-499a-ba5c-d0d897d63950 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:26.237727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d48d8faa-6d40-499a-ba5c-d0d897d63950 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:26.343306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5211defd-f0de-4a0f-828f-e75d03953947 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:26.343923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5211defd-f0de-4a0f-828f-e75d03953947 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:26.351000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5211defd-f0de-4a0f-828f-e75d03953947 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:26.352953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5211defd-f0de-4a0f-828f-e75d03953947 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:26.353921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5211defd-f0de-4a0f-828f-e75d03953947 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:26.355261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5211defd-f0de-4a0f-828f-e75d03953947 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:26.375628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d48d8faa-6d40-499a-ba5c-d0d897d63950 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:26.384420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d48d8faa-6d40-499a-ba5c-d0d897d63950 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.159494 May 23 13:32:26.385029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 51/95] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:26 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:26.415559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:26.416165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:26.422330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:26.422792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:26.423571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:26.424010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:26.541055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5211defd-f0de-4a0f-828f-e75d03953947 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:26.548961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5211defd-f0de-4a0f-828f-e75d03953947 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.209523 May 23 13:32:26.549666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 45/96] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:26 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:26.601905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:26.610135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:26.611636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:26.612768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bab106f5-9af2-4013-acf1-c1dbb2f434a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.201281 May 23 13:32:26.613321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 52/97] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:32:26.932771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-3e1c57ad-4bea-41c3-a087-3222e254fc5d req-004f9c7d-cc1b-4cb2-871c-4ff5ff66d3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2618bd92-79d0-43b5-8067-c26548f759c3", "tag": "d30d25db-4d2c-4301-908b-bb216ff079eb"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:26.946695 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-3e1c57ad-4bea-41c3-a087-3222e254fc5d req-004f9c7d-cc1b-4cb2-871c-4ff5ff66d3c4 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:26.947381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-3e1c57ad-4bea-41c3-a087-3222e254fc5d req-004f9c7d-cc1b-4cb2-871c-4ff5ff66d3c4 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:26.964497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-3e1c57ad-4bea-41c3-a087-3222e254fc5d req-004f9c7d-cc1b-4cb2-871c-4ff5ff66d3c4 service nova] Creating event network-changed:d30d25db-4d2c-4301-908b-bb216ff079eb for instance 2618bd92-79d0-43b5-8067-c26548f759c3 on hv-cinder-82549 May 23 13:32:26.971419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-3e1c57ad-4bea-41c3-a087-3222e254fc5d req-004f9c7d-cc1b-4cb2-871c-4ff5ff66d3c4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043047 May 23 13:32:26.976929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 46/98] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:27.134555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4f4f7277-e8fa-428c-bcf2-defd9742b505 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:27.135176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4f4f7277-e8fa-428c-bcf2-defd9742b505 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:27.141424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f4f7277-e8fa-428c-bcf2-defd9742b505 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:27.141873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f4f7277-e8fa-428c-bcf2-defd9742b505 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:27.142657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f4f7277-e8fa-428c-bcf2-defd9742b505 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:27.143074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f4f7277-e8fa-428c-bcf2-defd9742b505 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:27.311430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4f4f7277-e8fa-428c-bcf2-defd9742b505 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:27.321905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4f4f7277-e8fa-428c-bcf2-defd9742b505 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.191079 May 23 13:32:27.324845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 53/99] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:27 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:27.404033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-44d0c614-f13e-4c29-9135-bed82b58e6dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:27.404953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-44d0c614-f13e-4c29-9135-bed82b58e6dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:27.411381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44d0c614-f13e-4c29-9135-bed82b58e6dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:27.411836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44d0c614-f13e-4c29-9135-bed82b58e6dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:27.413526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44d0c614-f13e-4c29-9135-bed82b58e6dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:27.413742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44d0c614-f13e-4c29-9135-bed82b58e6dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:27.569544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c7a846e-b5cf-41f1-8aae-972013467024 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:27.571556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c7a846e-b5cf-41f1-8aae-972013467024 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:27.582949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c7a846e-b5cf-41f1-8aae-972013467024 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:27.583763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c7a846e-b5cf-41f1-8aae-972013467024 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:27.586316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c7a846e-b5cf-41f1-8aae-972013467024 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:27.587040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c7a846e-b5cf-41f1-8aae-972013467024 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:27.737082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-44d0c614-f13e-4c29-9135-bed82b58e6dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:27.746226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-44d0c614-f13e-4c29-9135-bed82b58e6dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.346328 May 23 13:32:27.755650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 47/100] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:27 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:27.763132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:27.763132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:27.772693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:27.772955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:27.773749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:27.774194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:27.781624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c7a846e-b5cf-41f1-8aae-972013467024 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:27.791490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c7a846e-b5cf-41f1-8aae-972013467024 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.227619 May 23 13:32:27.792488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 54/101] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:27 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:27.797336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:27.956900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:27.965750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:27.967278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:27.968396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e324efc9-5392-4282-abf2-cb47406b0f3e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.210825 May 23 13:32:27.969003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 48/102] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:28.339815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5de01d20-9863-451f-951b-3ac77715671b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:28.340432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5de01d20-9863-451f-951b-3ac77715671b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:28.346545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5de01d20-9863-451f-951b-3ac77715671b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:28.346999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5de01d20-9863-451f-951b-3ac77715671b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:28.347799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5de01d20-9863-451f-951b-3ac77715671b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:28.348237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5de01d20-9863-451f-951b-3ac77715671b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:28.484841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5de01d20-9863-451f-951b-3ac77715671b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:28.487175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:28.494076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5de01d20-9863-451f-951b-3ac77715671b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.158179 May 23 13:32:28.494668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 55/103] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:28 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:28.763760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-57f9b445-4f13-470d-a9bc-e9aaf5d8b4fd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:28.769783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-57f9b445-4f13-470d-a9bc-e9aaf5d8b4fd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:28.773821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57f9b445-4f13-470d-a9bc-e9aaf5d8b4fd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:28.774278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57f9b445-4f13-470d-a9bc-e9aaf5d8b4fd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:28.775052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57f9b445-4f13-470d-a9bc-e9aaf5d8b4fd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:28.775483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57f9b445-4f13-470d-a9bc-e9aaf5d8b4fd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:28.808992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae3da844-e1a7-4ae0-b7c3-8754f66a71d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:28.809857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae3da844-e1a7-4ae0-b7c3-8754f66a71d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:28.816333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae3da844-e1a7-4ae0-b7c3-8754f66a71d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:28.816714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae3da844-e1a7-4ae0-b7c3-8754f66a71d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:28.817479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae3da844-e1a7-4ae0-b7c3-8754f66a71d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:28.817907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae3da844-e1a7-4ae0-b7c3-8754f66a71d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:28.936693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-57f9b445-4f13-470d-a9bc-e9aaf5d8b4fd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:28.945102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-57f9b445-4f13-470d-a9bc-e9aaf5d8b4fd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.185040 May 23 13:32:28.945811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 49/104] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:28 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:28.967310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae3da844-e1a7-4ae0-b7c3-8754f66a71d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:28.974705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae3da844-e1a7-4ae0-b7c3-8754f66a71d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.170239 May 23 13:32:28.975268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 56/105] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:28 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:28.985677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:28.986294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:28.992495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:28.993002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:28.994009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:28.994452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:29.118495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2bf8c7f6-48c4-4dc7-9195-7d9751843182 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "313d3ddb-ed87-44d1-a792-7c90e4ffaac4"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:29.119656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2bf8c7f6-48c4-4dc7-9195-7d9751843182 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:29.127806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7f6-48c4-4dc7-9195-7d9751843182 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:29.128515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7f6-48c4-4dc7-9195-7d9751843182 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:29.144324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7f6-48c4-4dc7-9195-7d9751843182 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:29.145103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7f6-48c4-4dc7-9195-7d9751843182 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:29.154396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:29.165074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:29.167198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:29.169676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-670268d2-d0bd-4bee-8f3d-3afc3ebb9f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.187915 May 23 13:32:29.183056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 50/106] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:28 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:29.511444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c7bb8df6-d3d1-4aa6-83a6-18f1fd58197c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:29.512157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7bb8df6-d3d1-4aa6-83a6-18f1fd58197c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:29.518301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7bb8df6-d3d1-4aa6-83a6-18f1fd58197c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:29.518745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7bb8df6-d3d1-4aa6-83a6-18f1fd58197c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:29.519611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7bb8df6-d3d1-4aa6-83a6-18f1fd58197c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:29.520101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7bb8df6-d3d1-4aa6-83a6-18f1fd58197c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:29.667520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7bb8df6-d3d1-4aa6-83a6-18f1fd58197c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:29.688836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c7bb8df6-d3d1-4aa6-83a6-18f1fd58197c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.181319 May 23 13:32:29.689430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 51/107] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:29 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:29.962929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b710bdd-e54e-4edd-bf3f-42610f5b5f17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:29.963712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b710bdd-e54e-4edd-bf3f-42610f5b5f17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:29.970407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b710bdd-e54e-4edd-bf3f-42610f5b5f17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:29.971182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b710bdd-e54e-4edd-bf3f-42610f5b5f17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:29.972207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b710bdd-e54e-4edd-bf3f-42610f5b5f17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:29.972898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b710bdd-e54e-4edd-bf3f-42610f5b5f17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:30.761055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b710bdd-e54e-4edd-bf3f-42610f5b5f17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:30.773866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b710bdd-e54e-4edd-bf3f-42610f5b5f17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.815511 May 23 13:32:30.775186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 52/108] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:29 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:30.808373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9e0e4c6-6477-4947-b701-7a01821e1479 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:30.811521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9e0e4c6-6477-4947-b701-7a01821e1479 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:30.842841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9e0e4c6-6477-4947-b701-7a01821e1479 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:30.845541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9e0e4c6-6477-4947-b701-7a01821e1479 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:30.847662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2bf8c7f6-48c4-4dc7-9195-7d9751843182 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "POST /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.734111 May 23 13:32:30.848184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9e0e4c6-6477-4947-b701-7a01821e1479 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:30.848405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9e0e4c6-6477-4947-b701-7a01821e1479 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:30.850942 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 57/109] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 13:32:29 2022] POST /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb/os-volume_attachments => generated 194 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:32:30.885036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:30.890160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:30.927300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:30.942319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:30.944471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:30.947037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:31.086958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d9e0e4c6-6477-4947-b701-7a01821e1479 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:31.095213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9e0e4c6-6477-4947-b701-7a01821e1479 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.318523 May 23 13:32:31.096063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 53/110] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:30 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:31.101800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-212f9107-4d9a-4ee5-8cfb-791968be9b17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:31.102643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-212f9107-4d9a-4ee5-8cfb-791968be9b17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:31.109555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-212f9107-4d9a-4ee5-8cfb-791968be9b17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:31.110019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-212f9107-4d9a-4ee5-8cfb-791968be9b17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:31.110874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-212f9107-4d9a-4ee5-8cfb-791968be9b17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:31.111280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-212f9107-4d9a-4ee5-8cfb-791968be9b17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:31.280898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-212f9107-4d9a-4ee5-8cfb-791968be9b17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:31.292471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-212f9107-4d9a-4ee5-8cfb-791968be9b17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.194947 May 23 13:32:31.293123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 54/111] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:31 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:31.298369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-1a15196d-923f-4a17-97ed-ae87f9cc7768 req-553afcce-2997-4c90-91ba-c184bc160ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f051b3-679a-43af-909b-a4edda1984fa", "name": "network-vif-plugged", "status": "completed", "tag": "134a119a-a4cc-402e-a0e6-6aa02c073149"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:31.308350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-1a15196d-923f-4a17-97ed-ae87f9cc7768 req-553afcce-2997-4c90-91ba-c184bc160ce5 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:31.308853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-1a15196d-923f-4a17-97ed-ae87f9cc7768 req-553afcce-2997-4c90-91ba-c184bc160ce5 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:31.321517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-1a15196d-923f-4a17-97ed-ae87f9cc7768 req-553afcce-2997-4c90-91ba-c184bc160ce5 service nova] Creating event network-vif-plugged:134a119a-a4cc-402e-a0e6-6aa02c073149 for instance 81f051b3-679a-43af-909b-a4edda1984fa on hv-cinder-82549 May 23 13:32:31.326950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-1a15196d-923f-4a17-97ed-ae87f9cc7768 req-553afcce-2997-4c90-91ba-c184bc160ce5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032278 May 23 13:32:31.327763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 55/112] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:31.372901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:31.381668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:31.383265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:31.384544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e578844f-5040-4a7b-b9ac-2341b5fd30d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.532176 May 23 13:32:31.385152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 58/113] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:31.797199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d4eb480d-b18d-4bc7-a802-82f87a6bfdd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:31.799380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d4eb480d-b18d-4bc7-a802-82f87a6bfdd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:31.811501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4eb480d-b18d-4bc7-a802-82f87a6bfdd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:31.812473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4eb480d-b18d-4bc7-a802-82f87a6bfdd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:31.813748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4eb480d-b18d-4bc7-a802-82f87a6bfdd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:31.814509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4eb480d-b18d-4bc7-a802-82f87a6bfdd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:31.956459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d4eb480d-b18d-4bc7-a802-82f87a6bfdd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:31.964949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d4eb480d-b18d-4bc7-a802-82f87a6bfdd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.175414 May 23 13:32:31.966276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 56/114] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:31 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:32.112875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a06e9eeb-679b-4c55-a6dc-06d5e7902a49 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:32.113599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a06e9eeb-679b-4c55-a6dc-06d5e7902a49 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:32.121190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a06e9eeb-679b-4c55-a6dc-06d5e7902a49 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:32.121635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a06e9eeb-679b-4c55-a6dc-06d5e7902a49 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:32.122387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a06e9eeb-679b-4c55-a6dc-06d5e7902a49 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:32.122816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a06e9eeb-679b-4c55-a6dc-06d5e7902a49 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:32.314973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3cbca2e0-7b74-4759-b765-7d5442cf99ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:32.315863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3cbca2e0-7b74-4759-b765-7d5442cf99ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:32.324026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cbca2e0-7b74-4759-b765-7d5442cf99ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:32.325129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cbca2e0-7b74-4759-b765-7d5442cf99ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:32.326598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cbca2e0-7b74-4759-b765-7d5442cf99ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:32.327180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cbca2e0-7b74-4759-b765-7d5442cf99ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:32.429251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a06e9eeb-679b-4c55-a6dc-06d5e7902a49 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:32.442215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a06e9eeb-679b-4c55-a6dc-06d5e7902a49 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.333056 May 23 13:32:32.444205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 59/115] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:32 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:32.449985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:32.450811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:32.459470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:32.460196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:32.461201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:32.461750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:32.631591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:32.640172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:32.641706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:32.642821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3de9850-e67c-443b-a212-d9de53be2307 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.197239 May 23 13:32:32.643380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 60/116] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:32 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:32.649795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3cbca2e0-7b74-4759-b765-7d5442cf99ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:32.657691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3cbca2e0-7b74-4759-b765-7d5442cf99ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.347893 May 23 13:32:32.659322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 57/117] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:32 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:32.989469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-67750b3c-d5c7-4182-858a-149f2f0c0f52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:32.990087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-67750b3c-d5c7-4182-858a-149f2f0c0f52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:32.998188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67750b3c-d5c7-4182-858a-149f2f0c0f52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:32.998642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67750b3c-d5c7-4182-858a-149f2f0c0f52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:32.999447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67750b3c-d5c7-4182-858a-149f2f0c0f52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:32.999879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67750b3c-d5c7-4182-858a-149f2f0c0f52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:33.148809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-67750b3c-d5c7-4182-858a-149f2f0c0f52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:33.158885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-67750b3c-d5c7-4182-858a-149f2f0c0f52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.173150 May 23 13:32:33.159449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 61/118] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:32 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:33.354554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-a43d3d53-548f-4562-9ac8-0b0cf7bafce6 req-c606a9d5-03f5-4f7c-a882-c780faf86e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fed39b-8380-4717-a760-06079bdfd66d", "name": "network-vif-plugged", "status": "completed", "tag": "28defdb2-721b-4ae7-81e4-a7844f3e0baa"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:33.363960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a43d3d53-548f-4562-9ac8-0b0cf7bafce6 req-c606a9d5-03f5-4f7c-a882-c780faf86e0c service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:33.364411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a43d3d53-548f-4562-9ac8-0b0cf7bafce6 req-c606a9d5-03f5-4f7c-a882-c780faf86e0c service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:33.378168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-a43d3d53-548f-4562-9ac8-0b0cf7bafce6 req-c606a9d5-03f5-4f7c-a882-c780faf86e0c service nova] Creating event network-vif-plugged:28defdb2-721b-4ae7-81e4-a7844f3e0baa for instance b6fed39b-8380-4717-a760-06079bdfd66d on hv-cinder-82549 May 23 13:32:33.384679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-a43d3d53-548f-4562-9ac8-0b0cf7bafce6 req-c606a9d5-03f5-4f7c-a882-c780faf86e0c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044244 May 23 13:32:33.385280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 58/119] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:33.459647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e6996f67-3849-4a72-9787-8de9fb88f1e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:33.460270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e6996f67-3849-4a72-9787-8de9fb88f1e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:33.466836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6996f67-3849-4a72-9787-8de9fb88f1e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:33.467574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6996f67-3849-4a72-9787-8de9fb88f1e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:33.468689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6996f67-3849-4a72-9787-8de9fb88f1e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:33.469430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6996f67-3849-4a72-9787-8de9fb88f1e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:33.616154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6996f67-3849-4a72-9787-8de9fb88f1e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:33.627504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e6996f67-3849-4a72-9787-8de9fb88f1e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.171057 May 23 13:32:33.639712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 62/120] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:33 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:33.662225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:33.662929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:33.669330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:33.669783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:33.670548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:33.670983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:33.674595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c99db8d1-0790-4182-8c2b-0b499800e066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:33.675212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c99db8d1-0790-4182-8c2b-0b499800e066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:33.681300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c99db8d1-0790-4182-8c2b-0b499800e066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:33.681750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c99db8d1-0790-4182-8c2b-0b499800e066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:33.682508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c99db8d1-0790-4182-8c2b-0b499800e066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:33.682930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c99db8d1-0790-4182-8c2b-0b499800e066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:33.749360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:33.829737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:33.842179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:33.843777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:33.844889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b99b7261-5672-4ba3-97f3-efb610e0f7a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.187039 May 23 13:32:33.845445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 59/121] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:32:33.855779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c99db8d1-0790-4182-8c2b-0b499800e066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:33.863740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c99db8d1-0790-4182-8c2b-0b499800e066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.192985 May 23 13:32:33.864334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 63/122] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:33 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:34.177109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d085f65d-e0fa-44ad-9c38-ce005e7d6d33 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:34.179518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d085f65d-e0fa-44ad-9c38-ce005e7d6d33 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:34.188176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d085f65d-e0fa-44ad-9c38-ce005e7d6d33 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:34.188877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d085f65d-e0fa-44ad-9c38-ce005e7d6d33 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:34.189659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d085f65d-e0fa-44ad-9c38-ce005e7d6d33 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:34.190312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d085f65d-e0fa-44ad-9c38-ce005e7d6d33 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:34.354959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d085f65d-e0fa-44ad-9c38-ce005e7d6d33 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:34.369984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d085f65d-e0fa-44ad-9c38-ce005e7d6d33 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.197462 May 23 13:32:34.370664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 60/123] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:34 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:34.651086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ea4e38b-7e4f-49f3-b522-19b35cd6fdab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:34.651776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ea4e38b-7e4f-49f3-b522-19b35cd6fdab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:34.658584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ea4e38b-7e4f-49f3-b522-19b35cd6fdab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:34.659037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ea4e38b-7e4f-49f3-b522-19b35cd6fdab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:34.659889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ea4e38b-7e4f-49f3-b522-19b35cd6fdab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:34.660258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ea4e38b-7e4f-49f3-b522-19b35cd6fdab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:34.800553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ea4e38b-7e4f-49f3-b522-19b35cd6fdab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:34.809055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ea4e38b-7e4f-49f3-b522-19b35cd6fdab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.162694 May 23 13:32:34.809625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 64/124] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:34 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:34.864211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:34.864854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:34.871842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:34.872226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:34.876184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:34.876184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:34.883007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-83258032-d6c2-4b90-9064-0119cff286bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:34.883640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-83258032-d6c2-4b90-9064-0119cff286bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:34.892256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83258032-d6c2-4b90-9064-0119cff286bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:34.892756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83258032-d6c2-4b90-9064-0119cff286bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:34.893542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83258032-d6c2-4b90-9064-0119cff286bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:34.894543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83258032-d6c2-4b90-9064-0119cff286bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:35.030049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:35.040322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:35.041895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:35.043059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e80354ee-7414-4bf2-9a3c-b86b89fc4723 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.182994 May 23 13:32:35.043804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 61/125] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:34 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:35.064661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-83258032-d6c2-4b90-9064-0119cff286bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:35.072860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-83258032-d6c2-4b90-9064-0119cff286bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.194923 May 23 13:32:35.073431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 65/126] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:34 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:35.388118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6dd562eb-7a69-46d0-859d-8eae721819b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:35.388805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6dd562eb-7a69-46d0-859d-8eae721819b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:35.395115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dd562eb-7a69-46d0-859d-8eae721819b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:35.395568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dd562eb-7a69-46d0-859d-8eae721819b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:35.396341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dd562eb-7a69-46d0-859d-8eae721819b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:35.396889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dd562eb-7a69-46d0-859d-8eae721819b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:35.532502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6dd562eb-7a69-46d0-859d-8eae721819b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:35.541769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6dd562eb-7a69-46d0-859d-8eae721819b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.157397 May 23 13:32:35.542481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 62/127] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:35 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:35.825901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-368e8f3a-07ae-404d-9554-e4b8ee12f450 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:35.826574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-368e8f3a-07ae-404d-9554-e4b8ee12f450 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:35.833326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-368e8f3a-07ae-404d-9554-e4b8ee12f450 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:35.833791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-368e8f3a-07ae-404d-9554-e4b8ee12f450 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:35.837537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-368e8f3a-07ae-404d-9554-e4b8ee12f450 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:35.837537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-368e8f3a-07ae-404d-9554-e4b8ee12f450 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:36.056285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-368e8f3a-07ae-404d-9554-e4b8ee12f450 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:36.061902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:36.062524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:36.071578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-368e8f3a-07ae-404d-9554-e4b8ee12f450 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.248862 May 23 13:32:36.081199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:36.081199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:36.081199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:36.081199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:36.082589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 66/128] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:35 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:36.105425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5d4d3a9-cb30-4dfd-ad1e-b034d9563c55 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:36.106324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5d4d3a9-cb30-4dfd-ad1e-b034d9563c55 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:36.116428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5d4d3a9-cb30-4dfd-ad1e-b034d9563c55 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:36.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5d4d3a9-cb30-4dfd-ad1e-b034d9563c55 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:36.118117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5d4d3a9-cb30-4dfd-ad1e-b034d9563c55 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:36.119005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5d4d3a9-cb30-4dfd-ad1e-b034d9563c55 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:36.285438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5d4d3a9-cb30-4dfd-ad1e-b034d9563c55 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:36.301401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5d4d3a9-cb30-4dfd-ad1e-b034d9563c55 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.208088 May 23 13:32:36.301401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 67/129] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:36 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:36.315643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:36.325189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:36.326713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:36.327838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6edbb48e-6bbe-4614-89a3-0f196c4ab100 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.270112 May 23 13:32:36.328386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 63/130] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:36 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:32:36.559193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f32aa38c-38f1-4302-aba1-da0e2a6d8eaf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:36.559807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f32aa38c-38f1-4302-aba1-da0e2a6d8eaf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:36.565887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32aa38c-38f1-4302-aba1-da0e2a6d8eaf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:36.566414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32aa38c-38f1-4302-aba1-da0e2a6d8eaf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:36.567188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32aa38c-38f1-4302-aba1-da0e2a6d8eaf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:36.567630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32aa38c-38f1-4302-aba1-da0e2a6d8eaf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:36.735360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f32aa38c-38f1-4302-aba1-da0e2a6d8eaf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:36.743995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f32aa38c-38f1-4302-aba1-da0e2a6d8eaf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.188568 May 23 13:32:36.744586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 68/131] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:36 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:37.090825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-195e4c2a-fa6e-4c77-81de-90c831193f36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:37.091519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-195e4c2a-fa6e-4c77-81de-90c831193f36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:37.098490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-195e4c2a-fa6e-4c77-81de-90c831193f36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:37.098945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-195e4c2a-fa6e-4c77-81de-90c831193f36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:37.100104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-195e4c2a-fa6e-4c77-81de-90c831193f36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:37.101082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-195e4c2a-fa6e-4c77-81de-90c831193f36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:37.149663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-9afb2a5e-47fe-4657-aa98-d3800a53e904 req-e5b36bf9-ef46-4422-8220-ff96f511ff3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011172-f0cf-4b8a-9791-2535bb8bcaa4", "name": "network-vif-plugged", "status": "completed", "tag": "8fcc06ea-c028-490c-8ab1-e434a5b0c699"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:37.161981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-9afb2a5e-47fe-4657-aa98-d3800a53e904 req-e5b36bf9-ef46-4422-8220-ff96f511ff3b service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:37.162685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-9afb2a5e-47fe-4657-aa98-d3800a53e904 req-e5b36bf9-ef46-4422-8220-ff96f511ff3b service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:37.177391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-9afb2a5e-47fe-4657-aa98-d3800a53e904 req-e5b36bf9-ef46-4422-8220-ff96f511ff3b service nova] Creating event network-vif-plugged:8fcc06ea-c028-490c-8ab1-e434a5b0c699 for instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 on hv-cinder-82549 May 23 13:32:37.186475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-9afb2a5e-47fe-4657-aa98-d3800a53e904 req-e5b36bf9-ef46-4422-8220-ff96f511ff3b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042000 May 23 13:32:37.189236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 69/132] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:37.275919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-195e4c2a-fa6e-4c77-81de-90c831193f36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:37.283648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-195e4c2a-fa6e-4c77-81de-90c831193f36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.197571 May 23 13:32:37.284318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 64/133] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:37 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:37.317699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4db01d22-c046-4feb-b88d-22956e011699 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:37.317699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4db01d22-c046-4feb-b88d-22956e011699 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:37.322644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db01d22-c046-4feb-b88d-22956e011699 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:37.323132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db01d22-c046-4feb-b88d-22956e011699 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:37.323853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db01d22-c046-4feb-b88d-22956e011699 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:37.324281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db01d22-c046-4feb-b88d-22956e011699 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:37.345898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:37.346518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:37.356990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:37.357655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:37.358458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:37.359431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:37.528610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4db01d22-c046-4feb-b88d-22956e011699 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:37.535482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:37.539604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4db01d22-c046-4feb-b88d-22956e011699 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.231827 May 23 13:32:37.540392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 70/134] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:37 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:37.543106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:37.544643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:37.545757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f3a3895-ef3f-48c4-8201-57a5cff00da0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.203933 May 23 13:32:37.546336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 65/135] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:37 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:32:37.765130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0fed11cd-7845-4a00-b173-3a2858b9982b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:37.765745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0fed11cd-7845-4a00-b173-3a2858b9982b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:37.772214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fed11cd-7845-4a00-b173-3a2858b9982b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:37.772803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fed11cd-7845-4a00-b173-3a2858b9982b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:37.773587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fed11cd-7845-4a00-b173-3a2858b9982b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:37.774096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fed11cd-7845-4a00-b173-3a2858b9982b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:37.958267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0fed11cd-7845-4a00-b173-3a2858b9982b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:37.961608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:37.969145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0fed11cd-7845-4a00-b173-3a2858b9982b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.207784 May 23 13:32:37.970280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 71/136] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:37 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:38.301809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a75a3d2a-59dd-45d5-b269-56f2d4bc5129 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:38.302380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a75a3d2a-59dd-45d5-b269-56f2d4bc5129 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:38.312308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a75a3d2a-59dd-45d5-b269-56f2d4bc5129 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:38.313020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a75a3d2a-59dd-45d5-b269-56f2d4bc5129 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:38.314022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a75a3d2a-59dd-45d5-b269-56f2d4bc5129 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:38.314747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a75a3d2a-59dd-45d5-b269-56f2d4bc5129 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:38.336897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:38.487328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a75a3d2a-59dd-45d5-b269-56f2d4bc5129 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:38.496430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a75a3d2a-59dd-45d5-b269-56f2d4bc5129 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.198732 May 23 13:32:38.497234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 66/137] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:38 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:38.558545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45eae6e0-6ca9-4201-ae46-f3a5a3649d2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:38.559246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45eae6e0-6ca9-4201-ae46-f3a5a3649d2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:38.564196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:38.564880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:38.579274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:38.581408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:38.581408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:38.581408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:38.587079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45eae6e0-6ca9-4201-ae46-f3a5a3649d2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:38.587959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45eae6e0-6ca9-4201-ae46-f3a5a3649d2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:38.589789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45eae6e0-6ca9-4201-ae46-f3a5a3649d2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:38.590538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45eae6e0-6ca9-4201-ae46-f3a5a3649d2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:38.940123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45eae6e0-6ca9-4201-ae46-f3a5a3649d2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:38.958496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45eae6e0-6ca9-4201-ae46-f3a5a3649d2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.405937 May 23 13:32:38.972954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 72/138] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:38 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:39.005080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c58f10f6-1714-4a7b-958c-ae840d644361 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:39.010230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c58f10f6-1714-4a7b-958c-ae840d644361 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:39.023079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c58f10f6-1714-4a7b-958c-ae840d644361 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:39.024079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c58f10f6-1714-4a7b-958c-ae840d644361 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:39.025252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c58f10f6-1714-4a7b-958c-ae840d644361 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:39.025874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c58f10f6-1714-4a7b-958c-ae840d644361 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:39.144246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:39.156673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:39.158501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:39.159907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37309ded-e097-4077-8a84-3ee5b893af80 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.600208 May 23 13:32:39.160684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 67/139] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:38 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:32:39.298760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-f3f54c5b-d647-40c9-9a86-674449b62895 req-b89a31ea-7017-4973-bde3-c1f020e6ee64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2618bd92-79d0-43b5-8067-c26548f759c3", "name": "network-vif-plugged", "status": "completed", "tag": "d30d25db-4d2c-4301-908b-bb216ff079eb"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:39.308832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f3f54c5b-d647-40c9-9a86-674449b62895 req-b89a31ea-7017-4973-bde3-c1f020e6ee64 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:39.310285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f3f54c5b-d647-40c9-9a86-674449b62895 req-b89a31ea-7017-4973-bde3-c1f020e6ee64 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:39.331487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-f3f54c5b-d647-40c9-9a86-674449b62895 req-b89a31ea-7017-4973-bde3-c1f020e6ee64 service nova] Creating event network-vif-plugged:d30d25db-4d2c-4301-908b-bb216ff079eb for instance 2618bd92-79d0-43b5-8067-c26548f759c3 on hv-cinder-82549 May 23 13:32:39.335579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-f3f54c5b-d647-40c9-9a86-674449b62895 req-b89a31ea-7017-4973-bde3-c1f020e6ee64 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038800 May 23 13:32:39.336661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c58f10f6-1714-4a7b-958c-ae840d644361 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:39.337040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 68/140] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:39.346147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c58f10f6-1714-4a7b-958c-ae840d644361 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.356148 May 23 13:32:39.346769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 73/141] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:38 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:39.514594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1302a30-4414-40c9-b6f6-a4c3eb4cf937 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:39.515395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e1302a30-4414-40c9-b6f6-a4c3eb4cf937 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:39.518677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:39.525921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1302a30-4414-40c9-b6f6-a4c3eb4cf937 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:39.526633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1302a30-4414-40c9-b6f6-a4c3eb4cf937 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:39.527731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1302a30-4414-40c9-b6f6-a4c3eb4cf937 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:39.528242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1302a30-4414-40c9-b6f6-a4c3eb4cf937 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:39.684297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1302a30-4414-40c9-b6f6-a4c3eb4cf937 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:39.693275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1302a30-4414-40c9-b6f6-a4c3eb4cf937 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.182879 May 23 13:32:39.693874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 69/142] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:39 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:40.074117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4adee41-c6d1-4f52-8f14-f629bf6f27ff tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:40.074117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a4adee41-c6d1-4f52-8f14-f629bf6f27ff tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:40.074117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4adee41-c6d1-4f52-8f14-f629bf6f27ff tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:40.074117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4adee41-c6d1-4f52-8f14-f629bf6f27ff tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:40.077591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4adee41-c6d1-4f52-8f14-f629bf6f27ff tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:40.077591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4adee41-c6d1-4f52-8f14-f629bf6f27ff tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:40.134982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a4adee41-c6d1-4f52-8f14-f629bf6f27ff tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:40.142638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4adee41-c6d1-4f52-8f14-f629bf6f27ff tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.169383 May 23 13:32:40.143200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 74/143] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:39 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:40.190508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:40.191167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:40.198018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:40.198496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:40.199302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:40.199743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:40.334448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:40.342385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:40.343889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:40.345016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d0f7baf1-28d4-4e85-bd8c-4132917fe12c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.158570 May 23 13:32:40.345567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 70/144] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:40.363094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65fa79ab-d6cd-4ccc-9c3a-cf80251d46e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:40.363752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65fa79ab-d6cd-4ccc-9c3a-cf80251d46e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:40.371554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65fa79ab-d6cd-4ccc-9c3a-cf80251d46e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:40.372004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65fa79ab-d6cd-4ccc-9c3a-cf80251d46e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:40.372818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65fa79ab-d6cd-4ccc-9c3a-cf80251d46e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:40.373267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65fa79ab-d6cd-4ccc-9c3a-cf80251d46e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:40.504238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65fa79ab-d6cd-4ccc-9c3a-cf80251d46e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:40.512647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65fa79ab-d6cd-4ccc-9c3a-cf80251d46e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.153279 May 23 13:32:40.513233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 75/145] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:40 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:40.710876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-18a55b45-59f4-4f02-b95e-9a83c8ba9b79 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:40.715513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-18a55b45-59f4-4f02-b95e-9a83c8ba9b79 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:40.718433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18a55b45-59f4-4f02-b95e-9a83c8ba9b79 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:40.718888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18a55b45-59f4-4f02-b95e-9a83c8ba9b79 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:40.719654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18a55b45-59f4-4f02-b95e-9a83c8ba9b79 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:40.720103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18a55b45-59f4-4f02-b95e-9a83c8ba9b79 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:40.869292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-18a55b45-59f4-4f02-b95e-9a83c8ba9b79 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:40.877751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-18a55b45-59f4-4f02-b95e-9a83c8ba9b79 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.171477 May 23 13:32:40.878741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 71/146] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:40 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:41.159421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f8a0ffcd-84b9-4a3b-b884-8c372c626dce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:41.160119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f8a0ffcd-84b9-4a3b-b884-8c372c626dce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:41.167263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8a0ffcd-84b9-4a3b-b884-8c372c626dce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:41.167783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8a0ffcd-84b9-4a3b-b884-8c372c626dce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:41.168642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8a0ffcd-84b9-4a3b-b884-8c372c626dce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:41.169153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8a0ffcd-84b9-4a3b-b884-8c372c626dce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:41.312012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f8a0ffcd-84b9-4a3b-b884-8c372c626dce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:41.319957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f8a0ffcd-84b9-4a3b-b884-8c372c626dce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1368 microversion: 2.1 time: 0.164562 May 23 13:32:41.320532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 76/147] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:41 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:41.363434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:41.364395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:41.371656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:41.372104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:41.372912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:41.373339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:41.509405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:41.518255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:41.519754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:41.520884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-83bbe847-66cb-43fa-b3f3-ddeb15cae4f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.161581 May 23 13:32:41.523755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 72/148] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:41 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:41.530261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-80a60b9c-cc44-4bdd-a5b6-c842068656ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:41.530879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-80a60b9c-cc44-4bdd-a5b6-c842068656ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:41.538158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80a60b9c-cc44-4bdd-a5b6-c842068656ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:41.538680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80a60b9c-cc44-4bdd-a5b6-c842068656ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:41.539455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80a60b9c-cc44-4bdd-a5b6-c842068656ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:41.540068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80a60b9c-cc44-4bdd-a5b6-c842068656ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:41.674566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-80a60b9c-cc44-4bdd-a5b6-c842068656ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:41.686939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-80a60b9c-cc44-4bdd-a5b6-c842068656ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.160523 May 23 13:32:41.687789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 77/149] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:41 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:41.905102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97452718-6345-41c8-b1e1-c8d3714b6691 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:41.906359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97452718-6345-41c8-b1e1-c8d3714b6691 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:41.923045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97452718-6345-41c8-b1e1-c8d3714b6691 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:41.924285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97452718-6345-41c8-b1e1-c8d3714b6691 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:41.932855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97452718-6345-41c8-b1e1-c8d3714b6691 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:41.934028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97452718-6345-41c8-b1e1-c8d3714b6691 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:42.213955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97452718-6345-41c8-b1e1-c8d3714b6691 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:42.221930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97452718-6345-41c8-b1e1-c8d3714b6691 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1321 microversion: 2.1 time: 0.330525 May 23 13:32:42.222509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 73/150] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:41 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:42.339522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-68911ad7-2634-404a-85dc-bcfb04770e21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:42.343243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-68911ad7-2634-404a-85dc-bcfb04770e21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:42.351101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68911ad7-2634-404a-85dc-bcfb04770e21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:42.351809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68911ad7-2634-404a-85dc-bcfb04770e21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:42.352836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68911ad7-2634-404a-85dc-bcfb04770e21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:42.353279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68911ad7-2634-404a-85dc-bcfb04770e21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:42.509358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-68911ad7-2634-404a-85dc-bcfb04770e21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:42.517443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-68911ad7-2634-404a-85dc-bcfb04770e21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1558 microversion: 2.1 time: 0.182942 May 23 13:32:42.518577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 78/151] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:42 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:42.540508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:42.541801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:42.543536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f97733fb-92fe-4092-8ffb-32e98c479d08 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:42.544136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f97733fb-92fe-4092-8ffb-32e98c479d08 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:42.548698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:42.549167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:42.550541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:42.550714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f97733fb-92fe-4092-8ffb-32e98c479d08 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:42.550980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:42.551221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f97733fb-92fe-4092-8ffb-32e98c479d08 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:42.551999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f97733fb-92fe-4092-8ffb-32e98c479d08 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:42.553592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f97733fb-92fe-4092-8ffb-32e98c479d08 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:42.670805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f97733fb-92fe-4092-8ffb-32e98c479d08 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131376 May 23 13:32:42.671639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 79/152] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 23 13:32:42 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:32:42.707343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c471cb0-7bcb-49cf-849d-840beb5f4289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:42.708215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c471cb0-7bcb-49cf-849d-840beb5f4289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:42.715294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c471cb0-7bcb-49cf-849d-840beb5f4289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:42.715734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c471cb0-7bcb-49cf-849d-840beb5f4289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:42.716503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c471cb0-7bcb-49cf-849d-840beb5f4289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:42.717169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c471cb0-7bcb-49cf-849d-840beb5f4289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:42.732486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:42.744273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:42.745819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:42.746939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e29c7fe-813b-4766-a3ea-44bff25800cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.211350 May 23 13:32:42.747493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 74/153] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:42 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:43.023115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c471cb0-7bcb-49cf-849d-840beb5f4289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:43.032947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c471cb0-7bcb-49cf-849d-840beb5f4289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.328730 May 23 13:32:43.034048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 80/154] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:42 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:43.248197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab936cb2-54b4-4055-8d88-024c73181bf4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:43.249042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab936cb2-54b4-4055-8d88-024c73181bf4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:43.272778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab936cb2-54b4-4055-8d88-024c73181bf4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:43.273879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab936cb2-54b4-4055-8d88-024c73181bf4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:43.275234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab936cb2-54b4-4055-8d88-024c73181bf4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:43.276166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab936cb2-54b4-4055-8d88-024c73181bf4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:43.490012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab936cb2-54b4-4055-8d88-024c73181bf4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:43.500307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab936cb2-54b4-4055-8d88-024c73181bf4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1515 microversion: 2.1 time: 0.257448 May 23 13:32:43.503722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 75/155] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:43 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:43.520164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ab4846db-1854-4832-aebb-1651afe95347 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:43.522087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ab4846db-1854-4832-aebb-1651afe95347 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:43.532726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab4846db-1854-4832-aebb-1651afe95347 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:43.533194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab4846db-1854-4832-aebb-1651afe95347 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:43.533972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab4846db-1854-4832-aebb-1651afe95347 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:43.534416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab4846db-1854-4832-aebb-1651afe95347 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:43.587845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-ab4846db-1854-4832-aebb-1651afe95347 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'flavor' on Instance uuid b6fed39b-8380-4717-a760-06079bdfd66d {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:32:43.641307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-00625550-c415-483b-86f7-5db27ef9f30d req-e595e882-e4db-4721-81d1-c1d312cb6af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc07d7d-03f3-4b89-ae8e-5b898db04e3d", "name": "network-vif-plugged", "status": "completed", "tag": "1be92243-68d7-42e8-a7dd-2ed34f166ca6"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:43.652967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-00625550-c415-483b-86f7-5db27ef9f30d req-e595e882-e4db-4721-81d1-c1d312cb6af7 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:43.653510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-00625550-c415-483b-86f7-5db27ef9f30d req-e595e882-e4db-4721-81d1-c1d312cb6af7 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:43.666864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-00625550-c415-483b-86f7-5db27ef9f30d req-e595e882-e4db-4721-81d1-c1d312cb6af7 service nova] Creating event network-vif-plugged:1be92243-68d7-42e8-a7dd-2ed34f166ca6 for instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d on hv-cinder-82549 May 23 13:32:43.678218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-00625550-c415-483b-86f7-5db27ef9f30d req-e595e882-e4db-4721-81d1-c1d312cb6af7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045626 May 23 13:32:43.688344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 76/156] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:43.766498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:43.767781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:43.777664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:43.778603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:43.779556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:43.780079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:43.933723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:43.952956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:43.954483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:43.955609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7468e90-8be1-4178-be27-82e4c7359e92 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1407 microversion: 2.20 time: 0.193767 May 23 13:32:43.956385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 77/157] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:43 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:32:44.051509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4daa62de-b9c8-43cf-ba88-1eea7c3b272b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:44.052081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4daa62de-b9c8-43cf-ba88-1eea7c3b272b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:44.058353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4daa62de-b9c8-43cf-ba88-1eea7c3b272b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:44.058797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4daa62de-b9c8-43cf-ba88-1eea7c3b272b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:44.059562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4daa62de-b9c8-43cf-ba88-1eea7c3b272b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:44.060000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4daa62de-b9c8-43cf-ba88-1eea7c3b272b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:44.205380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ab4846db-1854-4832-aebb-1651afe95347 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d/action" status: 200 len: 32 microversion: 2.1 time: 0.689095 May 23 13:32:44.217266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 81/158] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:32:43 2022] POST /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d/action => generated 32 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 13:32:44.223303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-81049d81-d31f-4b09-b080-fd19b102f28c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:44.224048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-81049d81-d31f-4b09-b080-fd19b102f28c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:44.231161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4daa62de-b9c8-43cf-ba88-1eea7c3b272b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:44.232251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-81049d81-d31f-4b09-b080-fd19b102f28c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:44.232734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-81049d81-d31f-4b09-b080-fd19b102f28c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:44.233696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-81049d81-d31f-4b09-b080-fd19b102f28c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:44.234175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-81049d81-d31f-4b09-b080-fd19b102f28c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:44.240779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4daa62de-b9c8-43cf-ba88-1eea7c3b272b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.192911 May 23 13:32:44.251541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 78/159] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:44 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:44.481000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-81049d81-d31f-4b09-b080-fd19b102f28c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:44.491075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-81049d81-d31f-4b09-b080-fd19b102f28c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.272203 May 23 13:32:44.491753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 82/160] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:44 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:44.533141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-e84ccc21-4da8-4871-a058-f5d51ccc4b70 req-513df4bd-f45b-4d57-b51a-ae0643f4796d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f051b3-679a-43af-909b-a4edda1984fa", "tag": "134a119a-a4cc-402e-a0e6-6aa02c073149"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:44.542873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e84ccc21-4da8-4871-a058-f5d51ccc4b70 req-513df4bd-f45b-4d57-b51a-ae0643f4796d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:44.543323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e84ccc21-4da8-4871-a058-f5d51ccc4b70 req-513df4bd-f45b-4d57-b51a-ae0643f4796d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:44.555939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-e84ccc21-4da8-4871-a058-f5d51ccc4b70 req-513df4bd-f45b-4d57-b51a-ae0643f4796d service nova] Creating event network-changed:134a119a-a4cc-402e-a0e6-6aa02c073149 for instance 81f051b3-679a-43af-909b-a4edda1984fa on hv-cinder-82549 May 23 13:32:44.561704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-e84ccc21-4da8-4871-a058-f5d51ccc4b70 req-513df4bd-f45b-4d57-b51a-ae0643f4796d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032090 May 23 13:32:44.562310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 79/161] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:44.975204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:44.976591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:44.984609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:44.985057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:44.985945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:44.986379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:45.150585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:45.161998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:45.164992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:45.180220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-80d0ab42-6bcf-4b7e-b6a8-f824e51759c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1599 microversion: 2.20 time: 0.195916 May 23 13:32:45.182106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 83/162] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:32:44 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:32:45.213780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aaa6a8a2-5f9f-47d5-9019-4679439e1fe4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:45.214529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aaa6a8a2-5f9f-47d5-9019-4679439e1fe4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:45.233284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaa6a8a2-5f9f-47d5-9019-4679439e1fe4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:45.235085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaa6a8a2-5f9f-47d5-9019-4679439e1fe4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:45.236894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaa6a8a2-5f9f-47d5-9019-4679439e1fe4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:45.242040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaa6a8a2-5f9f-47d5-9019-4679439e1fe4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:45.260883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-550c308f-634c-4078-bdbd-317f2a394f18 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:45.261563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-550c308f-634c-4078-bdbd-317f2a394f18 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:45.277990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-550c308f-634c-4078-bdbd-317f2a394f18 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:45.279711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-550c308f-634c-4078-bdbd-317f2a394f18 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:45.280668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-550c308f-634c-4078-bdbd-317f2a394f18 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:45.282177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-550c308f-634c-4078-bdbd-317f2a394f18 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:45.418355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aaa6a8a2-5f9f-47d5-9019-4679439e1fe4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.234143 May 23 13:32:45.419100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 80/163] 10.222.0.70 () {60 vars in 1315 bytes} [Mon May 23 13:32:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:32:45.471548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-550c308f-634c-4078-bdbd-317f2a394f18 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:45.486389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-550c308f-634c-4078-bdbd-317f2a394f18 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.230888 May 23 13:32:45.487487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 84/164] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:45 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:45.513240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ed1597d-d48f-449a-9922-b0a5cb62e66f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:45.514597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ed1597d-d48f-449a-9922-b0a5cb62e66f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:45.525850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ed1597d-d48f-449a-9922-b0a5cb62e66f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:45.526770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ed1597d-d48f-449a-9922-b0a5cb62e66f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:45.527940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ed1597d-d48f-449a-9922-b0a5cb62e66f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:45.528774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ed1597d-d48f-449a-9922-b0a5cb62e66f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:45.854711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ed1597d-d48f-449a-9922-b0a5cb62e66f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:45.887193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ed1597d-d48f-449a-9922-b0a5cb62e66f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.379636 May 23 13:32:45.901493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 81/165] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:45 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:46.505413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31e2a0f8-55cd-4f4e-9541-40937108a568 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:46.507363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31e2a0f8-55cd-4f4e-9541-40937108a568 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:46.514282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e2a0f8-55cd-4f4e-9541-40937108a568 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:46.514860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e2a0f8-55cd-4f4e-9541-40937108a568 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:46.515644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e2a0f8-55cd-4f4e-9541-40937108a568 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:46.516229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31e2a0f8-55cd-4f4e-9541-40937108a568 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:46.712224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31e2a0f8-55cd-4f4e-9541-40937108a568 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:46.720409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31e2a0f8-55cd-4f4e-9541-40937108a568 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.218873 May 23 13:32:46.721318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 85/166] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:46 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:46.907227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f1db992-47c8-44bd-9e8c-1f27ddb9c601 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:46.907879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f1db992-47c8-44bd-9e8c-1f27ddb9c601 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:46.914610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f1db992-47c8-44bd-9e8c-1f27ddb9c601 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:46.915056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f1db992-47c8-44bd-9e8c-1f27ddb9c601 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:46.915821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f1db992-47c8-44bd-9e8c-1f27ddb9c601 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:46.916262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f1db992-47c8-44bd-9e8c-1f27ddb9c601 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:47.181086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f1db992-47c8-44bd-9e8c-1f27ddb9c601 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:47.192646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f1db992-47c8-44bd-9e8c-1f27ddb9c601 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.289555 May 23 13:32:47.193794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 82/167] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:46 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:47.519362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-2f9ca5c2-56d3-45d9-8bf2-50d26d6625b1 req-14060036-3fde-4946-9e81-dbd28ec61b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f011172-f0cf-4b8a-9791-2535bb8bcaa4", "tag": "8fcc06ea-c028-490c-8ab1-e434a5b0c699"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:47.530282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2f9ca5c2-56d3-45d9-8bf2-50d26d6625b1 req-14060036-3fde-4946-9e81-dbd28ec61b0b service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:47.531210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2f9ca5c2-56d3-45d9-8bf2-50d26d6625b1 req-14060036-3fde-4946-9e81-dbd28ec61b0b service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:47.547423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-2f9ca5c2-56d3-45d9-8bf2-50d26d6625b1 req-14060036-3fde-4946-9e81-dbd28ec61b0b service nova] Creating event network-changed:8fcc06ea-c028-490c-8ab1-e434a5b0c699 for instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 on hv-cinder-82549 May 23 13:32:47.553968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-2f9ca5c2-56d3-45d9-8bf2-50d26d6625b1 req-14060036-3fde-4946-9e81-dbd28ec61b0b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037221 May 23 13:32:47.554927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 86/168] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:47.738946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a1e7c86c-416e-4915-9c64-201bfe01c1c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:47.739448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a1e7c86c-416e-4915-9c64-201bfe01c1c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:47.746702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1e7c86c-416e-4915-9c64-201bfe01c1c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:47.747146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1e7c86c-416e-4915-9c64-201bfe01c1c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:47.748492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1e7c86c-416e-4915-9c64-201bfe01c1c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:47.749003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1e7c86c-416e-4915-9c64-201bfe01c1c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:47.916506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a1e7c86c-416e-4915-9c64-201bfe01c1c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:47.925631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a1e7c86c-416e-4915-9c64-201bfe01c1c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.190541 May 23 13:32:47.927324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 83/169] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:47 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:48.214094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0255e7b8-458f-4889-9532-c2481cfadafd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:48.215119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0255e7b8-458f-4889-9532-c2481cfadafd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:48.222077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0255e7b8-458f-4889-9532-c2481cfadafd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:48.222872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0255e7b8-458f-4889-9532-c2481cfadafd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:48.223724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0255e7b8-458f-4889-9532-c2481cfadafd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:48.224106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0255e7b8-458f-4889-9532-c2481cfadafd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:48.242310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:48.454811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0255e7b8-458f-4889-9532-c2481cfadafd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:48.467314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0255e7b8-458f-4889-9532-c2481cfadafd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.259467 May 23 13:32:48.467887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 87/170] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:48 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:48.946402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-57b2f9a1-a039-4172-aa7d-6655d8a415a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:48.965784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-57b2f9a1-a039-4172-aa7d-6655d8a415a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:48.965784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57b2f9a1-a039-4172-aa7d-6655d8a415a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:48.965784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57b2f9a1-a039-4172-aa7d-6655d8a415a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:48.965784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57b2f9a1-a039-4172-aa7d-6655d8a415a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:48.967670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57b2f9a1-a039-4172-aa7d-6655d8a415a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:49.485961 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-216475c3-5ede-465d-93e8-abca7b01d280 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:49.486807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-216475c3-5ede-465d-93e8-abca7b01d280 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:49.488503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-57b2f9a1-a039-4172-aa7d-6655d8a415a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:49.495499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-216475c3-5ede-465d-93e8-abca7b01d280 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:49.495950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-216475c3-5ede-465d-93e8-abca7b01d280 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:49.497165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-216475c3-5ede-465d-93e8-abca7b01d280 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:49.497580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-57b2f9a1-a039-4172-aa7d-6655d8a415a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1363 microversion: 2.1 time: 0.556773 May 23 13:32:49.497701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-216475c3-5ede-465d-93e8-abca7b01d280 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:49.507502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 84/171] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1363 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:49.684376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-216475c3-5ede-465d-93e8-abca7b01d280 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:49.692228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-216475c3-5ede-465d-93e8-abca7b01d280 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.210977 May 23 13:32:49.692719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 88/172] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:49 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:50.514433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8dfe2e3-eddc-40e1-bc0c-4c1a71bd50d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:50.514980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8dfe2e3-eddc-40e1-bc0c-4c1a71bd50d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:50.525422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dfe2e3-eddc-40e1-bc0c-4c1a71bd50d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:50.525919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dfe2e3-eddc-40e1-bc0c-4c1a71bd50d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:50.526932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dfe2e3-eddc-40e1-bc0c-4c1a71bd50d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:50.527447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dfe2e3-eddc-40e1-bc0c-4c1a71bd50d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:50.548004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:50.687443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f8dfe2e3-eddc-40e1-bc0c-4c1a71bd50d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:50.698502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8dfe2e3-eddc-40e1-bc0c-4c1a71bd50d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1549 microversion: 2.1 time: 0.188100 May 23 13:32:50.699075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 85/173] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:50.711841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d642c044-6e08-4667-8c5d-eae92a734cbe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:50.712477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d642c044-6e08-4667-8c5d-eae92a734cbe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:50.725069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d642c044-6e08-4667-8c5d-eae92a734cbe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:50.727688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1dc84e9c-22e3-4a32-b306-ef8b665c6330 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:50.728172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1dc84e9c-22e3-4a32-b306-ef8b665c6330 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:50.730863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d642c044-6e08-4667-8c5d-eae92a734cbe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:50.734242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d642c044-6e08-4667-8c5d-eae92a734cbe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:50.734242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d642c044-6e08-4667-8c5d-eae92a734cbe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:50.749794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc84e9c-22e3-4a32-b306-ef8b665c6330 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:50.750256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc84e9c-22e3-4a32-b306-ef8b665c6330 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:50.751082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc84e9c-22e3-4a32-b306-ef8b665c6330 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:50.751521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc84e9c-22e3-4a32-b306-ef8b665c6330 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:50.837716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1dc84e9c-22e3-4a32-b306-ef8b665c6330 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118372 May 23 13:32:50.837716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 86/174] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 23 13:32:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:50.907006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d642c044-6e08-4667-8c5d-eae92a734cbe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:50.915278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d642c044-6e08-4667-8c5d-eae92a734cbe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.208513 May 23 13:32:50.915883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 89/175] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:50 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:51.931893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-35f1e1d0-d44c-4cec-a1f7-3e28e758995c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:51.932536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-35f1e1d0-d44c-4cec-a1f7-3e28e758995c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:51.938833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35f1e1d0-d44c-4cec-a1f7-3e28e758995c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:51.939284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35f1e1d0-d44c-4cec-a1f7-3e28e758995c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:51.940051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35f1e1d0-d44c-4cec-a1f7-3e28e758995c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:51.940483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35f1e1d0-d44c-4cec-a1f7-3e28e758995c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:52.660000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-2660ded6-a6f4-436a-9dba-776c75058255 req-7e6cf1b2-9fc7-414a-8cbd-8d9d41596b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2618bd92-79d0-43b5-8067-c26548f759c3", "tag": "d30d25db-4d2c-4301-908b-bb216ff079eb"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:52.675074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2660ded6-a6f4-436a-9dba-776c75058255 req-7e6cf1b2-9fc7-414a-8cbd-8d9d41596b79 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:52.675527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2660ded6-a6f4-436a-9dba-776c75058255 req-7e6cf1b2-9fc7-414a-8cbd-8d9d41596b79 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:52.690220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-35f1e1d0-d44c-4cec-a1f7-3e28e758995c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:52.691393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-2660ded6-a6f4-436a-9dba-776c75058255 req-7e6cf1b2-9fc7-414a-8cbd-8d9d41596b79 service nova] Creating event network-changed:d30d25db-4d2c-4301-908b-bb216ff079eb for instance 2618bd92-79d0-43b5-8067-c26548f759c3 on hv-cinder-82549 May 23 13:32:52.700160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-2660ded6-a6f4-436a-9dba-776c75058255 req-7e6cf1b2-9fc7-414a-8cbd-8d9d41596b79 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044590 May 23 13:32:52.701318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 90/176] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:32:52.720100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-35f1e1d0-d44c-4cec-a1f7-3e28e758995c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.790677 May 23 13:32:52.721119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 87/177] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:51 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:52.902210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8d5042c-d1f0-4e73-8ae7-d1209f781004 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:52.903231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8d5042c-d1f0-4e73-8ae7-d1209f781004 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:52.914748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d5042c-d1f0-4e73-8ae7-d1209f781004 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:52.915590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d5042c-d1f0-4e73-8ae7-d1209f781004 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:52.916677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d5042c-d1f0-4e73-8ae7-d1209f781004 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:52.917369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d5042c-d1f0-4e73-8ae7-d1209f781004 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:52.999568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8d5042c-d1f0-4e73-8ae7-d1209f781004 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:32:53.384433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:32:53.518532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8d5042c-d1f0-4e73-8ae7-d1209f781004 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 204 len: 0 microversion: 2.1 time: 0.622715 May 23 13:32:53.519532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 91/178] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:32:52 2022] DELETE /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 13:32:53.535512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0adba34e-0ebe-4030-938a-79ee0a0da9c3 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:53.536703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0adba34e-0ebe-4030-938a-79ee0a0da9c3 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:53.561184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0adba34e-0ebe-4030-938a-79ee0a0da9c3 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:53.561925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0adba34e-0ebe-4030-938a-79ee0a0da9c3 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:53.579063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0adba34e-0ebe-4030-938a-79ee0a0da9c3 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:53.583219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0adba34e-0ebe-4030-938a-79ee0a0da9c3 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:53.745901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c3f19fec-26c4-4349-bca3-021ceb630910 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:53.747443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c3f19fec-26c4-4349-bca3-021ceb630910 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:53.775149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3f19fec-26c4-4349-bca3-021ceb630910 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:53.779548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3f19fec-26c4-4349-bca3-021ceb630910 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:53.781470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3f19fec-26c4-4349-bca3-021ceb630910 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:53.782133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3f19fec-26c4-4349-bca3-021ceb630910 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:53.830669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0adba34e-0ebe-4030-938a-79ee0a0da9c3 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:53.842128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0adba34e-0ebe-4030-938a-79ee0a0da9c3 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1553 microversion: 2.1 time: 0.317253 May 23 13:32:53.842706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 88/179] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:53 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1553 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:53.976373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c3f19fec-26c4-4349-bca3-021ceb630910 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:53.985400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c3f19fec-26c4-4349-bca3-021ceb630910 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.245430 May 23 13:32:53.985986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 92/180] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:53 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:54.860537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-712d4993-f28d-454c-82c1-75696e620aea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:54.861204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-712d4993-f28d-454c-82c1-75696e620aea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:54.867364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-712d4993-f28d-454c-82c1-75696e620aea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:54.867812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-712d4993-f28d-454c-82c1-75696e620aea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:54.868872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-712d4993-f28d-454c-82c1-75696e620aea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:54.869308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-712d4993-f28d-454c-82c1-75696e620aea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:55.003495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52fa3f9c-fbce-4c64-a7d2-3f80025e0fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:55.004160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-52fa3f9c-fbce-4c64-a7d2-3f80025e0fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:55.013488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52fa3f9c-fbce-4c64-a7d2-3f80025e0fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:55.013944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52fa3f9c-fbce-4c64-a7d2-3f80025e0fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:55.014718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52fa3f9c-fbce-4c64-a7d2-3f80025e0fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:55.015159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52fa3f9c-fbce-4c64-a7d2-3f80025e0fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:55.053994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-712d4993-f28d-454c-82c1-75696e620aea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:55.062680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-712d4993-f28d-454c-82c1-75696e620aea tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1553 microversion: 2.1 time: 0.206263 May 23 13:32:55.063263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 89/181] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:54 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:55.151030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52fa3f9c-fbce-4c64-a7d2-3f80025e0fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:55.158707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-52fa3f9c-fbce-4c64-a7d2-3f80025e0fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.159431 May 23 13:32:55.159320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 93/182] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:54 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:56.080467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0eb878f-51f8-434f-aa70-f78e2798365c tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:56.081200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e0eb878f-51f8-434f-aa70-f78e2798365c tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:56.087899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0eb878f-51f8-434f-aa70-f78e2798365c tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:56.088551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0eb878f-51f8-434f-aa70-f78e2798365c tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:56.089464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0eb878f-51f8-434f-aa70-f78e2798365c tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:56.089900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0eb878f-51f8-434f-aa70-f78e2798365c tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:56.192141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a5dbef27-e0d1-4723-96e7-4cd0cb5b79cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:56.194416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a5dbef27-e0d1-4723-96e7-4cd0cb5b79cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:56.201495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5dbef27-e0d1-4723-96e7-4cd0cb5b79cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:56.202279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5dbef27-e0d1-4723-96e7-4cd0cb5b79cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:56.212752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5dbef27-e0d1-4723-96e7-4cd0cb5b79cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:56.212752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5dbef27-e0d1-4723-96e7-4cd0cb5b79cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:56.340103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0eb878f-51f8-434f-aa70-f78e2798365c tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:56.350387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e0eb878f-51f8-434f-aa70-f78e2798365c tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1553 microversion: 2.1 time: 0.273617 May 23 13:32:56.354595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 90/183] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:56 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:56.569067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a5dbef27-e0d1-4723-96e7-4cd0cb5b79cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:56.576809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a5dbef27-e0d1-4723-96e7-4cd0cb5b79cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.404716 May 23 13:32:56.577383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 94/184] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:56 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:57.121475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-52241a2b-9497-4c52-a5c2-2b9cd0eab290 req-bfcfcbf6-2661-4ef7-9604-b4450d560a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57e8a29-90c4-4305-b5bd-b5d2f22673bb", "name": "network-vif-deleted", "tag": "7b9334d3-964c-48c1-bd0f-5cf0f2cccb6f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:32:57.144075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-52241a2b-9497-4c52-a5c2-2b9cd0eab290 req-bfcfcbf6-2661-4ef7-9604-b4450d560a31 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:57.151037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-52241a2b-9497-4c52-a5c2-2b9cd0eab290 req-bfcfcbf6-2661-4ef7-9604-b4450d560a31 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:57.156502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-52241a2b-9497-4c52-a5c2-2b9cd0eab290 req-bfcfcbf6-2661-4ef7-9604-b4450d560a31 service nova] Creating event network-vif-deleted:7b9334d3-964c-48c1-bd0f-5cf0f2cccb6f for instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb on hv-cinder-82549 May 23 13:32:57.162774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-52241a2b-9497-4c52-a5c2-2b9cd0eab290 req-bfcfcbf6-2661-4ef7-9604-b4450d560a31 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051324 May 23 13:32:57.163402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 91/185] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:32:57.371435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cd4ce536-fbae-47d2-9d53-d313c3534c74 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:57.372171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cd4ce536-fbae-47d2-9d53-d313c3534c74 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:57.378775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd4ce536-fbae-47d2-9d53-d313c3534c74 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:57.379229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd4ce536-fbae-47d2-9d53-d313c3534c74 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:57.380082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd4ce536-fbae-47d2-9d53-d313c3534c74 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:57.380547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd4ce536-fbae-47d2-9d53-d313c3534c74 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:57.456922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd4ce536-fbae-47d2-9d53-d313c3534c74 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:57.465813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cd4ce536-fbae-47d2-9d53-d313c3534c74 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1511 microversion: 2.1 time: 0.098370 May 23 13:32:57.476315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 95/186] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:57 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1511 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:32:57.594702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a21d15ca-6988-4329-8df0-541c40b42fe0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:57.595400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a21d15ca-6988-4329-8df0-541c40b42fe0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:57.602512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a21d15ca-6988-4329-8df0-541c40b42fe0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:57.602973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a21d15ca-6988-4329-8df0-541c40b42fe0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:57.603739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a21d15ca-6988-4329-8df0-541c40b42fe0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:57.604174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a21d15ca-6988-4329-8df0-541c40b42fe0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:57.766965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a21d15ca-6988-4329-8df0-541c40b42fe0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:57.778323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a21d15ca-6988-4329-8df0-541c40b42fe0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.187850 May 23 13:32:57.778910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 92/187] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:57 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:58.483658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:58.484185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:58.490894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:58.491340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:58.492099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:58.492530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:58.525825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:58.526371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:58.526879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lazy-loading 'fault' on Instance uuid f57e8a29-90c4-4305-b5bd-b5d2f22673bb {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:32:58.576492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c6c8fd1248908948c1a23ebf15b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f643c268087457e88f3ddabe8715a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:58.585122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-520e2705-978c-4053-be4e-3da2b4017244 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 200 len: 1351 microversion: 2.1 time: 0.105466 May 23 13:32:58.585722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 96/188] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:58 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:58.795674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68f0d8b0-9f8a-4c06-9361-f64bd77acf4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:58.796288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-68f0d8b0-9f8a-4c06-9361-f64bd77acf4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:58.802433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68f0d8b0-9f8a-4c06-9361-f64bd77acf4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:58.802868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68f0d8b0-9f8a-4c06-9361-f64bd77acf4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:58.803633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68f0d8b0-9f8a-4c06-9361-f64bd77acf4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:58.804073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68f0d8b0-9f8a-4c06-9361-f64bd77acf4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:58.938761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68f0d8b0-9f8a-4c06-9361-f64bd77acf4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:32:58.947671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68f0d8b0-9f8a-4c06-9361-f64bd77acf4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.155687 May 23 13:32:58.948241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 93/189] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:58 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:32:59.604797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:59.605418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:59.611715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:59.612158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:59.612964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:59.613392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:59.628449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] HTTP exception thrown: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Request method failure captured: May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb HTTP/1.1 May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4y6gjErcPFuKJEi2gQROWlkw0O6nvxULiizABj4hmvBVtSQfkQtsQ4vZqwOOdSNFXp49lnXEJHIj14Q7KH4jPPS37CHJzWuV2gGH1ASPiolObuoAawjiUQRTQfo5-BBfeQp9yYK2qejTCPjyFCMD_ayGgw01rtiBCydYbURqNV_r5k May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3f643c268087457e88f3ddabe8715a87 May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-DeleteServersTestJSON-959524243 May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:32:59.633348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3f643c268087457e88f3ddabe8715a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3f643c268087457e88f3ddabe8715a87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f643c268087457e88f3ddabe8715a87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f643c268087457e88f3ddabe8715a87"}]}] May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-DeleteServersTestJSON-959524243 May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3f643c268087457e88f3ddabe8715a87 May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-DeleteServersTestJSON-959524243 May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-DeleteServersTestJSON-959524243-project May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 1d30c6c8fd1248908948c1a23ebf15b8 May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-DeleteServersTestJSON-959524243-project May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.634887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'f57e8a29-90c4-4305-b5bd-b5d2f22673bb'} May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:32:59.635757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.637403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:32:59.638668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Returning 404 to user: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:32:59.638668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b64c38fb-55cf-428e-97a0-6b2d4c6dfeff tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 404 len: 111 microversion: 2.1 time: 0.036590 May 23 13:32:59.638668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 97/190] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:59 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 13:32:59.754414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:59.755343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:59.762041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:59.762482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:59.763264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:59.763701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:59.780948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] HTTP exception thrown: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Request method failure captured: May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb/os-volume_attachments HTTP/1.1 May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4y6gjErcPFuKJEi2gQROWlkw0O6nvxULiizABj4hmvBVtSQfkQtsQ4vZqwOOdSNFXp49lnXEJHIj14Q7KH4jPPS37CHJzWuV2gGH1ASPiolObuoAawjiUQRTQfo5-BBfeQp9yYK2qejTCPjyFCMD_ayGgw01rtiBCydYbURqNV_r5k May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 3f643c268087457e88f3ddabe8715a87 May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-DeleteServersTestJSON-959524243 May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:32:59.785196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3f643c268087457e88f3ddabe8715a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3f643c268087457e88f3ddabe8715a87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f643c268087457e88f3ddabe8715a87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f643c268087457e88f3ddabe8715a87"}]}] May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-DeleteServersTestJSON-959524243 May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 3f643c268087457e88f3ddabe8715a87 May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-DeleteServersTestJSON-959524243 May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-DeleteServersTestJSON-959524243-project May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 1d30c6c8fd1248908948c1a23ebf15b8 May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-DeleteServersTestJSON-959524243-project May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.786853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': 'f57e8a29-90c4-4305-b5bd-b5d2f22673bb'} May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:32:59.789876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:32:59.791152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:32:59.792474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Returning 404 to user: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:32:59.792474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7af37f22-08bb-4572-b2e4-4e05391c92f4 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036682 May 23 13:32:59.792474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 94/191] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:32:59 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 13:32:59.966434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e8fba2b-ea13-4a96-8a50-3a4668b6f78b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:32:59.966434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e8fba2b-ea13-4a96-8a50-3a4668b6f78b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:32:59.974279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e8fba2b-ea13-4a96-8a50-3a4668b6f78b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:59.975696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e8fba2b-ea13-4a96-8a50-3a4668b6f78b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:32:59.976756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e8fba2b-ea13-4a96-8a50-3a4668b6f78b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:32:59.977198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e8fba2b-ea13-4a96-8a50-3a4668b6f78b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:00.122131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6e8fba2b-ea13-4a96-8a50-3a4668b6f78b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:00.129774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e8fba2b-ea13-4a96-8a50-3a4668b6f78b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.168011 May 23 13:33:00.130331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 98/192] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:32:59 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:01.156219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae58409d-d38d-48c4-a954-046104a6c88e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:01.157043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae58409d-d38d-48c4-a954-046104a6c88e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:01.164639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae58409d-d38d-48c4-a954-046104a6c88e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:01.165259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae58409d-d38d-48c4-a954-046104a6c88e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:01.166039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae58409d-d38d-48c4-a954-046104a6c88e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:01.166473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae58409d-d38d-48c4-a954-046104a6c88e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:01.254217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:01.255257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:01.263702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:01.263899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:01.264841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:01.265345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:01.282205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] HTTP exception thrown: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Request method failure captured: May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb HTTP/1.1 May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4y6gjErcPFuKJEi2gQROWlkw0O6nvxULiizABj4hmvBVtSQfkQtsQ4vZqwOOdSNFXp49lnXEJHIj14Q7KH4jPPS37CHJzWuV2gGH1ASPiolObuoAawjiUQRTQfo5-BBfeQp9yYK2qejTCPjyFCMD_ayGgw01rtiBCydYbURqNV_r5k May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3f643c268087457e88f3ddabe8715a87 May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-DeleteServersTestJSON-959524243 May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:33:01.283780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3f643c268087457e88f3ddabe8715a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3f643c268087457e88f3ddabe8715a87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f643c268087457e88f3ddabe8715a87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f643c268087457e88f3ddabe8715a87"}]}] May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-DeleteServersTestJSON-959524243 May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3f643c268087457e88f3ddabe8715a87 May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-DeleteServersTestJSON-959524243 May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-DeleteServersTestJSON-959524243-project May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 1d30c6c8fd1248908948c1a23ebf15b8 May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-DeleteServersTestJSON-959524243-project May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.285245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'f57e8a29-90c4-4305-b5bd-b5d2f22673bb'} May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:33:01.286061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.288153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.289285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Returning 404 to user: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:33:01.289285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e02d341-850c-4302-b39b-115622d3c008 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 404 len: 111 microversion: 2.1 time: 0.035260 May 23 13:33:01.289285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 99/193] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:33:01 2022] DELETE /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 13:33:01.294797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:01.295525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] [instance: f57e8a29-90c4-4305-b5bd-b5d2f22673bb] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:01.302744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:01.303351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:01.304340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:01.304893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:01.318892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] HTTP exception thrown: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Request method failure captured: May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb HTTP/1.1 May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4y6gjErcPFuKJEi2gQROWlkw0O6nvxULiizABj4hmvBVtSQfkQtsQ4vZqwOOdSNFXp49lnXEJHIj14Q7KH4jPPS37CHJzWuV2gGH1ASPiolObuoAawjiUQRTQfo5-BBfeQp9yYK2qejTCPjyFCMD_ayGgw01rtiBCydYbURqNV_r5k May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3f643c268087457e88f3ddabe8715a87 May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-DeleteServersTestJSON-959524243 May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:33:01.320439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3f643c268087457e88f3ddabe8715a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3f643c268087457e88f3ddabe8715a87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f643c268087457e88f3ddabe8715a87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f643c268087457e88f3ddabe8715a87"}]}] May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-DeleteServersTestJSON-959524243 May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3f643c268087457e88f3ddabe8715a87 May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-DeleteServersTestJSON-959524243 May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-DeleteServersTestJSON-959524243-project May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 1d30c6c8fd1248908948c1a23ebf15b8 May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-DeleteServersTestJSON-959524243-project May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.322925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'f57e8a29-90c4-4305-b5bd-b5d2f22673bb'} May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:33:01.323694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. May 23 13:33:01.325002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:33:01.326118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] Returning 404 to user: Instance f57e8a29-90c4-4305-b5bd-b5d2f22673bb could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:33:01.326118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bfac0ebd-5f6b-47af-b2de-1a43ee1094c0 tempest-DeleteServersTestJSON-959524243 tempest-DeleteServersTestJSON-959524243-project] 10.222.0.70 "GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb" status: 404 len: 111 microversion: 2.1 time: 0.031024 May 23 13:33:01.326118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 100/194] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:01 2022] GET /compute/v2.1/servers/f57e8a29-90c4-4305-b5bd-b5d2f22673bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 13:33:01.326372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae58409d-d38d-48c4-a954-046104a6c88e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:01.335517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae58409d-d38d-48c4-a954-046104a6c88e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.183435 May 23 13:33:01.335999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 95/195] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:01 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:02.353132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb2f1fc6-c6d8-47cb-89ae-d4bd22c8c713 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:02.353737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb2f1fc6-c6d8-47cb-89ae-d4bd22c8c713 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:02.360336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2f1fc6-c6d8-47cb-89ae-d4bd22c8c713 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:02.360816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2f1fc6-c6d8-47cb-89ae-d4bd22c8c713 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:02.361597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2f1fc6-c6d8-47cb-89ae-d4bd22c8c713 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:02.362031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2f1fc6-c6d8-47cb-89ae-d4bd22c8c713 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:02.501440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bb2f1fc6-c6d8-47cb-89ae-d4bd22c8c713 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:02.510135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb2f1fc6-c6d8-47cb-89ae-d4bd22c8c713 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.161403 May 23 13:33:02.510562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 101/196] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:02 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:03.528530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-86bbbb12-5c4f-4804-a357-cc7f620cccd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:03.529799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-86bbbb12-5c4f-4804-a357-cc7f620cccd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:03.536427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bbbb12-5c4f-4804-a357-cc7f620cccd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:03.537559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bbbb12-5c4f-4804-a357-cc7f620cccd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:03.538301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bbbb12-5c4f-4804-a357-cc7f620cccd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:03.538734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bbbb12-5c4f-4804-a357-cc7f620cccd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:03.677939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-86bbbb12-5c4f-4804-a357-cc7f620cccd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:03.685738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-86bbbb12-5c4f-4804-a357-cc7f620cccd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.161463 May 23 13:33:03.686306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 96/197] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:03 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:04.702223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-292c3ef7-b73e-4e7f-aa88-64ef3795953b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:04.702890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-292c3ef7-b73e-4e7f-aa88-64ef3795953b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:04.709968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-292c3ef7-b73e-4e7f-aa88-64ef3795953b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:04.710425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-292c3ef7-b73e-4e7f-aa88-64ef3795953b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:04.711216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-292c3ef7-b73e-4e7f-aa88-64ef3795953b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:04.711655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-292c3ef7-b73e-4e7f-aa88-64ef3795953b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:04.866937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-292c3ef7-b73e-4e7f-aa88-64ef3795953b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:04.875154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-292c3ef7-b73e-4e7f-aa88-64ef3795953b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.176752 May 23 13:33:04.881020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 102/198] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:04 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:05.891879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-829f045b-ca80-4399-8d01-18b24e03c9f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:05.892488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-829f045b-ca80-4399-8d01-18b24e03c9f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:05.898964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-829f045b-ca80-4399-8d01-18b24e03c9f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:05.899385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-829f045b-ca80-4399-8d01-18b24e03c9f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:05.900147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-829f045b-ca80-4399-8d01-18b24e03c9f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:05.900692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-829f045b-ca80-4399-8d01-18b24e03c9f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:06.044208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-829f045b-ca80-4399-8d01-18b24e03c9f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:06.052168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-829f045b-ca80-4399-8d01-18b24e03c9f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.164023 May 23 13:33:06.053460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 97/199] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:05 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:07.078124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64a042be-985b-4e4b-bf48-84842da0935c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:07.078826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64a042be-985b-4e4b-bf48-84842da0935c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:07.087557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a042be-985b-4e4b-bf48-84842da0935c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:07.088277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a042be-985b-4e4b-bf48-84842da0935c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:07.090174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a042be-985b-4e4b-bf48-84842da0935c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:07.090683 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a042be-985b-4e4b-bf48-84842da0935c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:07.303581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64a042be-985b-4e4b-bf48-84842da0935c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:07.311386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64a042be-985b-4e4b-bf48-84842da0935c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.237629 May 23 13:33:07.311972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 103/200] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:07 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:08.328484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-046cfb0f-e48d-455c-bd0c-c37ed8030ff8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:08.329086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-046cfb0f-e48d-455c-bd0c-c37ed8030ff8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:08.335399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-046cfb0f-e48d-455c-bd0c-c37ed8030ff8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:08.335872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-046cfb0f-e48d-455c-bd0c-c37ed8030ff8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:08.336715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-046cfb0f-e48d-455c-bd0c-c37ed8030ff8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:08.337063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-046cfb0f-e48d-455c-bd0c-c37ed8030ff8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:08.480288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-046cfb0f-e48d-455c-bd0c-c37ed8030ff8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:08.488593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-046cfb0f-e48d-455c-bd0c-c37ed8030ff8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.164019 May 23 13:33:08.490626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 98/201] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:08 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:09.512007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19cca703-ecdf-43a3-a377-34f288496b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:09.513300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19cca703-ecdf-43a3-a377-34f288496b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:09.521977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19cca703-ecdf-43a3-a377-34f288496b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:09.522464 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19cca703-ecdf-43a3-a377-34f288496b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:09.525148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19cca703-ecdf-43a3-a377-34f288496b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:09.525148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19cca703-ecdf-43a3-a377-34f288496b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:09.673249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19cca703-ecdf-43a3-a377-34f288496b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:09.675330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:33:09.682878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19cca703-ecdf-43a3-a377-34f288496b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.175326 May 23 13:33:09.682878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 104/202] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:09 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:10.699447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0edd5a24-1296-4d13-aa87-013b2af45ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:10.700058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0edd5a24-1296-4d13-aa87-013b2af45ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:10.706179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edd5a24-1296-4d13-aa87-013b2af45ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:10.706628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edd5a24-1296-4d13-aa87-013b2af45ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:10.707404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edd5a24-1296-4d13-aa87-013b2af45ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:10.707840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edd5a24-1296-4d13-aa87-013b2af45ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:10.851555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0edd5a24-1296-4d13-aa87-013b2af45ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:10.868882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0edd5a24-1296-4d13-aa87-013b2af45ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.164264 May 23 13:33:10.868882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 99/203] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:10 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:11.878632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-21f93ff0-8032-438d-a065-35dae71b5e2e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:11.879340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-21f93ff0-8032-438d-a065-35dae71b5e2e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:11.887757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21f93ff0-8032-438d-a065-35dae71b5e2e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:11.888353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21f93ff0-8032-438d-a065-35dae71b5e2e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:11.889388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21f93ff0-8032-438d-a065-35dae71b5e2e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:11.889830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21f93ff0-8032-438d-a065-35dae71b5e2e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:12.049630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-21f93ff0-8032-438d-a065-35dae71b5e2e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:12.058631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-21f93ff0-8032-438d-a065-35dae71b5e2e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.184216 May 23 13:33:12.059246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 105/204] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:11 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:13.075613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e9565e5-a83f-473a-a85c-7b233ed18b59 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:13.076248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1e9565e5-a83f-473a-a85c-7b233ed18b59 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:13.078242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=62 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:33:13.082980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e9565e5-a83f-473a-a85c-7b233ed18b59 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:13.083425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e9565e5-a83f-473a-a85c-7b233ed18b59 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:13.084230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e9565e5-a83f-473a-a85c-7b233ed18b59 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:13.084677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e9565e5-a83f-473a-a85c-7b233ed18b59 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:13.305820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1e9565e5-a83f-473a-a85c-7b233ed18b59 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:13.315843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1e9565e5-a83f-473a-a85c-7b233ed18b59 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.243624 May 23 13:33:13.329266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 100/205] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:13 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:14.340115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfac2a7e-b684-41ff-8001-e861e863c49c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:14.340912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bfac2a7e-b684-41ff-8001-e861e863c49c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:14.348529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfac2a7e-b684-41ff-8001-e861e863c49c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:14.349012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfac2a7e-b684-41ff-8001-e861e863c49c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:14.350594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfac2a7e-b684-41ff-8001-e861e863c49c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:14.351030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfac2a7e-b684-41ff-8001-e861e863c49c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:14.490338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfac2a7e-b684-41ff-8001-e861e863c49c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:14.500660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bfac2a7e-b684-41ff-8001-e861e863c49c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.164522 May 23 13:33:14.501486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 106/206] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:14 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:15.518052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5be4be97-0abc-46c3-bc60-40b0b24d9125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:15.518949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5be4be97-0abc-46c3-bc60-40b0b24d9125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:15.526206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5be4be97-0abc-46c3-bc60-40b0b24d9125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:15.526677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5be4be97-0abc-46c3-bc60-40b0b24d9125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:15.527486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5be4be97-0abc-46c3-bc60-40b0b24d9125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:15.527923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5be4be97-0abc-46c3-bc60-40b0b24d9125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:15.668893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5be4be97-0abc-46c3-bc60-40b0b24d9125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:15.676674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5be4be97-0abc-46c3-bc60-40b0b24d9125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.162544 May 23 13:33:15.677237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 101/207] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:15 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:16.695335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-541dd6f8-ba03-4ffe-877a-ac270c573119 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:16.696046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-541dd6f8-ba03-4ffe-877a-ac270c573119 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:16.703992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-541dd6f8-ba03-4ffe-877a-ac270c573119 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:16.704529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-541dd6f8-ba03-4ffe-877a-ac270c573119 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:16.705534 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-541dd6f8-ba03-4ffe-877a-ac270c573119 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:16.705924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-541dd6f8-ba03-4ffe-877a-ac270c573119 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:16.893401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-541dd6f8-ba03-4ffe-877a-ac270c573119 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:16.902963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-541dd6f8-ba03-4ffe-877a-ac270c573119 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.212524 May 23 13:33:16.903560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 107/208] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:16 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:17.920224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-676800dd-98ea-4940-b647-e536d0cc7d41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:17.920888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-676800dd-98ea-4940-b647-e536d0cc7d41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:17.930265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-676800dd-98ea-4940-b647-e536d0cc7d41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:17.930265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-676800dd-98ea-4940-b647-e536d0cc7d41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:17.931476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-676800dd-98ea-4940-b647-e536d0cc7d41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:17.932137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-676800dd-98ea-4940-b647-e536d0cc7d41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:18.093901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-676800dd-98ea-4940-b647-e536d0cc7d41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:18.103486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-676800dd-98ea-4940-b647-e536d0cc7d41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.187114 May 23 13:33:18.104101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 102/209] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:17 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:19.123669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6c1d29b-1785-4efa-947d-be7a525980d1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:19.124358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c6c1d29b-1785-4efa-947d-be7a525980d1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:19.132086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6c1d29b-1785-4efa-947d-be7a525980d1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:19.132593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6c1d29b-1785-4efa-947d-be7a525980d1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:19.133388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6c1d29b-1785-4efa-947d-be7a525980d1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:19.134080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6c1d29b-1785-4efa-947d-be7a525980d1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:19.326341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c6c1d29b-1785-4efa-947d-be7a525980d1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:19.330616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c6c1d29b-1785-4efa-947d-be7a525980d1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.212220 May 23 13:33:19.331371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 108/210] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:19 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:20.350796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-08ad9adf-c0e5-4ad4-b85d-7506c2c1c944 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:20.351678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-08ad9adf-c0e5-4ad4-b85d-7506c2c1c944 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:20.358502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08ad9adf-c0e5-4ad4-b85d-7506c2c1c944 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:20.362683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08ad9adf-c0e5-4ad4-b85d-7506c2c1c944 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:20.362683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08ad9adf-c0e5-4ad4-b85d-7506c2c1c944 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:20.362683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08ad9adf-c0e5-4ad4-b85d-7506c2c1c944 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:20.496405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-08ad9adf-c0e5-4ad4-b85d-7506c2c1c944 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:20.499813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:33:20.504205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-08ad9adf-c0e5-4ad4-b85d-7506c2c1c944 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.158957 May 23 13:33:20.504801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 103/211] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:20 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:21.522761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eadf0e37-31d1-41f3-b6d2-4610a6a88bfe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:21.523373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eadf0e37-31d1-41f3-b6d2-4610a6a88bfe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:21.530492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eadf0e37-31d1-41f3-b6d2-4610a6a88bfe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:21.530937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eadf0e37-31d1-41f3-b6d2-4610a6a88bfe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:21.531699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eadf0e37-31d1-41f3-b6d2-4610a6a88bfe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:21.532126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eadf0e37-31d1-41f3-b6d2-4610a6a88bfe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:21.680043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eadf0e37-31d1-41f3-b6d2-4610a6a88bfe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:21.688051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eadf0e37-31d1-41f3-b6d2-4610a6a88bfe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1521 microversion: 2.1 time: 0.169792 May 23 13:33:21.688654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 109/212] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:21 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:22.707514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dbe97eed-a15a-4bb2-935a-36f9a8710125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:22.708122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dbe97eed-a15a-4bb2-935a-36f9a8710125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:22.715465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbe97eed-a15a-4bb2-935a-36f9a8710125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:22.717902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbe97eed-a15a-4bb2-935a-36f9a8710125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:22.717902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbe97eed-a15a-4bb2-935a-36f9a8710125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:22.717902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbe97eed-a15a-4bb2-935a-36f9a8710125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:22.856014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dbe97eed-a15a-4bb2-935a-36f9a8710125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:22.863878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dbe97eed-a15a-4bb2-935a-36f9a8710125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1501 microversion: 2.1 time: 0.160300 May 23 13:33:22.864461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 104/213] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:22 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:22.881624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7f698ac-277e-4415-9aa6-15559c59de05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:22.882375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7f698ac-277e-4415-9aa6-15559c59de05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:22.888475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7f698ac-277e-4415-9aa6-15559c59de05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:22.889211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7f698ac-277e-4415-9aa6-15559c59de05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:22.890159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7f698ac-277e-4415-9aa6-15559c59de05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:22.890594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7f698ac-277e-4415-9aa6-15559c59de05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:23.043221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7f698ac-277e-4415-9aa6-15559c59de05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:23.055146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7f698ac-277e-4415-9aa6-15559c59de05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1516 microversion: 2.1 time: 0.178074 May 23 13:33:23.055769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 110/214] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:22 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:26.081334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f9f010e4-c016-4d94-a9be-d8c042ad04fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:33:26.081334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f9f010e4-c016-4d94-a9be-d8c042ad04fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:26.088960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9f010e4-c016-4d94-a9be-d8c042ad04fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:26.089732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9f010e4-c016-4d94-a9be-d8c042ad04fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:26.090463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9f010e4-c016-4d94-a9be-d8c042ad04fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:26.090890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9f010e4-c016-4d94-a9be-d8c042ad04fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:26.128124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-f9f010e4-c016-4d94-a9be-d8c042ad04fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'flavor' on Instance uuid ebc07d7d-03f3-4b89-ae8e-5b898db04e3d {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:33:26.508647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f9f010e4-c016-4d94-a9be-d8c042ad04fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d/action" status: 200 len: 32 microversion: 2.1 time: 0.438661 May 23 13:33:26.509453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 105/215] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:33:26 2022] POST /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 13:33:26.519610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-951109ec-b532-4a31-abba-21e006bec726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:26.520275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-951109ec-b532-4a31-abba-21e006bec726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:26.523203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:33:26.528765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-951109ec-b532-4a31-abba-21e006bec726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:26.529220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-951109ec-b532-4a31-abba-21e006bec726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:26.530084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-951109ec-b532-4a31-abba-21e006bec726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:26.530718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-951109ec-b532-4a31-abba-21e006bec726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:26.670151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-951109ec-b532-4a31-abba-21e006bec726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:26.678787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-951109ec-b532-4a31-abba-21e006bec726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.162857 May 23 13:33:26.679566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 111/216] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:26 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:27.698660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-13d02883-815a-448b-9ac6-5ff075dbd26e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:27.699582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-13d02883-815a-448b-9ac6-5ff075dbd26e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:27.707230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13d02883-815a-448b-9ac6-5ff075dbd26e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:27.708004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13d02883-815a-448b-9ac6-5ff075dbd26e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:27.709740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13d02883-815a-448b-9ac6-5ff075dbd26e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:27.710473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13d02883-815a-448b-9ac6-5ff075dbd26e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:27.947487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-13d02883-815a-448b-9ac6-5ff075dbd26e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:27.954523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-13d02883-815a-448b-9ac6-5ff075dbd26e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.262725 May 23 13:33:27.955107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 106/217] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:27 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:28.972808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-37735645-fd9f-45a8-87f3-f6714e0cb617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:28.973425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-37735645-fd9f-45a8-87f3-f6714e0cb617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:28.980908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37735645-fd9f-45a8-87f3-f6714e0cb617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:28.981371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37735645-fd9f-45a8-87f3-f6714e0cb617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:28.982137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37735645-fd9f-45a8-87f3-f6714e0cb617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:28.982566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37735645-fd9f-45a8-87f3-f6714e0cb617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:29.143954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-37735645-fd9f-45a8-87f3-f6714e0cb617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:29.153177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-37735645-fd9f-45a8-87f3-f6714e0cb617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.185326 May 23 13:33:29.154073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 112/218] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:28 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:30.170723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2035d3a-c306-401b-a345-1dea0f67b6d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:30.171580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2035d3a-c306-401b-a345-1dea0f67b6d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:30.179254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2035d3a-c306-401b-a345-1dea0f67b6d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:30.180022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2035d3a-c306-401b-a345-1dea0f67b6d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:30.180962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2035d3a-c306-401b-a345-1dea0f67b6d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:30.181365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2035d3a-c306-401b-a345-1dea0f67b6d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:30.328335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2035d3a-c306-401b-a345-1dea0f67b6d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:30.336461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2035d3a-c306-401b-a345-1dea0f67b6d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.169704 May 23 13:33:30.337065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 107/219] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:30 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:31.354171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dcdb11ca-6b83-4660-a97a-6e05891d9494 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:31.354848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dcdb11ca-6b83-4660-a97a-6e05891d9494 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:31.360959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcdb11ca-6b83-4660-a97a-6e05891d9494 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:31.361409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcdb11ca-6b83-4660-a97a-6e05891d9494 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:31.362181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcdb11ca-6b83-4660-a97a-6e05891d9494 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:31.362667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcdb11ca-6b83-4660-a97a-6e05891d9494 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:31.511205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcdb11ca-6b83-4660-a97a-6e05891d9494 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:31.518896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dcdb11ca-6b83-4660-a97a-6e05891d9494 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.169410 May 23 13:33:31.519480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 113/220] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:31 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:32.537899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2ac9192d-17ee-443a-b4ec-dbe2763e4401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:32.538942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2ac9192d-17ee-443a-b4ec-dbe2763e4401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:32.545253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ac9192d-17ee-443a-b4ec-dbe2763e4401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:32.545692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ac9192d-17ee-443a-b4ec-dbe2763e4401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:32.550292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ac9192d-17ee-443a-b4ec-dbe2763e4401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:32.550779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ac9192d-17ee-443a-b4ec-dbe2763e4401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:32.773318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ac9192d-17ee-443a-b4ec-dbe2763e4401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:32.782092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2ac9192d-17ee-443a-b4ec-dbe2763e4401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.249121 May 23 13:33:32.782673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 108/221] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:32 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:33.799547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-74cab6e1-bba1-41cf-a8bb-719cf9f4a3bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:33.800247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-74cab6e1-bba1-41cf-a8bb-719cf9f4a3bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:33.807803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74cab6e1-bba1-41cf-a8bb-719cf9f4a3bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:33.808216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74cab6e1-bba1-41cf-a8bb-719cf9f4a3bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:33.809184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74cab6e1-bba1-41cf-a8bb-719cf9f4a3bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:33.809774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74cab6e1-bba1-41cf-a8bb-719cf9f4a3bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:33.962407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-74cab6e1-bba1-41cf-a8bb-719cf9f4a3bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:33.970913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-74cab6e1-bba1-41cf-a8bb-719cf9f4a3bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.175121 May 23 13:33:33.971492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 114/222] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:33 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:34.994932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc8b1030-9821-4a24-bae6-76ce48838582 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:34.995497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc8b1030-9821-4a24-bae6-76ce48838582 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:35.002005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc8b1030-9821-4a24-bae6-76ce48838582 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:35.006531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc8b1030-9821-4a24-bae6-76ce48838582 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:35.006531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc8b1030-9821-4a24-bae6-76ce48838582 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:35.006531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc8b1030-9821-4a24-bae6-76ce48838582 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:35.166489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc8b1030-9821-4a24-bae6-76ce48838582 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:35.175149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc8b1030-9821-4a24-bae6-76ce48838582 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.184315 May 23 13:33:35.186197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 109/223] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:34 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:36.194589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a0dc7982-785e-4288-a830-20e04b3279b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:36.195201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a0dc7982-785e-4288-a830-20e04b3279b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:36.210474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0dc7982-785e-4288-a830-20e04b3279b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:36.210474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0dc7982-785e-4288-a830-20e04b3279b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:36.210474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0dc7982-785e-4288-a830-20e04b3279b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:36.210474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0dc7982-785e-4288-a830-20e04b3279b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:36.347608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a0dc7982-785e-4288-a830-20e04b3279b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:36.355304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a0dc7982-785e-4288-a830-20e04b3279b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.165580 May 23 13:33:36.356984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 115/224] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:36 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:37.375092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bbc14085-dbfc-4b02-bb67-7b3145b01f29 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:37.376051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bbc14085-dbfc-4b02-bb67-7b3145b01f29 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:37.383896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbc14085-dbfc-4b02-bb67-7b3145b01f29 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:37.384352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbc14085-dbfc-4b02-bb67-7b3145b01f29 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:37.385193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbc14085-dbfc-4b02-bb67-7b3145b01f29 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:37.385663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbc14085-dbfc-4b02-bb67-7b3145b01f29 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:37.537287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bbc14085-dbfc-4b02-bb67-7b3145b01f29 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:37.547013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bbc14085-dbfc-4b02-bb67-7b3145b01f29 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.175753 May 23 13:33:37.547819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 110/225] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:37 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:38.565971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-005808e4-bece-49bf-b5eb-b398158c6a2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:38.566636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-005808e4-bece-49bf-b5eb-b398158c6a2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:38.573977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-005808e4-bece-49bf-b5eb-b398158c6a2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:38.574494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-005808e4-bece-49bf-b5eb-b398158c6a2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:38.575275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-005808e4-bece-49bf-b5eb-b398158c6a2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:38.575717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-005808e4-bece-49bf-b5eb-b398158c6a2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:38.718330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-005808e4-bece-49bf-b5eb-b398158c6a2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:38.726781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-005808e4-bece-49bf-b5eb-b398158c6a2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.164939 May 23 13:33:38.727359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 116/226] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:38 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:39.135498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-638404130", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "networks": [{"uuid": "2d77765d-c719-42d2-a70b-26bbabd2e1b8"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:33:39.188874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] validate_networks() for [('2d77765d-c719-42d2-a70b-26bbabd2e1b8', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:33:39.607585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:33:39.608025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:33:39.608528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:33:39.609094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:33:39.609922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:33:39.622523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:39.623026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:39.623881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:39.625076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:39.644282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Getting quotas for project 562a3f075cb64d668a76838fd4f9c8f5. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:33:39.650971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Getting quotas for user 659caf32fa614f64bcd780a264674e33 and project 562a3f075cb64d668a76838fd4f9c8f5. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:33:39.666974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:33:39.669274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:33:39.744451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e73a427-add1-438e-972b-61ee1bec7059 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:39.745089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e73a427-add1-438e-972b-61ee1bec7059 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:39.751629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e73a427-add1-438e-972b-61ee1bec7059 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:39.752076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e73a427-add1-438e-972b-61ee1bec7059 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:39.755617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e73a427-add1-438e-972b-61ee1bec7059 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:39.755617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e73a427-add1-438e-972b-61ee1bec7059 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:39.860778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d114cc62-9e1c-4fb2-9729-0166e3d63fff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728924 May 23 13:33:39.861516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 111/227] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 13:33:39.871737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed94ced9-0c04-49f0-b540-49d62f235603 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:39.872345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed94ced9-0c04-49f0-b540-49d62f235603 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:39.892595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e73a427-add1-438e-972b-61ee1bec7059 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:39.903001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e73a427-add1-438e-972b-61ee1bec7059 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.163272 May 23 13:33:39.908960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 117/228] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:39 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:39.949238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed94ced9-0c04-49f0-b540-49d62f235603 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:39.958183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed94ced9-0c04-49f0-b540-49d62f235603 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1218 microversion: 2.1 time: 0.090313 May 23 13:33:39.960120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 112/229] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:39 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:40.919504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-702fad7c-581f-47e8-bb70-ce1600813149 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:40.920111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-702fad7c-581f-47e8-bb70-ce1600813149 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:40.927540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-702fad7c-581f-47e8-bb70-ce1600813149 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:40.927540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-702fad7c-581f-47e8-bb70-ce1600813149 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:40.928920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-702fad7c-581f-47e8-bb70-ce1600813149 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:40.929490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-702fad7c-581f-47e8-bb70-ce1600813149 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:40.977899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8f21d0f6-9216-4c9f-83fa-00df9c94d129 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:40.978381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8f21d0f6-9216-4c9f-83fa-00df9c94d129 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:41.043334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8f21d0f6-9216-4c9f-83fa-00df9c94d129 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:41.055642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8f21d0f6-9216-4c9f-83fa-00df9c94d129 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1218 microversion: 2.1 time: 0.082556 May 23 13:33:41.069668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 113/230] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:40 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:41.088539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-702fad7c-581f-47e8-bb70-ce1600813149 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:41.096311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-702fad7c-581f-47e8-bb70-ce1600813149 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.180840 May 23 13:33:41.100128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 118/231] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:40 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:42.075166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4ac7afa4-fbba-4d92-a6c5-ee7d2b5be529 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:42.075777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4ac7afa4-fbba-4d92-a6c5-ee7d2b5be529 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:42.081923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ac7afa4-fbba-4d92-a6c5-ee7d2b5be529 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:42.082376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ac7afa4-fbba-4d92-a6c5-ee7d2b5be529 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:42.083183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ac7afa4-fbba-4d92-a6c5-ee7d2b5be529 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:42.083623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ac7afa4-fbba-4d92-a6c5-ee7d2b5be529 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:42.113805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-14ccd115-ef1e-435b-bfd6-f73e1e77369a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:42.115095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-14ccd115-ef1e-435b-bfd6-f73e1e77369a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:42.123363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14ccd115-ef1e-435b-bfd6-f73e1e77369a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:42.123812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14ccd115-ef1e-435b-bfd6-f73e1e77369a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:42.124603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14ccd115-ef1e-435b-bfd6-f73e1e77369a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:42.125036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14ccd115-ef1e-435b-bfd6-f73e1e77369a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:42.144917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4ac7afa4-fbba-4d92-a6c5-ee7d2b5be529 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:42.154728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4ac7afa4-fbba-4d92-a6c5-ee7d2b5be529 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1222 microversion: 2.1 time: 0.082521 May 23 13:33:42.155459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 114/232] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:42 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:42.284537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-14ccd115-ef1e-435b-bfd6-f73e1e77369a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:42.294026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-14ccd115-ef1e-435b-bfd6-f73e1e77369a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.183825 May 23 13:33:42.294893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 119/233] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:42 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:43.172164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-93064400-8d98-49ef-b8ae-f5d4c208f0aa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:43.172928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-93064400-8d98-49ef-b8ae-f5d4c208f0aa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:43.180210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93064400-8d98-49ef-b8ae-f5d4c208f0aa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.180859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93064400-8d98-49ef-b8ae-f5d4c208f0aa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:43.181795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93064400-8d98-49ef-b8ae-f5d4c208f0aa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.182343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93064400-8d98-49ef-b8ae-f5d4c208f0aa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:43.257056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93064400-8d98-49ef-b8ae-f5d4c208f0aa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:43.265491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-93064400-8d98-49ef-b8ae-f5d4c208f0aa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1270 microversion: 2.1 time: 0.097105 May 23 13:33:43.266086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 115/234] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:43 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:43.318296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ae08c64-04e2-458f-817f-7ff6957e7158 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:43.318998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ae08c64-04e2-458f-817f-7ff6957e7158 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:43.327813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae08c64-04e2-458f-817f-7ff6957e7158 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.327813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae08c64-04e2-458f-817f-7ff6957e7158 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:43.327813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae08c64-04e2-458f-817f-7ff6957e7158 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.327813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ae08c64-04e2-458f-817f-7ff6957e7158 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:43.470459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ae08c64-04e2-458f-817f-7ff6957e7158 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:43.478436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ae08c64-04e2-458f-817f-7ff6957e7158 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1502 microversion: 2.1 time: 0.164686 May 23 13:33:43.479011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 120/235] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:43 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:43.495768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c201d55-e856-42d2-8d2a-5de3918e04c9"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:33:43.497034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:43.503301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.503803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:43.504606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.505696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Cannot 'attach_volume' instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d while it is in vm_state rescued May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: POST /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d/os-volume_attachments HTTP/1.1 May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 74 May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:33:43.537741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {"volumeAttachment": {"volumeId": "9c201d55-e856-42d2-8d2a-5de3918e04c9"}} May 23 13:33:43.539356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Cannot 'attach_volume' instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d while it is in vm_state rescued May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': 'ebc07d7d-03f3-4b89-ae8e-5b898db04e3d', 'body': {'volumeAttachment': {'volumeId': '9c201d55-e856-42d2-8d2a-5de3918e04c9'}}} May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:33:43.540381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d while it is in vm_state rescued May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:33:43.541752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:33:43.543155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:33:43.543155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:33:43.543155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d while it is in vm_state rescued May 23 13:33:43.543155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:33:43.543155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 409 to user: Cannot 'attach_volume' instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d while it is in vm_state rescued {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:33:43.543155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49ae0b94-20b7-41c3-a487-66e7c65d7740 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047027 May 23 13:33:43.543155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 116/236] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 13:33:43 2022] POST /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 13:33:43.549145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f84fd93b-4eb7-47fa-b395-fdbd999b6f34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:33:43.549684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f84fd93b-4eb7-47fa-b395-fdbd999b6f34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:43.557012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84fd93b-4eb7-47fa-b395-fdbd999b6f34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.557585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84fd93b-4eb7-47fa-b395-fdbd999b6f34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:43.558255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84fd93b-4eb7-47fa-b395-fdbd999b6f34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.558661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84fd93b-4eb7-47fa-b395-fdbd999b6f34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:43.574444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:33:43.842547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f84fd93b-4eb7-47fa-b395-fdbd999b6f34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d/action" status: 202 len: 0 microversion: 2.1 time: 0.297571 May 23 13:33:43.844997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 121/237] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:33:43 2022] POST /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:33:43.858182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f61ff73-c985-459b-8cbf-b01121843448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:43.859130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f61ff73-c985-459b-8cbf-b01121843448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:43.867461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f61ff73-c985-459b-8cbf-b01121843448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.867919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f61ff73-c985-459b-8cbf-b01121843448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:43.869440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f61ff73-c985-459b-8cbf-b01121843448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:43.869935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f61ff73-c985-459b-8cbf-b01121843448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:44.166205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f61ff73-c985-459b-8cbf-b01121843448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:44.174563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f61ff73-c985-459b-8cbf-b01121843448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1510 microversion: 2.1 time: 0.327025 May 23 13:33:44.176176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 117/238] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:43 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:44.285181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae68eea8-65eb-4b57-b1ba-9fc3ce17d741 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:44.285894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae68eea8-65eb-4b57-b1ba-9fc3ce17d741 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:44.293455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae68eea8-65eb-4b57-b1ba-9fc3ce17d741 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:44.293896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae68eea8-65eb-4b57-b1ba-9fc3ce17d741 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:44.294855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae68eea8-65eb-4b57-b1ba-9fc3ce17d741 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:44.295281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae68eea8-65eb-4b57-b1ba-9fc3ce17d741 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:44.428413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae68eea8-65eb-4b57-b1ba-9fc3ce17d741 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:44.437841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae68eea8-65eb-4b57-b1ba-9fc3ce17d741 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1288 microversion: 2.1 time: 0.157969 May 23 13:33:44.439684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 122/239] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:44 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1288 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:45.194202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0bb486c3-d6c1-41af-9630-31392c4204c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:45.194883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0bb486c3-d6c1-41af-9630-31392c4204c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:45.200998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb486c3-d6c1-41af-9630-31392c4204c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:45.207940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb486c3-d6c1-41af-9630-31392c4204c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:45.207940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb486c3-d6c1-41af-9630-31392c4204c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:45.207940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb486c3-d6c1-41af-9630-31392c4204c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:45.463451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-642df832-3c1f-45fd-a740-7cc12a54899f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:45.463968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-642df832-3c1f-45fd-a740-7cc12a54899f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:45.471149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-642df832-3c1f-45fd-a740-7cc12a54899f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:45.471596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-642df832-3c1f-45fd-a740-7cc12a54899f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:45.472366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-642df832-3c1f-45fd-a740-7cc12a54899f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:45.472984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-642df832-3c1f-45fd-a740-7cc12a54899f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:45.488541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0bb486c3-d6c1-41af-9630-31392c4204c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:45.501013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0bb486c3-d6c1-41af-9630-31392c4204c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1510 microversion: 2.1 time: 0.312327 May 23 13:33:45.510620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 118/240] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:45 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:45.628631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-642df832-3c1f-45fd-a740-7cc12a54899f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:45.636945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-642df832-3c1f-45fd-a740-7cc12a54899f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.177547 May 23 13:33:45.637491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 123/241] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:45 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:46.242930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-6a302335-9c04-43ad-9be3-bcd8f1de8529 req-b40fa5f4-b602-4056-a8ac-8c6b6f8461fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d8fc5f-0889-4ea2-942c-90bde9a763c4", "tag": "83142355-7e3c-401f-948d-197d0ec1724e"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:33:46.247822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:33:46.255438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6a302335-9c04-43ad-9be3-bcd8f1de8529 req-b40fa5f4-b602-4056-a8ac-8c6b6f8461fd service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:46.255883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6a302335-9c04-43ad-9be3-bcd8f1de8529 req-b40fa5f4-b602-4056-a8ac-8c6b6f8461fd service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:46.268141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-6a302335-9c04-43ad-9be3-bcd8f1de8529 req-b40fa5f4-b602-4056-a8ac-8c6b6f8461fd service nova] Creating event network-changed:83142355-7e3c-401f-948d-197d0ec1724e for instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 on hv-cinder-82549 May 23 13:33:46.274123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-6a302335-9c04-43ad-9be3-bcd8f1de8529 req-b40fa5f4-b602-4056-a8ac-8c6b6f8461fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035661 May 23 13:33:46.274770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 119/242] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:33:46.519272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a86389fe-dbb8-4cca-bcee-dff1fe164837 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:46.519880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a86389fe-dbb8-4cca-bcee-dff1fe164837 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:46.527242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a86389fe-dbb8-4cca-bcee-dff1fe164837 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:46.527739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a86389fe-dbb8-4cca-bcee-dff1fe164837 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:46.534332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a86389fe-dbb8-4cca-bcee-dff1fe164837 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:46.534332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a86389fe-dbb8-4cca-bcee-dff1fe164837 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:46.654652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f7fd11a-4f1a-415e-8120-96a9dd610fb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:46.655387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f7fd11a-4f1a-415e-8120-96a9dd610fb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:46.663195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7fd11a-4f1a-415e-8120-96a9dd610fb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:46.663678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7fd11a-4f1a-415e-8120-96a9dd610fb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:46.671807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7fd11a-4f1a-415e-8120-96a9dd610fb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:46.671807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7fd11a-4f1a-415e-8120-96a9dd610fb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:46.672095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a86389fe-dbb8-4cca-bcee-dff1fe164837 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:46.675198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a86389fe-dbb8-4cca-bcee-dff1fe164837 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1510 microversion: 2.1 time: 0.159857 May 23 13:33:46.675779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 124/243] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:46 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:46.800232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f7fd11a-4f1a-415e-8120-96a9dd610fb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:46.809438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f7fd11a-4f1a-415e-8120-96a9dd610fb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.158889 May 23 13:33:46.810003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 120/244] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:46 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:47.694862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-897a6b0d-d6ca-4892-883e-f789829b582c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:47.695471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-897a6b0d-d6ca-4892-883e-f789829b582c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:47.702824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-897a6b0d-d6ca-4892-883e-f789829b582c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:47.709543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-897a6b0d-d6ca-4892-883e-f789829b582c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:47.709543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-897a6b0d-d6ca-4892-883e-f789829b582c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:47.709543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-897a6b0d-d6ca-4892-883e-f789829b582c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:47.826674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eda3d079-e1f0-47e8-8c0b-aad403805b8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:47.827314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eda3d079-e1f0-47e8-8c0b-aad403805b8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:47.833634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eda3d079-e1f0-47e8-8c0b-aad403805b8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:47.834147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eda3d079-e1f0-47e8-8c0b-aad403805b8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:47.834929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eda3d079-e1f0-47e8-8c0b-aad403805b8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:47.835472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eda3d079-e1f0-47e8-8c0b-aad403805b8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:47.841643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-897a6b0d-d6ca-4892-883e-f789829b582c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:47.849560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-897a6b0d-d6ca-4892-883e-f789829b582c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1510 microversion: 2.1 time: 0.159484 May 23 13:33:47.859375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 125/245] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:47 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:47.975622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eda3d079-e1f0-47e8-8c0b-aad403805b8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:47.982889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eda3d079-e1f0-47e8-8c0b-aad403805b8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.160214 May 23 13:33:47.983468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 121/246] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:47 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:48.867551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a021b123-9412-4669-a042-a4261d985bf1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:48.868152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a021b123-9412-4669-a042-a4261d985bf1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:48.874943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a021b123-9412-4669-a042-a4261d985bf1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:48.875389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a021b123-9412-4669-a042-a4261d985bf1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:48.876155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a021b123-9412-4669-a042-a4261d985bf1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:48.876600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a021b123-9412-4669-a042-a4261d985bf1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:49.001998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0e4ea22a-108c-48ea-9508-4746b09dd1d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:49.003199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0e4ea22a-108c-48ea-9508-4746b09dd1d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:49.011763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e4ea22a-108c-48ea-9508-4746b09dd1d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:49.012218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e4ea22a-108c-48ea-9508-4746b09dd1d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:49.013244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e4ea22a-108c-48ea-9508-4746b09dd1d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:49.013688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e4ea22a-108c-48ea-9508-4746b09dd1d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:49.020114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:33:49.033174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a021b123-9412-4669-a042-a4261d985bf1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:49.064418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a021b123-9412-4669-a042-a4261d985bf1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1510 microversion: 2.1 time: 0.201154 May 23 13:33:49.065048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 126/247] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:48 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:49.229229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0e4ea22a-108c-48ea-9508-4746b09dd1d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:49.237244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0e4ea22a-108c-48ea-9508-4746b09dd1d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.239524 May 23 13:33:49.237812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 122/248] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:48 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:50.084209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-654886de-096d-4270-8b2e-353046a38ad6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:50.085126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-654886de-096d-4270-8b2e-353046a38ad6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:50.091982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-654886de-096d-4270-8b2e-353046a38ad6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:50.092634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-654886de-096d-4270-8b2e-353046a38ad6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:50.093404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-654886de-096d-4270-8b2e-353046a38ad6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:50.093829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-654886de-096d-4270-8b2e-353046a38ad6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:50.237320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-654886de-096d-4270-8b2e-353046a38ad6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:50.245669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-654886de-096d-4270-8b2e-353046a38ad6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1516 microversion: 2.1 time: 0.166902 May 23 13:33:50.246245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 127/249] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:50 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:50.257502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c0afab8e-52e9-4a94-a905-064e4d6288bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:50.258013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c0afab8e-52e9-4a94-a905-064e4d6288bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:50.260724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:33:50.271153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0afab8e-52e9-4a94-a905-064e4d6288bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:50.272151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0afab8e-52e9-4a94-a905-064e4d6288bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:50.274323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0afab8e-52e9-4a94-a905-064e4d6288bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:50.275523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0afab8e-52e9-4a94-a905-064e4d6288bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:50.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0afab8e-52e9-4a94-a905-064e4d6288bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:50.452373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c0afab8e-52e9-4a94-a905-064e4d6288bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.199835 May 23 13:33:50.452997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 123/250] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:50 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:51.472392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1f2bd4d-6c04-456a-a48c-eefbee43594f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:51.473028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1f2bd4d-6c04-456a-a48c-eefbee43594f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:51.481030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1f2bd4d-6c04-456a-a48c-eefbee43594f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:51.481522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1f2bd4d-6c04-456a-a48c-eefbee43594f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:51.482296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1f2bd4d-6c04-456a-a48c-eefbee43594f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:51.482733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1f2bd4d-6c04-456a-a48c-eefbee43594f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:51.622158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1f2bd4d-6c04-456a-a48c-eefbee43594f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:51.630477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1f2bd4d-6c04-456a-a48c-eefbee43594f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.161334 May 23 13:33:51.631680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 128/251] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:51 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:52.647901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-941bc125-74c5-40df-8018-532a0b8a7a2f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:52.648713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-941bc125-74c5-40df-8018-532a0b8a7a2f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:52.650392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:33:52.655533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-941bc125-74c5-40df-8018-532a0b8a7a2f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:52.656018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-941bc125-74c5-40df-8018-532a0b8a7a2f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:52.656842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-941bc125-74c5-40df-8018-532a0b8a7a2f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:52.657277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-941bc125-74c5-40df-8018-532a0b8a7a2f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:52.796867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-941bc125-74c5-40df-8018-532a0b8a7a2f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:52.805319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-941bc125-74c5-40df-8018-532a0b8a7a2f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.161903 May 23 13:33:52.805886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 124/252] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:52 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:53.823560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd38e655-6974-4f53-b701-ec00d75575c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:53.824228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd38e655-6974-4f53-b701-ec00d75575c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:53.830853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd38e655-6974-4f53-b701-ec00d75575c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:53.831308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd38e655-6974-4f53-b701-ec00d75575c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:53.832077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd38e655-6974-4f53-b701-ec00d75575c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:53.832506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd38e655-6974-4f53-b701-ec00d75575c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:53.969018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd38e655-6974-4f53-b701-ec00d75575c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:53.982403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd38e655-6974-4f53-b701-ec00d75575c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.162453 May 23 13:33:53.982986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 129/253] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:53 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:33:55.000118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3cc1553d-089c-4a18-9515-a55099fd6c6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:55.000751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3cc1553d-089c-4a18-9515-a55099fd6c6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:55.010079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cc1553d-089c-4a18-9515-a55099fd6c6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:55.010767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cc1553d-089c-4a18-9515-a55099fd6c6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:55.011949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cc1553d-089c-4a18-9515-a55099fd6c6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:55.012648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cc1553d-089c-4a18-9515-a55099fd6c6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:55.159854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3cc1553d-089c-4a18-9515-a55099fd6c6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:55.167429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3cc1553d-089c-4a18-9515-a55099fd6c6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.171642 May 23 13:33:55.167992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 125/254] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:54 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:56.185489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2316aee6-0eaa-400c-8bc8-eea50815bdec tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:56.186457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2316aee6-0eaa-400c-8bc8-eea50815bdec tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:56.193813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2316aee6-0eaa-400c-8bc8-eea50815bdec tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:56.194262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2316aee6-0eaa-400c-8bc8-eea50815bdec tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:56.195044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2316aee6-0eaa-400c-8bc8-eea50815bdec tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:56.195480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2316aee6-0eaa-400c-8bc8-eea50815bdec tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:56.356876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2316aee6-0eaa-400c-8bc8-eea50815bdec tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:56.365616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2316aee6-0eaa-400c-8bc8-eea50815bdec tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.185154 May 23 13:33:56.366192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 130/255] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:56 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:57.382388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5f307146-c091-43a1-9390-81da6bcc18ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:57.382993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5f307146-c091-43a1-9390-81da6bcc18ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:57.389076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f307146-c091-43a1-9390-81da6bcc18ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:57.389518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f307146-c091-43a1-9390-81da6bcc18ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:57.390269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f307146-c091-43a1-9390-81da6bcc18ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:57.390696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f307146-c091-43a1-9390-81da6bcc18ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:57.519699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5f307146-c091-43a1-9390-81da6bcc18ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:57.528274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5f307146-c091-43a1-9390-81da6bcc18ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.149786 May 23 13:33:57.528881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 126/256] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:57 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:58.545784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-48c53fcf-0f7e-470b-8e0d-4f100fac5e67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:58.546292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-48c53fcf-0f7e-470b-8e0d-4f100fac5e67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:58.553655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48c53fcf-0f7e-470b-8e0d-4f100fac5e67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:58.554111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48c53fcf-0f7e-470b-8e0d-4f100fac5e67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:58.554872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48c53fcf-0f7e-470b-8e0d-4f100fac5e67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:58.555314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48c53fcf-0f7e-470b-8e0d-4f100fac5e67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:58.687522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-48c53fcf-0f7e-470b-8e0d-4f100fac5e67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:58.695877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-48c53fcf-0f7e-470b-8e0d-4f100fac5e67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.153969 May 23 13:33:58.696455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 131/257] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:58 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:33:59.713667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a74cb218-8206-4e8d-b7c8-510202bf6d6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:33:59.714224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a74cb218-8206-4e8d-b7c8-510202bf6d6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:33:59.721114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a74cb218-8206-4e8d-b7c8-510202bf6d6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:59.721669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a74cb218-8206-4e8d-b7c8-510202bf6d6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:59.722526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a74cb218-8206-4e8d-b7c8-510202bf6d6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:33:59.723053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a74cb218-8206-4e8d-b7c8-510202bf6d6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:33:59.861414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a74cb218-8206-4e8d-b7c8-510202bf6d6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:33:59.870156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a74cb218-8206-4e8d-b7c8-510202bf6d6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.160356 May 23 13:33:59.870735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 127/258] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:33:59 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:00.077792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-94981d3a-118c-4af1-8fc2-0d35fe912bce req-e45c95aa-dd42-4377-81af-9343be7a83f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d8fc5f-0889-4ea2-942c-90bde9a763c4", "name": "network-vif-plugged", "status": "completed", "tag": "83142355-7e3c-401f-948d-197d0ec1724e"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:00.083015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=42 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:00.087895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-94981d3a-118c-4af1-8fc2-0d35fe912bce req-e45c95aa-dd42-4377-81af-9343be7a83f1 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:00.088343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-94981d3a-118c-4af1-8fc2-0d35fe912bce req-e45c95aa-dd42-4377-81af-9343be7a83f1 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:00.107455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-94981d3a-118c-4af1-8fc2-0d35fe912bce req-e45c95aa-dd42-4377-81af-9343be7a83f1 service nova] Creating event network-vif-plugged:83142355-7e3c-401f-948d-197d0ec1724e for instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 on hv-cinder-82549 May 23 13:34:00.115766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-94981d3a-118c-4af1-8fc2-0d35fe912bce req-e45c95aa-dd42-4377-81af-9343be7a83f1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041625 May 23 13:34:00.116432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 132/259] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:34:00.530242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce4d19a3-ba08-4376-a7b2-523f9547da6f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'create', calling method: .version_select at 0x7effb208b430>, body: {"keypair": {"name": "tempest-keypair-164593863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLf6YLZIyKMQw+7JrOs6GIiY0K+u/nYG81t9w24eII1lDiZG0nEsR4CEMvMmOVTie1AnmCeZpzEY+JjuQZHEnsOhxsCikOxF79aBoEjTzl1Ri569UIx7psfeO47R3XGHJw=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:00.553032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-ce4d19a3-ba08-4376-a7b2-523f9547da6f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Getting quotas for project c4fb50a6ddee45278948b5fed215597b. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:34:00.557972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-ce4d19a3-ba08-4376-a7b2-523f9547da6f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Getting quotas for user af29f227080147a1a157f88842d39483 and project c4fb50a6ddee45278948b5fed215597b. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:34:00.711536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce4d19a3-ba08-4376-a7b2-523f9547da6f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185856 May 23 13:34:00.712214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 128/260] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 13:34:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:34:00.889332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4981f93-b9c5-4144-b7b9-a39d1a9062b2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:00.890130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a4981f93-b9c5-4144-b7b9-a39d1a9062b2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:00.898081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4981f93-b9c5-4144-b7b9-a39d1a9062b2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:00.898607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4981f93-b9c5-4144-b7b9-a39d1a9062b2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:00.899548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4981f93-b9c5-4144-b7b9-a39d1a9062b2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:00.900134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4981f93-b9c5-4144-b7b9-a39d1a9062b2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:01.043466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a4981f93-b9c5-4144-b7b9-a39d1a9062b2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:01.052936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4981f93-b9c5-4144-b7b9-a39d1a9062b2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.168148 May 23 13:34:01.053273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 133/261] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:00 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:02.069847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6c585ecd-c019-4bb7-b6a9-22e628a146ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:02.070498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6c585ecd-c019-4bb7-b6a9-22e628a146ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:02.088605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c585ecd-c019-4bb7-b6a9-22e628a146ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:02.089069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c585ecd-c019-4bb7-b6a9-22e628a146ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:02.093467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c585ecd-c019-4bb7-b6a9-22e628a146ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:02.093924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c585ecd-c019-4bb7-b6a9-22e628a146ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:02.322974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c585ecd-c019-4bb7-b6a9-22e628a146ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:02.330529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6c585ecd-c019-4bb7-b6a9-22e628a146ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.264758 May 23 13:34:02.331105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 129/262] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:02 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:03.352018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-677f7474-72dd-4c03-81ce-6151e1dd4334 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:03.352664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-677f7474-72dd-4c03-81ce-6151e1dd4334 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:03.355748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1905359049", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "861d496f-1a1a-40b6-9eb0-bf781ce919c3"}], "security_groups": [{"name": "tempest-securitygroup--1047815840"}], "key_name": "tempest-keypair-164593863", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:03.359268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-677f7474-72dd-4c03-81ce-6151e1dd4334 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:03.359922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-677f7474-72dd-4c03-81ce-6151e1dd4334 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:03.360737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-677f7474-72dd-4c03-81ce-6151e1dd4334 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:03.361263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-677f7474-72dd-4c03-81ce-6151e1dd4334 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:03.484703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] validate_networks() for [('861d496f-1a1a-40b6-9eb0-bf781ce919c3', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:34:03.508558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-677f7474-72dd-4c03-81ce-6151e1dd4334 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:03.523720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-677f7474-72dd-4c03-81ce-6151e1dd4334 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.177213 May 23 13:34:03.524931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 134/263] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:03 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:04.128692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:34:04.129120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:34:04.129647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:34:04.130054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:34:04.130464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:34:04.140237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:04.140731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:04.141516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:04.141944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:04.160088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Getting quotas for project c4fb50a6ddee45278948b5fed215597b. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:34:04.168791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Getting quotas for user af29f227080147a1a157f88842d39483 and project c4fb50a6ddee45278948b5fed215597b. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:34:04.181877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:34:04.184282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:34:04.352127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-28d001b4-d9e5-4e4b-a703-788d5cc72f64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.000708 May 23 13:34:04.353106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 130/264] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:34:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 13:34:04.363286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9985650c-bcef-4bca-ad15-31cc43f5beb5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:04.364504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9985650c-bcef-4bca-ad15-31cc43f5beb5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:04.437230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9985650c-bcef-4bca-ad15-31cc43f5beb5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:04.444059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9985650c-bcef-4bca-ad15-31cc43f5beb5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1245 microversion: 2.1 time: 0.084830 May 23 13:34:04.444684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 135/265] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:04.541930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cad42566-4947-4ae3-933f-6ab874831922 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:04.542672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cad42566-4947-4ae3-933f-6ab874831922 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:04.556746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cad42566-4947-4ae3-933f-6ab874831922 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:04.557193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cad42566-4947-4ae3-933f-6ab874831922 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:04.557969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cad42566-4947-4ae3-933f-6ab874831922 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:04.563231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cad42566-4947-4ae3-933f-6ab874831922 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:04.719062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cad42566-4947-4ae3-933f-6ab874831922 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:04.731355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cad42566-4947-4ae3-933f-6ab874831922 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1318 microversion: 2.1 time: 0.192719 May 23 13:34:04.731965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 131/266] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:04 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:05.461309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-50a61989-7505-4885-ac41-24b873d725d3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:05.461930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-50a61989-7505-4885-ac41-24b873d725d3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:05.516465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-50a61989-7505-4885-ac41-24b873d725d3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:05.524434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-50a61989-7505-4885-ac41-24b873d725d3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1245 microversion: 2.1 time: 0.067728 May 23 13:34:05.525047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 136/267] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:05.749495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4dc06e54-5f6b-4a0f-9e8d-47033c3b6926 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:05.750138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4dc06e54-5f6b-4a0f-9e8d-47033c3b6926 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:05.757216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4dc06e54-5f6b-4a0f-9e8d-47033c3b6926 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:05.757667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4dc06e54-5f6b-4a0f-9e8d-47033c3b6926 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:05.758429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4dc06e54-5f6b-4a0f-9e8d-47033c3b6926 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:05.758864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4dc06e54-5f6b-4a0f-9e8d-47033c3b6926 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:05.896169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4dc06e54-5f6b-4a0f-9e8d-47033c3b6926 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:05.903911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4dc06e54-5f6b-4a0f-9e8d-47033c3b6926 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1507 microversion: 2.1 time: 0.158279 May 23 13:34:05.904609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 132/268] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:05 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:06.542348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a1ed78dd-a964-40f9-857d-9c7ebd0b9b84 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:06.542950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a1ed78dd-a964-40f9-857d-9c7ebd0b9b84 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:06.549579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1ed78dd-a964-40f9-857d-9c7ebd0b9b84 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:06.554149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1ed78dd-a964-40f9-857d-9c7ebd0b9b84 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:06.554149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1ed78dd-a964-40f9-857d-9c7ebd0b9b84 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:06.554149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1ed78dd-a964-40f9-857d-9c7ebd0b9b84 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:06.618729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a1ed78dd-a964-40f9-857d-9c7ebd0b9b84 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:06.626327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a1ed78dd-a964-40f9-857d-9c7ebd0b9b84 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1249 microversion: 2.1 time: 0.087813 May 23 13:34:06.628597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 137/269] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:07.643509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-182fff3d-681e-4975-ae94-ddbb3ca53c90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:07.644123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-182fff3d-681e-4975-ae94-ddbb3ca53c90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:07.655530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-182fff3d-681e-4975-ae94-ddbb3ca53c90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:07.656619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-182fff3d-681e-4975-ae94-ddbb3ca53c90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:07.657731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-182fff3d-681e-4975-ae94-ddbb3ca53c90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:07.658426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-182fff3d-681e-4975-ae94-ddbb3ca53c90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:07.730230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-182fff3d-681e-4975-ae94-ddbb3ca53c90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:07.737908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-182fff3d-681e-4975-ae94-ddbb3ca53c90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1241 microversion: 2.1 time: 0.098210 May 23 13:34:07.738492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 133/270] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:08.755520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8f6e061-9b76-4e11-8c8f-10a7bebf4075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:08.756227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8f6e061-9b76-4e11-8c8f-10a7bebf4075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:08.763047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8f6e061-9b76-4e11-8c8f-10a7bebf4075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:08.763497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8f6e061-9b76-4e11-8c8f-10a7bebf4075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:08.764268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8f6e061-9b76-4e11-8c8f-10a7bebf4075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:08.764753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8f6e061-9b76-4e11-8c8f-10a7bebf4075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:08.841171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8f6e061-9b76-4e11-8c8f-10a7bebf4075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:08.876675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8f6e061-9b76-4e11-8c8f-10a7bebf4075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1297 microversion: 2.1 time: 0.124917 May 23 13:34:08.877960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 138/271] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1297 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:09.894224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0074b0f7-1d9d-4d5b-910d-8b5302df600c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:09.894962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0074b0f7-1d9d-4d5b-910d-8b5302df600c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:09.904137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0074b0f7-1d9d-4d5b-910d-8b5302df600c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:09.904656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0074b0f7-1d9d-4d5b-910d-8b5302df600c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:09.906504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0074b0f7-1d9d-4d5b-910d-8b5302df600c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:09.907055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0074b0f7-1d9d-4d5b-910d-8b5302df600c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:10.006075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0074b0f7-1d9d-4d5b-910d-8b5302df600c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:10.014880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0074b0f7-1d9d-4d5b-910d-8b5302df600c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1303 microversion: 2.1 time: 0.124387 May 23 13:34:10.015629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 134/272] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:11.034440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7165f1c4-4672-42e1-b3e3-ab9f7b3c2467 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:11.035301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7165f1c4-4672-42e1-b3e3-ab9f7b3c2467 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:11.043149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7165f1c4-4672-42e1-b3e3-ab9f7b3c2467 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:11.043690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7165f1c4-4672-42e1-b3e3-ab9f7b3c2467 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:11.044517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7165f1c4-4672-42e1-b3e3-ab9f7b3c2467 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:11.045047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7165f1c4-4672-42e1-b3e3-ab9f7b3c2467 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:11.227533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7165f1c4-4672-42e1-b3e3-ab9f7b3c2467 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:11.230162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:11.235962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7165f1c4-4672-42e1-b3e3-ab9f7b3c2467 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.205554 May 23 13:34:11.236560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 139/273] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:11.776721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-98561e25-50a2-4381-baca-61516aca5662 req-e28a3dc8-b012-46a2-b867-dda1794a1e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea1331e-b180-41c8-910a-04b7cff4a9f7", "tag": "b04be98e-e124-43f9-b990-a67a4ab0ea9f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:11.796430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-98561e25-50a2-4381-baca-61516aca5662 req-e28a3dc8-b012-46a2-b867-dda1794a1e78 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:11.797181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-98561e25-50a2-4381-baca-61516aca5662 req-e28a3dc8-b012-46a2-b867-dda1794a1e78 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:11.818107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-98561e25-50a2-4381-baca-61516aca5662 req-e28a3dc8-b012-46a2-b867-dda1794a1e78 service nova] Creating event network-changed:b04be98e-e124-43f9-b990-a67a4ab0ea9f for instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 on hv-cinder-82549 May 23 13:34:11.823660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-98561e25-50a2-4381-baca-61516aca5662 req-e28a3dc8-b012-46a2-b867-dda1794a1e78 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053725 May 23 13:34:11.824365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 135/274] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:34:12.253423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e4ee124-3105-44fc-a13a-db49d5ee071a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:12.254030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e4ee124-3105-44fc-a13a-db49d5ee071a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:12.261770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e4ee124-3105-44fc-a13a-db49d5ee071a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:12.262170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e4ee124-3105-44fc-a13a-db49d5ee071a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:12.262941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e4ee124-3105-44fc-a13a-db49d5ee071a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:12.263410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e4ee124-3105-44fc-a13a-db49d5ee071a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:12.403811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e4ee124-3105-44fc-a13a-db49d5ee071a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:12.411472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e4ee124-3105-44fc-a13a-db49d5ee071a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.162102 May 23 13:34:12.412053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 140/275] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:13.429255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-28317ca6-7641-423e-b5e2-768ed8c47f5e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:13.430032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-28317ca6-7641-423e-b5e2-768ed8c47f5e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:13.436747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28317ca6-7641-423e-b5e2-768ed8c47f5e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:13.437351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28317ca6-7641-423e-b5e2-768ed8c47f5e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:13.438189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28317ca6-7641-423e-b5e2-768ed8c47f5e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:13.438817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28317ca6-7641-423e-b5e2-768ed8c47f5e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:13.639821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-28317ca6-7641-423e-b5e2-768ed8c47f5e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:13.647913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-28317ca6-7641-423e-b5e2-768ed8c47f5e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.223283 May 23 13:34:13.648474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 136/276] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:14.666797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2402c20-e416-4b78-97a4-30442882a970 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:14.667502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2402c20-e416-4b78-97a4-30442882a970 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:14.674599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2402c20-e416-4b78-97a4-30442882a970 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:14.676225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2402c20-e416-4b78-97a4-30442882a970 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:14.676225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2402c20-e416-4b78-97a4-30442882a970 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:14.677036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2402c20-e416-4b78-97a4-30442882a970 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:14.817313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2402c20-e416-4b78-97a4-30442882a970 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:14.826418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2402c20-e416-4b78-97a4-30442882a970 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.165364 May 23 13:34:14.827005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 141/277] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:15.843714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-75deb075-76b3-4445-8d48-7a960bc3a34b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:15.844339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-75deb075-76b3-4445-8d48-7a960bc3a34b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:15.846865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:15.847571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:15.854277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75deb075-76b3-4445-8d48-7a960bc3a34b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:15.854726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75deb075-76b3-4445-8d48-7a960bc3a34b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:15.855980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75deb075-76b3-4445-8d48-7a960bc3a34b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:15.855980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-75deb075-76b3-4445-8d48-7a960bc3a34b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:16.262205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-75deb075-76b3-4445-8d48-7a960bc3a34b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:16.270361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-75deb075-76b3-4445-8d48-7a960bc3a34b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.430419 May 23 13:34:16.271013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 137/278] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:17.228504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-789309075", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "networks": [{"uuid": "16dd73e1-be62-4f22-b4c3-00ead026b19d"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:17.235037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:17.289304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca62629b-2bb2-40d0-8842-9a4a528f99d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:17.289744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] validate_networks() for [('16dd73e1-be62-4f22-b4c3-00ead026b19d', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:34:17.289838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ca62629b-2bb2-40d0-8842-9a4a528f99d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:17.291208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:17.296731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca62629b-2bb2-40d0-8842-9a4a528f99d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:17.297311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca62629b-2bb2-40d0-8842-9a4a528f99d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:17.298336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca62629b-2bb2-40d0-8842-9a4a528f99d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:17.298813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca62629b-2bb2-40d0-8842-9a4a528f99d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:17.501088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ca62629b-2bb2-40d0-8842-9a4a528f99d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:17.516915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ca62629b-2bb2-40d0-8842-9a4a528f99d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.233394 May 23 13:34:17.526756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 138/279] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:17.693652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:34:17.694085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:34:17.694611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:34:17.694956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:34:17.695367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:34:17.705738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:17.706185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:17.715237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:17.715237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:17.732838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Getting quotas for project b3808ebec9df4a4c937ab961f3683dda. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:34:17.737539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Getting quotas for user 740cc82ff2c04228b8ba32ecc034944f and project b3808ebec9df4a4c937ab961f3683dda. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:34:17.750628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:34:17.753238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:34:17.945560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2cf1032e-6fc3-41cc-8023-5fe11ff6dc21 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720732 May 23 13:34:17.951996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 142/280] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 13:34:17.958498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e76d095b-e7aa-46f0-ad73-b42f8a4b682d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:17.963378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e76d095b-e7aa-46f0-ad73-b42f8a4b682d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:18.075026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e76d095b-e7aa-46f0-ad73-b42f8a4b682d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:18.084091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e76d095b-e7aa-46f0-ad73-b42f8a4b682d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1213 microversion: 2.1 time: 0.130444 May 23 13:34:18.085270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 139/281] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:17 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1213 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:18.535464 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ac60584-ca4b-4f47-b9b0-0aaa55c71b78 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:18.536411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ac60584-ca4b-4f47-b9b0-0aaa55c71b78 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:18.542860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ac60584-ca4b-4f47-b9b0-0aaa55c71b78 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:18.543309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ac60584-ca4b-4f47-b9b0-0aaa55c71b78 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:18.544139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ac60584-ca4b-4f47-b9b0-0aaa55c71b78 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:18.544626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ac60584-ca4b-4f47-b9b0-0aaa55c71b78 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:18.777308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9ac60584-ca4b-4f47-b9b0-0aaa55c71b78 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:18.787205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ac60584-ca4b-4f47-b9b0-0aaa55c71b78 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.256143 May 23 13:34:18.788468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 143/282] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:19.103297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e6a93749-4759-43af-ad39-b3e04d019844 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:19.104471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e6a93749-4759-43af-ad39-b3e04d019844 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:19.195422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6a93749-4759-43af-ad39-b3e04d019844 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:19.204399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e6a93749-4759-43af-ad39-b3e04d019844 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1213 microversion: 2.1 time: 0.106172 May 23 13:34:19.205418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 140/283] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:19 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:19.813614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-40d369e0-df17-40b7-8a8d-eabd96e79128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:19.814754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-40d369e0-df17-40b7-8a8d-eabd96e79128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:19.825889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40d369e0-df17-40b7-8a8d-eabd96e79128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:19.826803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40d369e0-df17-40b7-8a8d-eabd96e79128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:19.828018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40d369e0-df17-40b7-8a8d-eabd96e79128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:19.829132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40d369e0-df17-40b7-8a8d-eabd96e79128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:20.022982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40d369e0-df17-40b7-8a8d-eabd96e79128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:20.033575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-40d369e0-df17-40b7-8a8d-eabd96e79128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.226203 May 23 13:34:20.034304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 144/284] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:20.227968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f205b68-6e47-4190-99cc-1e347ce6ae08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:20.229172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f205b68-6e47-4190-99cc-1e347ce6ae08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:20.239645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f205b68-6e47-4190-99cc-1e347ce6ae08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:20.240299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f205b68-6e47-4190-99cc-1e347ce6ae08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:20.241143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f205b68-6e47-4190-99cc-1e347ce6ae08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:20.241573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f205b68-6e47-4190-99cc-1e347ce6ae08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:20.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f205b68-6e47-4190-99cc-1e347ce6ae08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:20.321095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f205b68-6e47-4190-99cc-1e347ce6ae08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1217 microversion: 2.1 time: 0.100608 May 23 13:34:20.321869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 141/285] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:20 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:21.053185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b41cc3c4-f58e-4393-af8b-6c9a1ffa16ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:21.054568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b41cc3c4-f58e-4393-af8b-6c9a1ffa16ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:21.061659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b41cc3c4-f58e-4393-af8b-6c9a1ffa16ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:21.062148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b41cc3c4-f58e-4393-af8b-6c9a1ffa16ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:21.063047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b41cc3c4-f58e-4393-af8b-6c9a1ffa16ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:21.063480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b41cc3c4-f58e-4393-af8b-6c9a1ffa16ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:21.234777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b41cc3c4-f58e-4393-af8b-6c9a1ffa16ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:21.244220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b41cc3c4-f58e-4393-af8b-6c9a1ffa16ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.196177 May 23 13:34:21.245604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 145/286] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:21.339609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15b20df2-6f25-49b4-971b-8b66a470f906 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:21.340233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15b20df2-6f25-49b4-971b-8b66a470f906 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:21.353570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15b20df2-6f25-49b4-971b-8b66a470f906 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:21.354337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15b20df2-6f25-49b4-971b-8b66a470f906 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:21.354815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15b20df2-6f25-49b4-971b-8b66a470f906 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:21.355248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15b20df2-6f25-49b4-971b-8b66a470f906 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:21.359038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=93 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:21.438555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15b20df2-6f25-49b4-971b-8b66a470f906 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:21.447420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15b20df2-6f25-49b4-971b-8b66a470f906 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1265 microversion: 2.1 time: 0.112625 May 23 13:34:21.448006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 142/287] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:21 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:22.263239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9b8c07ad-acad-47cf-8f72-5ca88fa19d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:22.264250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9b8c07ad-acad-47cf-8f72-5ca88fa19d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:22.281937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b8c07ad-acad-47cf-8f72-5ca88fa19d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:22.283799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b8c07ad-acad-47cf-8f72-5ca88fa19d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:22.284841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b8c07ad-acad-47cf-8f72-5ca88fa19d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:22.286097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b8c07ad-acad-47cf-8f72-5ca88fa19d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:22.467644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef1665c9-4d50-4d4e-878c-97624cbc662f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:22.469300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef1665c9-4d50-4d4e-878c-97624cbc662f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:22.482326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef1665c9-4d50-4d4e-878c-97624cbc662f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:22.486744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef1665c9-4d50-4d4e-878c-97624cbc662f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:22.492379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef1665c9-4d50-4d4e-878c-97624cbc662f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:22.492379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef1665c9-4d50-4d4e-878c-97624cbc662f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:22.532839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b8c07ad-acad-47cf-8f72-5ca88fa19d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:22.540432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9b8c07ad-acad-47cf-8f72-5ca88fa19d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.281065 May 23 13:34:22.545693 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 146/288] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:22.662599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef1665c9-4d50-4d4e-878c-97624cbc662f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:22.677172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef1665c9-4d50-4d4e-878c-97624cbc662f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1271 microversion: 2.1 time: 0.213494 May 23 13:34:22.680096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 143/289] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:22 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:23.563013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f0b2ea04-c132-4990-8cf6-7cf240976ff7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:23.563691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f0b2ea04-c132-4990-8cf6-7cf240976ff7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:23.570866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0b2ea04-c132-4990-8cf6-7cf240976ff7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:23.571429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0b2ea04-c132-4990-8cf6-7cf240976ff7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:23.572265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0b2ea04-c132-4990-8cf6-7cf240976ff7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:23.572793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0b2ea04-c132-4990-8cf6-7cf240976ff7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:23.698612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-436daf5d-f33d-464a-b21c-e15aea187957 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:23.700417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-436daf5d-f33d-464a-b21c-e15aea187957 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:23.710558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-436daf5d-f33d-464a-b21c-e15aea187957 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:23.712017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-436daf5d-f33d-464a-b21c-e15aea187957 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:23.713225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-436daf5d-f33d-464a-b21c-e15aea187957 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:23.713838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-436daf5d-f33d-464a-b21c-e15aea187957 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:23.834689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f0b2ea04-c132-4990-8cf6-7cf240976ff7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:23.845383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f0b2ea04-c132-4990-8cf6-7cf240976ff7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.285858 May 23 13:34:23.856727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 147/290] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:24.136899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-436daf5d-f33d-464a-b21c-e15aea187957 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:24.146681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-436daf5d-f33d-464a-b21c-e15aea187957 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.451913 May 23 13:34:24.147530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 144/291] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:23 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:24.359251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-c48a2272-c509-4c51-aec8-29c2cbe19edb req-a8cb46f1-e29e-4d2f-8d98-ddc0a3359114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea1331e-b180-41c8-910a-04b7cff4a9f7", "name": "network-vif-plugged", "status": "completed", "tag": "b04be98e-e124-43f9-b990-a67a4ab0ea9f"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:24.371142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c48a2272-c509-4c51-aec8-29c2cbe19edb req-a8cb46f1-e29e-4d2f-8d98-ddc0a3359114 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:24.372277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c48a2272-c509-4c51-aec8-29c2cbe19edb req-a8cb46f1-e29e-4d2f-8d98-ddc0a3359114 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:24.394436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-c48a2272-c509-4c51-aec8-29c2cbe19edb req-a8cb46f1-e29e-4d2f-8d98-ddc0a3359114 service nova] Creating event network-vif-plugged:b04be98e-e124-43f9-b990-a67a4ab0ea9f for instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 on hv-cinder-82549 May 23 13:34:24.404246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-c48a2272-c509-4c51-aec8-29c2cbe19edb req-a8cb46f1-e29e-4d2f-8d98-ddc0a3359114 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049857 May 23 13:34:24.405477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 148/292] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:34:24.863288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-610ebf3b-4e38-4977-8d51-f4b77e49bbe1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:24.864317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-610ebf3b-4e38-4977-8d51-f4b77e49bbe1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:24.871085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-610ebf3b-4e38-4977-8d51-f4b77e49bbe1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:24.871805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-610ebf3b-4e38-4977-8d51-f4b77e49bbe1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:24.872853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-610ebf3b-4e38-4977-8d51-f4b77e49bbe1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:24.873450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-610ebf3b-4e38-4977-8d51-f4b77e49bbe1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:24.985960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-a051fa18-a718-4860-8230-ec99ec0d68e9 req-06dd6383-87a7-4f8d-bda7-9d80875da806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "672eec27-241e-4b3b-addd-591dfe9185b4", "tag": "36781652-25bc-45c7-b441-25327d6fe79f"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:25.038209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a051fa18-a718-4860-8230-ec99ec0d68e9 req-06dd6383-87a7-4f8d-bda7-9d80875da806 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:25.038673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a051fa18-a718-4860-8230-ec99ec0d68e9 req-06dd6383-87a7-4f8d-bda7-9d80875da806 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:25.072224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-a051fa18-a718-4860-8230-ec99ec0d68e9 req-06dd6383-87a7-4f8d-bda7-9d80875da806 service nova] Creating event network-changed:36781652-25bc-45c7-b441-25327d6fe79f for instance 672eec27-241e-4b3b-addd-591dfe9185b4 on hv-cinder-82549 May 23 13:34:25.088934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-a051fa18-a718-4860-8230-ec99ec0d68e9 req-06dd6383-87a7-4f8d-bda7-9d80875da806 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108624 May 23 13:34:25.098263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 149/293] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:34:25.164832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca87904a-3756-4720-a01e-9ef019a83481 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:25.165544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ca87904a-3756-4720-a01e-9ef019a83481 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:25.183922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca87904a-3756-4720-a01e-9ef019a83481 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:25.184999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca87904a-3756-4720-a01e-9ef019a83481 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:25.186088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca87904a-3756-4720-a01e-9ef019a83481 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:25.186693 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca87904a-3756-4720-a01e-9ef019a83481 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:25.272087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-610ebf3b-4e38-4977-8d51-f4b77e49bbe1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:25.281635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-610ebf3b-4e38-4977-8d51-f4b77e49bbe1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.422820 May 23 13:34:25.299447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 145/294] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:25.401542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ca87904a-3756-4720-a01e-9ef019a83481 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:25.429049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ca87904a-3756-4720-a01e-9ef019a83481 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.269048 May 23 13:34:25.434600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 150/295] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:25 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:26.299091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc5af982-3dd9-4699-ac2a-5d955ad3f57e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:26.300413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc5af982-3dd9-4699-ac2a-5d955ad3f57e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:26.307530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc5af982-3dd9-4699-ac2a-5d955ad3f57e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:26.308087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc5af982-3dd9-4699-ac2a-5d955ad3f57e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:26.309042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc5af982-3dd9-4699-ac2a-5d955ad3f57e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:26.309547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc5af982-3dd9-4699-ac2a-5d955ad3f57e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:26.448853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1676eeb-9ad9-4d43-adde-cfef57210a57 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:26.458777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1676eeb-9ad9-4d43-adde-cfef57210a57 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:26.487904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1676eeb-9ad9-4d43-adde-cfef57210a57 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:26.487904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1676eeb-9ad9-4d43-adde-cfef57210a57 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:26.487904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1676eeb-9ad9-4d43-adde-cfef57210a57 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:26.487904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1676eeb-9ad9-4d43-adde-cfef57210a57 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:26.691444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1676eeb-9ad9-4d43-adde-cfef57210a57 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:26.701169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1676eeb-9ad9-4d43-adde-cfef57210a57 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.257163 May 23 13:34:26.701845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 151/296] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:26 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:26.984532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc5af982-3dd9-4699-ac2a-5d955ad3f57e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:26.999697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc5af982-3dd9-4699-ac2a-5d955ad3f57e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1371 microversion: 2.1 time: 0.704269 May 23 13:34:27.001010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 146/297] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1371 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:27.719343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2845ff8e-70fd-40fc-afea-e4a1c6fb539d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:27.721149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2845ff8e-70fd-40fc-afea-e4a1c6fb539d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:27.728552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:27.730507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2845ff8e-70fd-40fc-afea-e4a1c6fb539d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:27.731174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2845ff8e-70fd-40fc-afea-e4a1c6fb539d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:27.732170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2845ff8e-70fd-40fc-afea-e4a1c6fb539d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:27.732865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2845ff8e-70fd-40fc-afea-e4a1c6fb539d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:27.751332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:27.988620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2845ff8e-70fd-40fc-afea-e4a1c6fb539d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:28.004675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2845ff8e-70fd-40fc-afea-e4a1c6fb539d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.288271 May 23 13:34:28.007405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 152/298] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:27 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:28.017913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-25e76574-4959-48ce-b6a5-99a2c055639d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:28.018641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-25e76574-4959-48ce-b6a5-99a2c055639d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:28.028149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25e76574-4959-48ce-b6a5-99a2c055639d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:28.031737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25e76574-4959-48ce-b6a5-99a2c055639d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:28.032833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25e76574-4959-48ce-b6a5-99a2c055639d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:28.033647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25e76574-4959-48ce-b6a5-99a2c055639d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:28.373227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-25e76574-4959-48ce-b6a5-99a2c055639d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:28.383183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-25e76574-4959-48ce-b6a5-99a2c055639d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1566 microversion: 2.1 time: 0.369169 May 23 13:34:28.384242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 147/299] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1566 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:28.402809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d99d089-9230-4078-a0e1-75105df85e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:28.403316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d99d089-9230-4078-a0e1-75105df85e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:28.409923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d99d089-9230-4078-a0e1-75105df85e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:28.410487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d99d089-9230-4078-a0e1-75105df85e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:28.411724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d99d089-9230-4078-a0e1-75105df85e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:28.412180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d99d089-9230-4078-a0e1-75105df85e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:28.568504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d99d089-9230-4078-a0e1-75105df85e90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168651 May 23 13:34:28.569713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 153/300] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 23 13:34:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:34:29.025792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8863f845-f1fb-425f-85bd-984b4fe02892 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:29.026417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8863f845-f1fb-425f-85bd-984b4fe02892 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:29.042274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8863f845-f1fb-425f-85bd-984b4fe02892 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:29.045367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8863f845-f1fb-425f-85bd-984b4fe02892 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:29.046439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8863f845-f1fb-425f-85bd-984b4fe02892 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:29.047029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8863f845-f1fb-425f-85bd-984b4fe02892 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:29.200439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:29.616264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8863f845-f1fb-425f-85bd-984b4fe02892 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:29.628957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8863f845-f1fb-425f-85bd-984b4fe02892 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.609446 May 23 13:34:29.638551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 148/301] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:29 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:30.650265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8fce322a-fbb5-4a78-9ab1-ed83e437aeb5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:30.651503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8fce322a-fbb5-4a78-9ab1-ed83e437aeb5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:30.659492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fce322a-fbb5-4a78-9ab1-ed83e437aeb5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:30.660378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fce322a-fbb5-4a78-9ab1-ed83e437aeb5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:30.661983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fce322a-fbb5-4a78-9ab1-ed83e437aeb5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:30.662630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fce322a-fbb5-4a78-9ab1-ed83e437aeb5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:30.822525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8fce322a-fbb5-4a78-9ab1-ed83e437aeb5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:30.833602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8fce322a-fbb5-4a78-9ab1-ed83e437aeb5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.189152 May 23 13:34:30.845833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 154/302] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:30 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:30.930897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-bee77f21-014f-4303-bc4c-7031d2565d0c req-af4640b9-c821-4840-96ea-03653d18a556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea1331e-b180-41c8-910a-04b7cff4a9f7", "tag": "b04be98e-e124-43f9-b990-a67a4ab0ea9f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:30.945302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-bee77f21-014f-4303-bc4c-7031d2565d0c req-af4640b9-c821-4840-96ea-03653d18a556 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:30.948140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-bee77f21-014f-4303-bc4c-7031d2565d0c req-af4640b9-c821-4840-96ea-03653d18a556 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:30.972247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-bee77f21-014f-4303-bc4c-7031d2565d0c req-af4640b9-c821-4840-96ea-03653d18a556 service nova] Creating event network-changed:b04be98e-e124-43f9-b990-a67a4ab0ea9f for instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 on hv-cinder-82549 May 23 13:34:30.991412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-bee77f21-014f-4303-bc4c-7031d2565d0c req-af4640b9-c821-4840-96ea-03653d18a556 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064460 May 23 13:34:30.994917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 149/303] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:34:31.862532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52f8dc7b-29c7-4201-b2da-f2d4f9e92f2a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:31.863929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-52f8dc7b-29c7-4201-b2da-f2d4f9e92f2a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:31.876597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:31.881034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52f8dc7b-29c7-4201-b2da-f2d4f9e92f2a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:31.881512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52f8dc7b-29c7-4201-b2da-f2d4f9e92f2a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:31.882311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52f8dc7b-29c7-4201-b2da-f2d4f9e92f2a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:31.882753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52f8dc7b-29c7-4201-b2da-f2d4f9e92f2a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:32.121289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52f8dc7b-29c7-4201-b2da-f2d4f9e92f2a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:32.129254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-52f8dc7b-29c7-4201-b2da-f2d4f9e92f2a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.271402 May 23 13:34:32.139567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 155/304] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:31 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:33.149757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37493945-463b-4ffa-ab7a-ee40a8d1e561 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:33.150488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37493945-463b-4ffa-ab7a-ee40a8d1e561 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:33.162897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37493945-463b-4ffa-ab7a-ee40a8d1e561 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:33.165874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37493945-463b-4ffa-ab7a-ee40a8d1e561 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:33.166755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37493945-463b-4ffa-ab7a-ee40a8d1e561 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:33.167218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37493945-463b-4ffa-ab7a-ee40a8d1e561 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:34.372556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37493945-463b-4ffa-ab7a-ee40a8d1e561 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:34.415681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37493945-463b-4ffa-ab7a-ee40a8d1e561 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 1.271916 May 23 13:34:34.418408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 150/305] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:33 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:35.442430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b55e5c68-93c8-4025-87ff-63e112fa297d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:35.443072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b55e5c68-93c8-4025-87ff-63e112fa297d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:35.456334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b55e5c68-93c8-4025-87ff-63e112fa297d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:35.463507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b55e5c68-93c8-4025-87ff-63e112fa297d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:35.464400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b55e5c68-93c8-4025-87ff-63e112fa297d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:35.464874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b55e5c68-93c8-4025-87ff-63e112fa297d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:35.754338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b55e5c68-93c8-4025-87ff-63e112fa297d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:35.764816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b55e5c68-93c8-4025-87ff-63e112fa297d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.333087 May 23 13:34:35.766043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 156/306] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:35 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:36.783019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9bb5c224-0fe6-429b-8ab4-9ec8d313d5a8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:36.783625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9bb5c224-0fe6-429b-8ab4-9ec8d313d5a8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:36.790400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9bb5c224-0fe6-429b-8ab4-9ec8d313d5a8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:36.790860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9bb5c224-0fe6-429b-8ab4-9ec8d313d5a8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:36.791629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9bb5c224-0fe6-429b-8ab4-9ec8d313d5a8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:36.792079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9bb5c224-0fe6-429b-8ab4-9ec8d313d5a8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:37.089427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9bb5c224-0fe6-429b-8ab4-9ec8d313d5a8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:37.105556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9bb5c224-0fe6-429b-8ab4-9ec8d313d5a8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.318810 May 23 13:34:37.105556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 151/307] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:36 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:38.067913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-508a897c-d734-4df0-8e1b-38b725d13f64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40cadf9a-a621-41fe-ac36-7bb8ff08e500", "device": "/dev/sdb"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:38.081431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-508a897c-d734-4df0-8e1b-38b725d13f64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:38.097934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-508a897c-d734-4df0-8e1b-38b725d13f64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:38.098378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-508a897c-d734-4df0-8e1b-38b725d13f64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:38.101550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-508a897c-d734-4df0-8e1b-38b725d13f64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:38.102000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-508a897c-d734-4df0-8e1b-38b725d13f64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:38.116377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6cb94f36-771d-4d69-96cd-5ce7895a54a3 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:38.117029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6cb94f36-771d-4d69-96cd-5ce7895a54a3 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:38.127279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cb94f36-771d-4d69-96cd-5ce7895a54a3 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:38.141331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cb94f36-771d-4d69-96cd-5ce7895a54a3 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:38.142446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cb94f36-771d-4d69-96cd-5ce7895a54a3 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:38.142886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6cb94f36-771d-4d69-96cd-5ce7895a54a3 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:38.447727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6cb94f36-771d-4d69-96cd-5ce7895a54a3 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:38.460994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6cb94f36-771d-4d69-96cd-5ce7895a54a3 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.348930 May 23 13:34:38.462181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 152/308] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:38 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:38.843813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-274dfb83-4d22-4362-a187-e7166b0c6415 req-1ada5757-c805-4476-9959-f63caa56522e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "672eec27-241e-4b3b-addd-591dfe9185b4", "name": "network-vif-plugged", "status": "completed", "tag": "36781652-25bc-45c7-b441-25327d6fe79f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:38.852385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-274dfb83-4d22-4362-a187-e7166b0c6415 req-1ada5757-c805-4476-9959-f63caa56522e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:38.852974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-274dfb83-4d22-4362-a187-e7166b0c6415 req-1ada5757-c805-4476-9959-f63caa56522e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:38.865226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-274dfb83-4d22-4362-a187-e7166b0c6415 req-1ada5757-c805-4476-9959-f63caa56522e service nova] Creating event network-vif-plugged:36781652-25bc-45c7-b441-25327d6fe79f for instance 672eec27-241e-4b3b-addd-591dfe9185b4 on hv-cinder-82549 May 23 13:34:38.871514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-274dfb83-4d22-4362-a187-e7166b0c6415 req-1ada5757-c805-4476-9959-f63caa56522e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030643 May 23 13:34:38.872279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 153/309] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:34:39.480795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-466cc9e2-5203-44fe-a6fb-b6dbe8475eea tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:39.482424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-466cc9e2-5203-44fe-a6fb-b6dbe8475eea tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:39.508738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-466cc9e2-5203-44fe-a6fb-b6dbe8475eea tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:39.509679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-466cc9e2-5203-44fe-a6fb-b6dbe8475eea tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:39.511117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-466cc9e2-5203-44fe-a6fb-b6dbe8475eea tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:39.511764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-466cc9e2-5203-44fe-a6fb-b6dbe8475eea tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:39.523754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:39.772427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-466cc9e2-5203-44fe-a6fb-b6dbe8475eea tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:39.784987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-466cc9e2-5203-44fe-a6fb-b6dbe8475eea tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.305842 May 23 13:34:39.785855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 154/310] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:39 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:39.819566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-508a897c-d734-4df0-8e1b-38b725d13f64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "POST /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.759322 May 23 13:34:39.820717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 157/311] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 13:34:38 2022] POST /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4/os-volume_attachments => generated 194 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:34:40.803460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb8d4ccf-f27d-4a6b-b0e5-97bf9f4fa978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:40.804250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb8d4ccf-f27d-4a6b-b0e5-97bf9f4fa978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:40.816426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb8d4ccf-f27d-4a6b-b0e5-97bf9f4fa978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:40.817638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb8d4ccf-f27d-4a6b-b0e5-97bf9f4fa978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:40.818469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb8d4ccf-f27d-4a6b-b0e5-97bf9f4fa978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:40.818863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb8d4ccf-f27d-4a6b-b0e5-97bf9f4fa978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:41.153759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb8d4ccf-f27d-4a6b-b0e5-97bf9f4fa978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:41.166968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb8d4ccf-f27d-4a6b-b0e5-97bf9f4fa978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1313 microversion: 2.1 time: 0.365483 May 23 13:34:41.171640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 155/312] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:40 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:42.189829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d9323bf-76c2-413a-adf1-6c910ad840c7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:42.191933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d9323bf-76c2-413a-adf1-6c910ad840c7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:42.201926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9323bf-76c2-413a-adf1-6c910ad840c7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:42.202666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9323bf-76c2-413a-adf1-6c910ad840c7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:42.203740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9323bf-76c2-413a-adf1-6c910ad840c7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:42.204645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9323bf-76c2-413a-adf1-6c910ad840c7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:42.562216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d9323bf-76c2-413a-adf1-6c910ad840c7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:42.590758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d9323bf-76c2-413a-adf1-6c910ad840c7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1497 microversion: 2.1 time: 0.390792 May 23 13:34:42.591427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 158/313] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:42 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1497 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:44.349081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2eeec686-a918-4322-8c74-2c5d48553978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:44.349744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2eeec686-a918-4322-8c74-2c5d48553978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:44.357832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2eeec686-a918-4322-8c74-2c5d48553978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:44.358597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2eeec686-a918-4322-8c74-2c5d48553978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:44.359524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2eeec686-a918-4322-8c74-2c5d48553978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:44.359790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2eeec686-a918-4322-8c74-2c5d48553978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:44.412055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2eeec686-a918-4322-8c74-2c5d48553978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:34:44.942210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2eeec686-a918-4322-8c74-2c5d48553978 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "DELETE /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 204 len: 0 microversion: 2.1 time: 0.597700 May 23 13:34:44.948269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 156/314] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:34:44 2022] DELETE /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 13:34:44.956395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-566d7a0e-b2cb-4464-b8d6-45d5bef7b949 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:44.958637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-566d7a0e-b2cb-4464-b8d6-45d5bef7b949 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:44.967713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-566d7a0e-b2cb-4464-b8d6-45d5bef7b949 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:44.971886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-566d7a0e-b2cb-4464-b8d6-45d5bef7b949 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:44.974802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-566d7a0e-b2cb-4464-b8d6-45d5bef7b949 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:44.975440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-566d7a0e-b2cb-4464-b8d6-45d5bef7b949 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:45.310708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-566d7a0e-b2cb-4464-b8d6-45d5bef7b949 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:45.321457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-566d7a0e-b2cb-4464-b8d6-45d5bef7b949 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1503 microversion: 2.1 time: 0.369111 May 23 13:34:45.322037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 159/315] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:44 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1503 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:46.342811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-473c4af9-d70a-45d6-bd1b-d8c39bcf2d08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:46.344759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-473c4af9-d70a-45d6-bd1b-d8c39bcf2d08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:46.353049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-473c4af9-d70a-45d6-bd1b-d8c39bcf2d08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:46.353767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-473c4af9-d70a-45d6-bd1b-d8c39bcf2d08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:46.354717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-473c4af9-d70a-45d6-bd1b-d8c39bcf2d08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:46.357161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-473c4af9-d70a-45d6-bd1b-d8c39bcf2d08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:46.536411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-473c4af9-d70a-45d6-bd1b-d8c39bcf2d08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:46.547497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-473c4af9-d70a-45d6-bd1b-d8c39bcf2d08 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1503 microversion: 2.1 time: 0.212360 May 23 13:34:46.548382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 157/316] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:46 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:46.664391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-809d3176-5932-4908-89cf-9b7da20ca867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Action: 'create', calling method: .version_select at 0x7effb27694c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1405250442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+Gh/y+euJ8PucqWK+V3vllQkAGBNRmLdG67FhuJp+NVAG7cq6YaizVzNNAauUyihbOUcMtW0eaB7YffCNE3jsxD2KKMZTod0JqQHhlaesc5L5bbdP4jdB4vQFgjZdgXA=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:46.685719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-809d3176-5932-4908-89cf-9b7da20ca867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Getting quotas for project 8441389e662041a1945ee7164ad17159. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:34:46.697780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-809d3176-5932-4908-89cf-9b7da20ca867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Getting quotas for user 86ffd5c4601c4ccf90d09be72f41a33f and project 8441389e662041a1945ee7164ad17159. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:34:46.828749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-809d3176-5932-4908-89cf-9b7da20ca867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.454984 May 23 13:34:46.829451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 160/317] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 13:34:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:34:47.538660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-d1579d58-4bf5-4611-81be-df4ee6ec377d req-600a65fc-eaa9-4366-8dcb-24a8053f1fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "672eec27-241e-4b3b-addd-591dfe9185b4", "name": "network-vif-deleted", "tag": "36781652-25bc-45c7-b441-25327d6fe79f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:47.547263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d1579d58-4bf5-4611-81be-df4ee6ec377d req-600a65fc-eaa9-4366-8dcb-24a8053f1fa1 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:47.547848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d1579d58-4bf5-4611-81be-df4ee6ec377d req-600a65fc-eaa9-4366-8dcb-24a8053f1fa1 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:47.562767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-d1579d58-4bf5-4611-81be-df4ee6ec377d req-600a65fc-eaa9-4366-8dcb-24a8053f1fa1 service nova] Creating event network-vif-deleted:36781652-25bc-45c7-b441-25327d6fe79f for instance 672eec27-241e-4b3b-addd-591dfe9185b4 on hv-cinder-82549 May 23 13:34:47.569303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e77d9155-b283-4796-b496-768ff6fd00f4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:47.569303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e77d9155-b283-4796-b496-768ff6fd00f4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:47.578848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77d9155-b283-4796-b496-768ff6fd00f4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:47.579631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77d9155-b283-4796-b496-768ff6fd00f4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:47.580556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77d9155-b283-4796-b496-768ff6fd00f4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:47.581256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77d9155-b283-4796-b496-768ff6fd00f4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:47.584045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-d1579d58-4bf5-4611-81be-df4ee6ec377d req-600a65fc-eaa9-4366-8dcb-24a8053f1fa1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049632 May 23 13:34:47.588505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 158/318] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:34:47.688627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e77d9155-b283-4796-b496-768ff6fd00f4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:47.696317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e77d9155-b283-4796-b496-768ff6fd00f4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1461 microversion: 2.1 time: 0.133807 May 23 13:34:47.701785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 161/319] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:47 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1461 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:48.719975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b96c8ad7-e63a-4dd9-a284-49a0e1d1519a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:48.720829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b96c8ad7-e63a-4dd9-a284-49a0e1d1519a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:48.727761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b96c8ad7-e63a-4dd9-a284-49a0e1d1519a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:48.728301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b96c8ad7-e63a-4dd9-a284-49a0e1d1519a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:48.729109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b96c8ad7-e63a-4dd9-a284-49a0e1d1519a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:48.729550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b96c8ad7-e63a-4dd9-a284-49a0e1d1519a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:48.733829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:48.807625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b96c8ad7-e63a-4dd9-a284-49a0e1d1519a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:48.815249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b96c8ad7-e63a-4dd9-a284-49a0e1d1519a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1461 microversion: 2.1 time: 0.099607 May 23 13:34:48.815821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 159/320] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:48 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:49.835108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:49.835747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:49.846280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:49.846819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:49.847820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:49.848479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:49.888937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:49.889699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:49.890343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lazy-loading 'fault' on Instance uuid 672eec27-241e-4b3b-addd-591dfe9185b4 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:34:49.975979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:49.984606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6889dbd4-8ad2-44d3-9927-a380505ade20 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1303 microversion: 2.1 time: 0.156496 May 23 13:34:49.995776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 162/321] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:49 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:50.472477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-080be61d-f4cf-49bd-add4-2da460db8713 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Action: 'create', calling method: .version_select at 0x7effb2028160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-406872192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTfbCoXWaB6pTbwhYDPQ2TpOuYSJFKlltBiQdMNhFs2fMAGruGIlLI8r6DU7GCpz63x6roE35vMWgT2tldm/HvYNqqTA1RGQ8hP+K2m1zDwKhzJzcqd7nC9VBAQTQTP5Q=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:50.477771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:34:50.498766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-080be61d-f4cf-49bd-add4-2da460db8713 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Getting quotas for project 3407c9665e0448e18fd87ec20b0843e4. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:34:50.503251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-080be61d-f4cf-49bd-add4-2da460db8713 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Getting quotas for user 701b374f2fcf437dad87cec756232547 and project 3407c9665e0448e18fd87ec20b0843e4. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:34:50.627101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-080be61d-f4cf-49bd-add4-2da460db8713 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.160259 May 23 13:34:50.628503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 160/322] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 13:34:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:34:50.745506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-153862169", "imageRef": "d82cad60-9160-412a-93ab-b69bd459a8a0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-406872192", "networks": [{"uuid": "5f13cfcc-50cb-412a-9e48-1365996b1746"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:50.825331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] validate_networks() for [('5f13cfcc-50cb-412a-9e48-1365996b1746', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:34:51.004374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:51.005789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:51.014543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:51.015002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:51.015804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:51.016239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:51.152198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:51.153540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:51.154698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lazy-loading 'fault' on Instance uuid 672eec27-241e-4b3b-addd-591dfe9185b4 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:34:51.251897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:51.264455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1b77cb31-e626-4e67-965c-77ab314ca1d2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 200 len: 1303 microversion: 2.1 time: 0.264388 May 23 13:34:51.277549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 161/323] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:50 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 1303 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:51.579279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:34:51.579798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:34:51.580161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:34:51.580596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:34:51.581005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:34:51.598727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:51.606038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:51.606038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:51.606038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:51.624583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Getting quotas for project 3407c9665e0448e18fd87ec20b0843e4. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:34:51.628885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Getting quotas for user 701b374f2fcf437dad87cec756232547 and project 3407c9665e0448e18fd87ec20b0843e4. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:34:51.651601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:34:51.651601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82cad60-9160-412a-93ab-b69bd459a8a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:34:51.848594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b5590d4-fbed-458d-bfe7-c9dd2f5a7021 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107228 May 23 13:34:51.849556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 163/324] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 13:34:51.859784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-db5c2dfe-c1a3-4b16-a0cf-58d60d17e57d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:51.860323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-db5c2dfe-c1a3-4b16-a0cf-58d60d17e57d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:51.919360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-db5c2dfe-c1a3-4b16-a0cf-58d60d17e57d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:51.928103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-db5c2dfe-c1a3-4b16-a0cf-58d60d17e57d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1257 microversion: 2.1 time: 0.072502 May 23 13:34:51.928891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 162/325] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:51 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:52.283266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:52.283909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 672eec27-241e-4b3b-addd-591dfe9185b4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:52.290709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:52.296876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:52.296876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:52.296876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:52.306908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] HTTP exception thrown: Instance 672eec27-241e-4b3b-addd-591dfe9185b4 could not be found. May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Request method failure captured: May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 HTTP/1.1 May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii41ScIre4ZNrxW7JeA4XFzze_VM2ND8MMQDpsxeV1iYuZKuXAp5vLkbj2l8qTeCGKA9yS7c4nMmlssJX6Lre-KhsDljLwpcqX4BK-yAgVsU6eU44aF039myuhpU_3oCwDeNPPtpIgF69dapJGf1sEwUSObbzHdihZzTF85YNOvZiEYc May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: b3808ebec9df4a4c937ab961f3683dda May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesActionsTest-771051636 May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:34:52.308737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b3808ebec9df4a4c937ab961f3683dda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b3808ebec9df4a4c937ab961f3683dda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b3808ebec9df4a4c937ab961f3683dda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b3808ebec9df4a4c937ab961f3683dda"}]}] May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesActionsTest-771051636 May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: b3808ebec9df4a4c937ab961f3683dda May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesActionsTest-771051636 May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesActionsTest-771051636-project May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 740cc82ff2c04228b8ba32ecc034944f May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesActionsTest-771051636-project May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance 672eec27-241e-4b3b-addd-591dfe9185b4 could not be found. May 23 13:34:52.310579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '672eec27-241e-4b3b-addd-591dfe9185b4'} May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 672eec27-241e-4b3b-addd-591dfe9185b4 could not be found. May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:34:52.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 672eec27-241e-4b3b-addd-591dfe9185b4 could not be found. May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 672eec27-241e-4b3b-addd-591dfe9185b4 could not be found. May 23 13:34:52.312847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:34:52.314662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Returning 404 to user: Instance 672eec27-241e-4b3b-addd-591dfe9185b4 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:34:52.314662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d5dcd37-6093-45f2-baab-237636849975 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4" status: 404 len: 111 microversion: 2.1 time: 0.030854 May 23 13:34:52.314662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 164/326] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:52 2022] GET /compute/v2.1/servers/672eec27-241e-4b3b-addd-591dfe9185b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 13:34:52.418993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-507245487", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "networks": [{"uuid": "16dd73e1-be62-4f22-b4c3-00ead026b19d"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:34:52.475088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] validate_networks() for [('16dd73e1-be62-4f22-b4c3-00ead026b19d', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:34:52.861933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:34:52.862491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:34:52.862840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:34:52.863643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:34:52.863849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:34:52.874374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:52.874825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:52.875656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:52.881151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:52.892990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Getting quotas for project b3808ebec9df4a4c937ab961f3683dda. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:34:52.897684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Getting quotas for user 740cc82ff2c04228b8ba32ecc034944f and project b3808ebec9df4a4c937ab961f3683dda. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:34:52.908727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:34:52.911536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:34:52.945996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-84c36594-9c83-4b6b-b72e-569d107ec0df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:52.947260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-84c36594-9c83-4b6b-b72e-569d107ec0df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:53.006413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84c36594-9c83-4b6b-b72e-569d107ec0df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:53.013612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-84c36594-9c83-4b6b-b72e-569d107ec0df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1257 microversion: 2.1 time: 0.072782 May 23 13:34:53.014874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 165/327] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:52 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1257 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:53.159362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a4e6732a-346b-46da-82ce-2a49507194df tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744396 May 23 13:34:53.160878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 163/328] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 13:34:53.170718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b23c0ed1-6ea3-482b-8b8c-b8f604fed466 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:53.171342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b23c0ed1-6ea3-482b-8b8c-b8f604fed466 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:53.249201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b23c0ed1-6ea3-482b-8b8c-b8f604fed466 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:53.260431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b23c0ed1-6ea3-482b-8b8c-b8f604fed466 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1213 microversion: 2.1 time: 0.093771 May 23 13:34:53.264921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 166/329] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:53 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:54.031520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3b6e0daa-771e-4eff-aea8-45c9f110a859 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:54.032130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3b6e0daa-771e-4eff-aea8-45c9f110a859 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:54.039906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b6e0daa-771e-4eff-aea8-45c9f110a859 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:54.040334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b6e0daa-771e-4eff-aea8-45c9f110a859 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:54.041439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b6e0daa-771e-4eff-aea8-45c9f110a859 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:54.041565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b6e0daa-771e-4eff-aea8-45c9f110a859 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:54.107367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b6e0daa-771e-4eff-aea8-45c9f110a859 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:54.116933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3b6e0daa-771e-4eff-aea8-45c9f110a859 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1261 microversion: 2.1 time: 0.089211 May 23 13:34:54.117516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 164/330] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:54 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:54.278102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3ddb92d1-b6a7-421d-a136-447eb81ece04 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:54.278714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3ddb92d1-b6a7-421d-a136-447eb81ece04 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:54.285855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ddb92d1-b6a7-421d-a136-447eb81ece04 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:54.286311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ddb92d1-b6a7-421d-a136-447eb81ece04 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:54.287082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ddb92d1-b6a7-421d-a136-447eb81ece04 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:54.287528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ddb92d1-b6a7-421d-a136-447eb81ece04 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:54.349309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ddb92d1-b6a7-421d-a136-447eb81ece04 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:54.356758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3ddb92d1-b6a7-421d-a136-447eb81ece04 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1217 microversion: 2.1 time: 0.082423 May 23 13:34:54.357238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 167/331] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:54 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:55.134269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f83db5fb-1c79-419c-aeff-0f58d19d8441 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:55.134880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f83db5fb-1c79-419c-aeff-0f58d19d8441 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:55.141562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f83db5fb-1c79-419c-aeff-0f58d19d8441 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:55.142009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f83db5fb-1c79-419c-aeff-0f58d19d8441 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:55.142780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f83db5fb-1c79-419c-aeff-0f58d19d8441 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:55.143247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f83db5fb-1c79-419c-aeff-0f58d19d8441 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:55.209187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f83db5fb-1c79-419c-aeff-0f58d19d8441 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:55.216643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f83db5fb-1c79-419c-aeff-0f58d19d8441 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1261 microversion: 2.1 time: 0.086195 May 23 13:34:55.217226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 165/332] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:55 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:34:55.373815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1afc20ae-907b-4bcd-ae68-e8b25752f254 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:55.374417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1afc20ae-907b-4bcd-ae68-e8b25752f254 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:55.381173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1afc20ae-907b-4bcd-ae68-e8b25752f254 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:55.381619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1afc20ae-907b-4bcd-ae68-e8b25752f254 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:55.382374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1afc20ae-907b-4bcd-ae68-e8b25752f254 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:55.382806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1afc20ae-907b-4bcd-ae68-e8b25752f254 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:55.445484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1afc20ae-907b-4bcd-ae68-e8b25752f254 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:55.453189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1afc20ae-907b-4bcd-ae68-e8b25752f254 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1217 microversion: 2.1 time: 0.083071 May 23 13:34:55.453761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 168/333] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:55 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:56.234673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2db68cf4-19dc-43e8-acfa-3ad4e6e875d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:56.237944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2db68cf4-19dc-43e8-acfa-3ad4e6e875d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:56.241696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2db68cf4-19dc-43e8-acfa-3ad4e6e875d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:56.242145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2db68cf4-19dc-43e8-acfa-3ad4e6e875d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:56.242913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2db68cf4-19dc-43e8-acfa-3ad4e6e875d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:56.243607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2db68cf4-19dc-43e8-acfa-3ad4e6e875d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:56.303249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2db68cf4-19dc-43e8-acfa-3ad4e6e875d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:56.310617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2db68cf4-19dc-43e8-acfa-3ad4e6e875d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1261 microversion: 2.1 time: 0.079846 May 23 13:34:56.311186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 166/334] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:56 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:56.470974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-863214e2-2433-407f-b3f2-282ed57f532a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:56.471511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-863214e2-2433-407f-b3f2-282ed57f532a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:56.478259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-863214e2-2433-407f-b3f2-282ed57f532a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:56.478707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-863214e2-2433-407f-b3f2-282ed57f532a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:56.482396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-863214e2-2433-407f-b3f2-282ed57f532a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:56.482396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-863214e2-2433-407f-b3f2-282ed57f532a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:56.545326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-863214e2-2433-407f-b3f2-282ed57f532a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:56.553290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-863214e2-2433-407f-b3f2-282ed57f532a tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1217 microversion: 2.1 time: 0.086305 May 23 13:34:56.553850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 169/335] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:56 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:57.328528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6446074-3dbb-44d5-9026-9dcc266f0145 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:57.329334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6446074-3dbb-44d5-9026-9dcc266f0145 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:57.336372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6446074-3dbb-44d5-9026-9dcc266f0145 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:57.336861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6446074-3dbb-44d5-9026-9dcc266f0145 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:57.337649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6446074-3dbb-44d5-9026-9dcc266f0145 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:57.338117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6446074-3dbb-44d5-9026-9dcc266f0145 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:57.401664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6446074-3dbb-44d5-9026-9dcc266f0145 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:57.409160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6446074-3dbb-44d5-9026-9dcc266f0145 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1309 microversion: 2.1 time: 0.085407 May 23 13:34:57.410261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 167/336] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:57 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:57.569561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b00c60e2-5bed-42de-a31b-88b904cd4219 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:57.570197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b00c60e2-5bed-42de-a31b-88b904cd4219 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:57.577099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b00c60e2-5bed-42de-a31b-88b904cd4219 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:57.577552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b00c60e2-5bed-42de-a31b-88b904cd4219 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:57.578375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b00c60e2-5bed-42de-a31b-88b904cd4219 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:57.578886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b00c60e2-5bed-42de-a31b-88b904cd4219 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:57.655801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b00c60e2-5bed-42de-a31b-88b904cd4219 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:57.665331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b00c60e2-5bed-42de-a31b-88b904cd4219 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1265 microversion: 2.1 time: 0.099534 May 23 13:34:57.665907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 170/337] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:57 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:58.430045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c7cd388-0b10-4cb3-bc3e-a1bde5696b7d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:58.430648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c7cd388-0b10-4cb3-bc3e-a1bde5696b7d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:58.437060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c7cd388-0b10-4cb3-bc3e-a1bde5696b7d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:58.437502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c7cd388-0b10-4cb3-bc3e-a1bde5696b7d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:58.438278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c7cd388-0b10-4cb3-bc3e-a1bde5696b7d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:58.439082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c7cd388-0b10-4cb3-bc3e-a1bde5696b7d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:58.543032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c7cd388-0b10-4cb3-bc3e-a1bde5696b7d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:58.550835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c7cd388-0b10-4cb3-bc3e-a1bde5696b7d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1315 microversion: 2.1 time: 0.124700 May 23 13:34:58.551646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 168/338] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:58 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1315 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:58.683096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57732065-7d43-4b41-bf06-8c52c15ebfcf tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:58.683714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57732065-7d43-4b41-bf06-8c52c15ebfcf tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:58.693471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57732065-7d43-4b41-bf06-8c52c15ebfcf tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:58.693471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57732065-7d43-4b41-bf06-8c52c15ebfcf tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:58.693471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57732065-7d43-4b41-bf06-8c52c15ebfcf tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:58.693471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57732065-7d43-4b41-bf06-8c52c15ebfcf tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:58.799436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57732065-7d43-4b41-bf06-8c52c15ebfcf tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:58.821293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57732065-7d43-4b41-bf06-8c52c15ebfcf tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1283 microversion: 2.1 time: 0.142316 May 23 13:34:58.822820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 171/339] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:58 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1283 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:59.568220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9215ecbf-e723-417e-9e57-b998913e8c46 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:59.569551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9215ecbf-e723-417e-9e57-b998913e8c46 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:59.576468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9215ecbf-e723-417e-9e57-b998913e8c46 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:59.577373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9215ecbf-e723-417e-9e57-b998913e8c46 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:59.578550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9215ecbf-e723-417e-9e57-b998913e8c46 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:59.579149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9215ecbf-e723-417e-9e57-b998913e8c46 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:59.796797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9215ecbf-e723-417e-9e57-b998913e8c46 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:34:59.812904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9215ecbf-e723-417e-9e57-b998913e8c46 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.249030 May 23 13:34:59.813826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 169/340] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:59 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:34:59.839440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc874db0-6b12-4d13-8616-a78834a577b4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:34:59.840305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc874db0-6b12-4d13-8616-a78834a577b4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:34:59.848582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc874db0-6b12-4d13-8616-a78834a577b4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:59.849031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc874db0-6b12-4d13-8616-a78834a577b4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:34:59.849812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc874db0-6b12-4d13-8616-a78834a577b4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:34:59.850248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc874db0-6b12-4d13-8616-a78834a577b4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:00.106343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dc874db0-6b12-4d13-8616-a78834a577b4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:00.137871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc874db0-6b12-4d13-8616-a78834a577b4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.302071 May 23 13:35:00.139188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 172/341] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:34:59 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:00.494284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-fb3dedd1-58f3-4187-930e-c71129e3c2ae req-a157053f-ddb8-49c4-ac96-4a7065ee820a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ddd2ac-4582-4472-a43f-e3a8b4944ed2", "tag": "c4681035-db92-4c8b-8c08-d28d81ee09fa"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:00.506350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-fb3dedd1-58f3-4187-930e-c71129e3c2ae req-a157053f-ddb8-49c4-ac96-4a7065ee820a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:00.507105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-fb3dedd1-58f3-4187-930e-c71129e3c2ae req-a157053f-ddb8-49c4-ac96-4a7065ee820a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:00.519820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-fb3dedd1-58f3-4187-930e-c71129e3c2ae req-a157053f-ddb8-49c4-ac96-4a7065ee820a service nova] Creating event network-changed:c4681035-db92-4c8b-8c08-d28d81ee09fa for instance 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 on hv-cinder-82549 May 23 13:35:00.525248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-fb3dedd1-58f3-4187-930e-c71129e3c2ae req-a157053f-ddb8-49c4-ac96-4a7065ee820a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037030 May 23 13:35:00.525847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 170/342] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:00.830587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ee36e3e7-ffa8-46f5-b95b-da42284874f7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:00.831220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ee36e3e7-ffa8-46f5-b95b-da42284874f7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:00.837569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee36e3e7-ffa8-46f5-b95b-da42284874f7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:00.838021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee36e3e7-ffa8-46f5-b95b-da42284874f7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:00.838815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee36e3e7-ffa8-46f5-b95b-da42284874f7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:00.839249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee36e3e7-ffa8-46f5-b95b-da42284874f7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:00.984656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ee36e3e7-ffa8-46f5-b95b-da42284874f7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:00.993419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ee36e3e7-ffa8-46f5-b95b-da42284874f7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.166373 May 23 13:35:00.994048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 173/343] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:00 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:01.098184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ce501f7-14ec-45b5-a8d7-f343ea0042af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:01.098766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8ce501f7-14ec-45b5-a8d7-f343ea0042af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:01.105101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce501f7-14ec-45b5-a8d7-f343ea0042af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:01.105557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce501f7-14ec-45b5-a8d7-f343ea0042af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:01.106339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce501f7-14ec-45b5-a8d7-f343ea0042af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:01.106781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ce501f7-14ec-45b5-a8d7-f343ea0042af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:01.131560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8ce501f7-14ec-45b5-a8d7-f343ea0042af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/ips" status: 200 len: 150 microversion: 2.1 time: 0.038137 May 23 13:35:01.132132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 171/344] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 13:35:01 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:01.165674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-73318ada-eeff-4dfa-8ab6-e6dae59d2e6c tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:01.166290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-73318ada-eeff-4dfa-8ab6-e6dae59d2e6c tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:01.172443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73318ada-eeff-4dfa-8ab6-e6dae59d2e6c tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:01.172971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73318ada-eeff-4dfa-8ab6-e6dae59d2e6c tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:01.173724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73318ada-eeff-4dfa-8ab6-e6dae59d2e6c tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:01.174168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73318ada-eeff-4dfa-8ab6-e6dae59d2e6c tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:01.583494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-73318ada-eeff-4dfa-8ab6-e6dae59d2e6c tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:01.583494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-73318ada-eeff-4dfa-8ab6-e6dae59d2e6c tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.215605 May 23 13:35:01.583494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 174/345] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:01 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:02.010397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-38ed7f66-22b8-4119-b403-35dcf0ec803a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:02.010957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-38ed7f66-22b8-4119-b403-35dcf0ec803a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:02.019907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38ed7f66-22b8-4119-b403-35dcf0ec803a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:02.020667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38ed7f66-22b8-4119-b403-35dcf0ec803a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:02.021514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38ed7f66-22b8-4119-b403-35dcf0ec803a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:02.021955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38ed7f66-22b8-4119-b403-35dcf0ec803a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:02.156889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38ed7f66-22b8-4119-b403-35dcf0ec803a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:02.165266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-38ed7f66-22b8-4119-b403-35dcf0ec803a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.158824 May 23 13:35:02.166098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 172/346] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:02 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:02.595322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e7090964-f60e-4de7-9352-71d9f4c67969 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:02.595992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e7090964-f60e-4de7-9352-71d9f4c67969 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:02.598599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:02.603972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7090964-f60e-4de7-9352-71d9f4c67969 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:02.604429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7090964-f60e-4de7-9352-71d9f4c67969 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:02.605221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7090964-f60e-4de7-9352-71d9f4c67969 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:02.605658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7090964-f60e-4de7-9352-71d9f4c67969 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:02.753009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e7090964-f60e-4de7-9352-71d9f4c67969 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:02.764419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e7090964-f60e-4de7-9352-71d9f4c67969 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.172795 May 23 13:35:02.768199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 175/347] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:02 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:03.186073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-191aaaea-253e-408a-9dcd-ffb859277e53 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:03.186779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-191aaaea-253e-408a-9dcd-ffb859277e53 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:03.188822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:03.189833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=12 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:03.195295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-191aaaea-253e-408a-9dcd-ffb859277e53 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:03.195742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-191aaaea-253e-408a-9dcd-ffb859277e53 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:03.196520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-191aaaea-253e-408a-9dcd-ffb859277e53 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:03.197056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-191aaaea-253e-408a-9dcd-ffb859277e53 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:03.353102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-191aaaea-253e-408a-9dcd-ffb859277e53 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:03.360872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-191aaaea-253e-408a-9dcd-ffb859277e53 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.178614 May 23 13:35:03.361621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 173/348] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:03 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:03.784039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4ad9ff0-c7dc-4956-99c8-a602c34f2ee4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:03.786355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a4ad9ff0-c7dc-4956-99c8-a602c34f2ee4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:03.789211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=14 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:03.793830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4ad9ff0-c7dc-4956-99c8-a602c34f2ee4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:03.794580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4ad9ff0-c7dc-4956-99c8-a602c34f2ee4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:03.795393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4ad9ff0-c7dc-4956-99c8-a602c34f2ee4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:03.796032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4ad9ff0-c7dc-4956-99c8-a602c34f2ee4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:03.942764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a4ad9ff0-c7dc-4956-99c8-a602c34f2ee4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:03.951611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8863d82c-a7c9-4fa7-976e-6dc1c78c02a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:03.952108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8863d82c-a7c9-4fa7-976e-6dc1c78c02a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:03.962257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8863d82c-a7c9-4fa7-976e-6dc1c78c02a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:03.964715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4ad9ff0-c7dc-4956-99c8-a602c34f2ee4 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.184911 May 23 13:35:03.965378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 176/349] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:03 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:03.965917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8863d82c-a7c9-4fa7-976e-6dc1c78c02a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:03.967552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8863d82c-a7c9-4fa7-976e-6dc1c78c02a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:03.967986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8863d82c-a7c9-4fa7-976e-6dc1c78c02a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:03.997992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8863d82c-a7c9-4fa7-976e-6dc1c78c02a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/ips" status: 200 len: 152 microversion: 2.20 time: 0.050752 May 23 13:35:04.003217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 174/350] 10.222.0.70 () {60 vars in 1288 bytes} [Mon May 23 13:35:03 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/ips => generated 152 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:35:04.379649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bcd387e4-d053-4e77-8fcf-68967d7d58f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:04.380482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bcd387e4-d053-4e77-8fcf-68967d7d58f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:04.387051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bcd387e4-d053-4e77-8fcf-68967d7d58f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:04.387492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bcd387e4-d053-4e77-8fcf-68967d7d58f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:04.388261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bcd387e4-d053-4e77-8fcf-68967d7d58f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:04.388742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bcd387e4-d053-4e77-8fcf-68967d7d58f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:04.535011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bcd387e4-d053-4e77-8fcf-68967d7d58f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:04.535011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bcd387e4-d053-4e77-8fcf-68967d7d58f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.159264 May 23 13:35:04.535011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 177/351] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:04 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:04.983843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-00360803-fbda-41da-b224-07b38691c65e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:04.985646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-00360803-fbda-41da-b224-07b38691c65e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:04.994033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00360803-fbda-41da-b224-07b38691c65e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:04.994560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00360803-fbda-41da-b224-07b38691c65e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:04.995503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00360803-fbda-41da-b224-07b38691c65e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:04.996016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00360803-fbda-41da-b224-07b38691c65e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:05.145674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-00360803-fbda-41da-b224-07b38691c65e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:05.153152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-00360803-fbda-41da-b224-07b38691c65e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.174024 May 23 13:35:05.153714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 175/352] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:04 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:05.552002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3ba558e8-dc8a-4355-902c-c951d87c90d6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:05.552713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3ba558e8-dc8a-4355-902c-c951d87c90d6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:05.559502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ba558e8-dc8a-4355-902c-c951d87c90d6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:05.559940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ba558e8-dc8a-4355-902c-c951d87c90d6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:05.560734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ba558e8-dc8a-4355-902c-c951d87c90d6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:05.561326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ba558e8-dc8a-4355-902c-c951d87c90d6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:05.564128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:05.715188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ba558e8-dc8a-4355-902c-c951d87c90d6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:05.724290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3ba558e8-dc8a-4355-902c-c951d87c90d6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.176669 May 23 13:35:05.725012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 178/353] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:05 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:06.170427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d91e16b-4022-48e8-8285-ec6253829008 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:06.171045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5d91e16b-4022-48e8-8285-ec6253829008 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:06.177975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d91e16b-4022-48e8-8285-ec6253829008 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:06.178459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d91e16b-4022-48e8-8285-ec6253829008 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:06.179234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d91e16b-4022-48e8-8285-ec6253829008 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:06.179671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d91e16b-4022-48e8-8285-ec6253829008 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:06.244495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-00dea89d-8131-427f-ae1b-a701f8d00eb8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:06.245171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-00dea89d-8131-427f-ae1b-a701f8d00eb8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:06.247060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:06.251963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00dea89d-8131-427f-ae1b-a701f8d00eb8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:06.252410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00dea89d-8131-427f-ae1b-a701f8d00eb8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:06.253678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00dea89d-8131-427f-ae1b-a701f8d00eb8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:06.253952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00dea89d-8131-427f-ae1b-a701f8d00eb8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:06.277952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-00dea89d-8131-427f-ae1b-a701f8d00eb8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/ips" status: 200 len: 144 microversion: 2.1 time: 0.037561 May 23 13:35:06.278688 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 179/354] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 13:35:06 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:06.313195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d91e16b-4022-48e8-8285-ec6253829008 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:06.320803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d91e16b-4022-48e8-8285-ec6253829008 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.154199 May 23 13:35:06.321377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 176/355] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:06 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:06.745427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5904d480-28d5-4de4-9749-7604ca1b66b3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:06.746956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5904d480-28d5-4de4-9749-7604ca1b66b3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:06.754163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5904d480-28d5-4de4-9749-7604ca1b66b3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:06.754611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5904d480-28d5-4de4-9749-7604ca1b66b3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:06.755426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5904d480-28d5-4de4-9749-7604ca1b66b3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:06.756189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5904d480-28d5-4de4-9749-7604ca1b66b3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:06.904988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5904d480-28d5-4de4-9749-7604ca1b66b3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:06.913643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5904d480-28d5-4de4-9749-7604ca1b66b3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.173773 May 23 13:35:06.914364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 180/356] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:06 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:07.337743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-18560c17-10b7-4024-81b3-fdda6fe40f1b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:07.338488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-18560c17-10b7-4024-81b3-fdda6fe40f1b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:07.344822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18560c17-10b7-4024-81b3-fdda6fe40f1b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:07.345370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18560c17-10b7-4024-81b3-fdda6fe40f1b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:07.346210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18560c17-10b7-4024-81b3-fdda6fe40f1b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:07.346651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18560c17-10b7-4024-81b3-fdda6fe40f1b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:07.482177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-18560c17-10b7-4024-81b3-fdda6fe40f1b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:07.490564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-18560c17-10b7-4024-81b3-fdda6fe40f1b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.156726 May 23 13:35:07.491134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 177/357] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:07 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:07.931000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1bad6145-4a15-4b6d-a0e0-cb0d8c9dfe8d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:07.940382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1bad6145-4a15-4b6d-a0e0-cb0d8c9dfe8d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:07.940382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bad6145-4a15-4b6d-a0e0-cb0d8c9dfe8d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:07.940382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bad6145-4a15-4b6d-a0e0-cb0d8c9dfe8d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:07.940382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bad6145-4a15-4b6d-a0e0-cb0d8c9dfe8d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:07.942064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bad6145-4a15-4b6d-a0e0-cb0d8c9dfe8d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:08.078171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1bad6145-4a15-4b6d-a0e0-cb0d8c9dfe8d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:08.096296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1bad6145-4a15-4b6d-a0e0-cb0d8c9dfe8d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.168987 May 23 13:35:08.097190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 181/358] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:07 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:08.508507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a07ddfdd-6e39-40d3-86d7-a9b73a44a44e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:08.509071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a07ddfdd-6e39-40d3-86d7-a9b73a44a44e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:08.515070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a07ddfdd-6e39-40d3-86d7-a9b73a44a44e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:08.515517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a07ddfdd-6e39-40d3-86d7-a9b73a44a44e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:08.516277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a07ddfdd-6e39-40d3-86d7-a9b73a44a44e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:08.516764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a07ddfdd-6e39-40d3-86d7-a9b73a44a44e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:08.649775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a07ddfdd-6e39-40d3-86d7-a9b73a44a44e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:08.657892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a07ddfdd-6e39-40d3-86d7-a9b73a44a44e tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.153371 May 23 13:35:08.658467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 178/359] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:08 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:09.126046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97ea7d2b-59cb-4ab4-881f-bca5213c08fb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:09.126046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97ea7d2b-59cb-4ab4-881f-bca5213c08fb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:09.126046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97ea7d2b-59cb-4ab4-881f-bca5213c08fb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:09.126046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97ea7d2b-59cb-4ab4-881f-bca5213c08fb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:09.126682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97ea7d2b-59cb-4ab4-881f-bca5213c08fb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:09.126682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97ea7d2b-59cb-4ab4-881f-bca5213c08fb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:09.281580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97ea7d2b-59cb-4ab4-881f-bca5213c08fb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:09.294047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97ea7d2b-59cb-4ab4-881f-bca5213c08fb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.184360 May 23 13:35:09.294630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 182/360] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:09 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:09.676451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1d7bf7c3-d0a9-4d98-96f2-e6e5259c7017 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:09.677228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1d7bf7c3-d0a9-4d98-96f2-e6e5259c7017 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:09.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d7bf7c3-d0a9-4d98-96f2-e6e5259c7017 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:09.686801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d7bf7c3-d0a9-4d98-96f2-e6e5259c7017 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:09.688105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d7bf7c3-d0a9-4d98-96f2-e6e5259c7017 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:09.688814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d7bf7c3-d0a9-4d98-96f2-e6e5259c7017 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:09.731898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:09.883824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d7bf7c3-d0a9-4d98-96f2-e6e5259c7017 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:09.891464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1d7bf7c3-d0a9-4d98-96f2-e6e5259c7017 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.219452 May 23 13:35:09.892028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 179/361] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:09 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:10.137697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e227db99-36a8-4c3b-9ffd-e21c51aa69ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf81cf5e-ffe3-45f5-b600-511e8e1948b8"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:10.138807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e227db99-36a8-4c3b-9ffd-e21c51aa69ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:10.148018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e227db99-36a8-4c3b-9ffd-e21c51aa69ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:10.148745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e227db99-36a8-4c3b-9ffd-e21c51aa69ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:10.149624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e227db99-36a8-4c3b-9ffd-e21c51aa69ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:10.150207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e227db99-36a8-4c3b-9ffd-e21c51aa69ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:10.311427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-710f50f8-7c0a-472b-a24b-4c8c3a50c8f4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:10.311933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-710f50f8-7c0a-472b-a24b-4c8c3a50c8f4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:10.319316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-710f50f8-7c0a-472b-a24b-4c8c3a50c8f4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:10.319768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-710f50f8-7c0a-472b-a24b-4c8c3a50c8f4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:10.320539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-710f50f8-7c0a-472b-a24b-4c8c3a50c8f4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:10.321007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-710f50f8-7c0a-472b-a24b-4c8c3a50c8f4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:10.468530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-710f50f8-7c0a-472b-a24b-4c8c3a50c8f4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:10.476358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-710f50f8-7c0a-472b-a24b-4c8c3a50c8f4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.168865 May 23 13:35:10.476960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 180/362] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:10 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:10.909116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04a0e45a-4d3d-4d4e-9118-3f9740800cba tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:10.910558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-04a0e45a-4d3d-4d4e-9118-3f9740800cba tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:10.916805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04a0e45a-4d3d-4d4e-9118-3f9740800cba tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:10.917484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04a0e45a-4d3d-4d4e-9118-3f9740800cba tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:10.918467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04a0e45a-4d3d-4d4e-9118-3f9740800cba tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:10.919071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04a0e45a-4d3d-4d4e-9118-3f9740800cba tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:11.069260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-04a0e45a-4d3d-4d4e-9118-3f9740800cba tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:11.076763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-04a0e45a-4d3d-4d4e-9118-3f9740800cba tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.171740 May 23 13:35:11.077516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 181/363] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:10 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:11.495292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6536f817-2643-4533-8c40-9e4b675deadc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:11.496045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6536f817-2643-4533-8c40-9e4b675deadc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:11.502823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6536f817-2643-4533-8c40-9e4b675deadc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:11.503961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6536f817-2643-4533-8c40-9e4b675deadc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:11.505088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6536f817-2643-4533-8c40-9e4b675deadc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:11.507878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6536f817-2643-4533-8c40-9e4b675deadc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:11.647047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6536f817-2643-4533-8c40-9e4b675deadc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:11.679539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6536f817-2643-4533-8c40-9e4b675deadc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.188493 May 23 13:35:11.680126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 182/364] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:11 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:11.684950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-88f3933a-4514-4a07-b0d8-ce46feebe576 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:11.685490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-88f3933a-4514-4a07-b0d8-ce46feebe576 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:11.695944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88f3933a-4514-4a07-b0d8-ce46feebe576 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:11.696742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88f3933a-4514-4a07-b0d8-ce46feebe576 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:11.697732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88f3933a-4514-4a07-b0d8-ce46feebe576 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:11.698305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88f3933a-4514-4a07-b0d8-ce46feebe576 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:11.724640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-88f3933a-4514-4a07-b0d8-ce46feebe576 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lazy-loading 'flavor' on Instance uuid 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:35:14.764492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-88f3933a-4514-4a07-b0d8-ce46feebe576 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/action" status: 202 len: 0 microversion: 2.20 time: 3.082938 May 23 13:35:14.765202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 183/365] 10.222.0.70 () {62 vars in 1318 bytes} [Mon May 23 13:35:11 2022] POST /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/action => generated 0 bytes in 3085 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 13:35:14.771804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1abc799e-243c-4376-b654-865d8c70bf53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc469050-86ae-4326-b727-a7d9c246d6b9"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:14.773494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1abc799e-243c-4376-b654-865d8c70bf53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:14.780740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1abc799e-243c-4376-b654-865d8c70bf53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:14.781228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1abc799e-243c-4376-b654-865d8c70bf53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:14.782098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1abc799e-243c-4376-b654-865d8c70bf53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:14.782596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1abc799e-243c-4376-b654-865d8c70bf53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:20.144332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=9 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:20.225579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=33 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:22.289249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1abc799e-243c-4376-b654-865d8c70bf53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "POST /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.522528 May 23 13:35:22.289825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e227db99-36a8-4c3b-9ffd-e21c51aa69ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.155211 May 23 13:35:22.290306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 184/366] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 13:35:14 2022] POST /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 194 bytes in 7524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:22.290414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 183/367] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 13:35:10 2022] POST /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 194 bytes in 12157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:22.296932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e5d0056b-1ac4-4d7a-a48f-34727ada72e3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:22.297864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e5d0056b-1ac4-4d7a-a48f-34727ada72e3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:22.306128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5ba529ed-8db5-4028-a1c1-c16f67dc2f5f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:22.306849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5ba529ed-8db5-4028-a1c1-c16f67dc2f5f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:22.313734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:22.316259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ba529ed-8db5-4028-a1c1-c16f67dc2f5f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:22.317185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ba529ed-8db5-4028-a1c1-c16f67dc2f5f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:22.317503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ba529ed-8db5-4028-a1c1-c16f67dc2f5f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:22.317946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ba529ed-8db5-4028-a1c1-c16f67dc2f5f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:22.330584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5d0056b-1ac4-4d7a-a48f-34727ada72e3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:22.331089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5d0056b-1ac4-4d7a-a48f-34727ada72e3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:22.342571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5d0056b-1ac4-4d7a-a48f-34727ada72e3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:22.343260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5d0056b-1ac4-4d7a-a48f-34727ada72e3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:22.489917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5ba529ed-8db5-4028-a1c1-c16f67dc2f5f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:22.498050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5ba529ed-8db5-4028-a1c1-c16f67dc2f5f tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.206611 May 23 13:35:22.498623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 185/368] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:22 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:22.500353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e5d0056b-1ac4-4d7a-a48f-34727ada72e3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:22.504225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:22.504865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:22.540882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e5d0056b-1ac4-4d7a-a48f-34727ada72e3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.218583 May 23 13:35:22.540882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 184/369] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:22 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:22.541127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:22.541127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:22.541127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:22.541127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:22.541429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-c62347cb-5882-4c90-a12a-d6acb0ae89f4 req-1204c995-9a8e-49a1-994e-568dd1d6b7dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384389ea-0e81-4681-bab8-bac7bb161a22", "tag": "4c62e3ce-841b-4c5a-95e9-fb578399174d"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:22.541429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c62347cb-5882-4c90-a12a-d6acb0ae89f4 req-1204c995-9a8e-49a1-994e-568dd1d6b7dc service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:22.541429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c62347cb-5882-4c90-a12a-d6acb0ae89f4 req-1204c995-9a8e-49a1-994e-568dd1d6b7dc service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:22.541429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-c62347cb-5882-4c90-a12a-d6acb0ae89f4 req-1204c995-9a8e-49a1-994e-568dd1d6b7dc service nova] Creating event network-changed:4c62e3ce-841b-4c5a-95e9-fb578399174d for instance 384389ea-0e81-4681-bab8-bac7bb161a22 on hv-cinder-82549 May 23 13:35:22.554849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-c62347cb-5882-4c90-a12a-d6acb0ae89f4 req-1204c995-9a8e-49a1-994e-568dd1d6b7dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042637 May 23 13:35:22.555488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 185/370] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:22.651142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:22.659935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:22.661460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:22.662617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9c1b2c7f-5c03-473b-be6d-fe7423acc891 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.162875 May 23 13:35:22.663163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 186/371] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:22 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:23.517060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-515e77fc-64f9-4729-9cc9-353c333b6ce5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:23.517882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-515e77fc-64f9-4729-9cc9-353c333b6ce5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:23.524393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-515e77fc-64f9-4729-9cc9-353c333b6ce5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:23.524878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-515e77fc-64f9-4729-9cc9-353c333b6ce5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:23.525644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-515e77fc-64f9-4729-9cc9-353c333b6ce5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:23.526081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-515e77fc-64f9-4729-9cc9-353c333b6ce5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:23.556130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8036d26a-6647-4e5f-a997-380d99783a6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:23.556887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8036d26a-6647-4e5f-a997-380d99783a6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:23.564445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8036d26a-6647-4e5f-a997-380d99783a6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:23.565071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8036d26a-6647-4e5f-a997-380d99783a6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:23.566567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8036d26a-6647-4e5f-a997-380d99783a6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:23.567101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8036d26a-6647-4e5f-a997-380d99783a6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:23.692258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-515e77fc-64f9-4729-9cc9-353c333b6ce5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:23.692258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-515e77fc-64f9-4729-9cc9-353c333b6ce5 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.170504 May 23 13:35:23.692258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 186/372] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:23 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:23.692258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:23.693136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:23.695253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:23.695699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:23.696536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:23.696997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:23.726552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8036d26a-6647-4e5f-a997-380d99783a6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:23.734492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8036d26a-6647-4e5f-a997-380d99783a6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.182141 May 23 13:35:23.735117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 187/373] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:23 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:23.830741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:23.836665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:23.838348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:23.839603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-67e68c3f-3d5e-47dd-a11a-e14ec7751892 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.154676 May 23 13:35:23.840168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 187/374] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:24.703043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-57980b07-cd36-40fd-9d44-a12e0415a7e0 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:24.703835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-57980b07-cd36-40fd-9d44-a12e0415a7e0 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:24.711052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57980b07-cd36-40fd-9d44-a12e0415a7e0 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:24.711501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57980b07-cd36-40fd-9d44-a12e0415a7e0 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:24.712281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57980b07-cd36-40fd-9d44-a12e0415a7e0 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:24.712916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57980b07-cd36-40fd-9d44-a12e0415a7e0 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:24.751931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-319b6a7a-284f-4cf6-8f89-cdcfe30bf978 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:24.752546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-319b6a7a-284f-4cf6-8f89-cdcfe30bf978 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:24.759953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-319b6a7a-284f-4cf6-8f89-cdcfe30bf978 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:24.762901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-319b6a7a-284f-4cf6-8f89-cdcfe30bf978 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:24.762901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-319b6a7a-284f-4cf6-8f89-cdcfe30bf978 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:24.762901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-319b6a7a-284f-4cf6-8f89-cdcfe30bf978 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:24.845451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-57980b07-cd36-40fd-9d44-a12e0415a7e0 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:24.853529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-57980b07-cd36-40fd-9d44-a12e0415a7e0 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.154200 May 23 13:35:24.854423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 188/375] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:24 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:24.858924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:24.859530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:24.865823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:24.866252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:24.867017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:24.867462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:24.905443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-319b6a7a-284f-4cf6-8f89-cdcfe30bf978 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:24.913413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-319b6a7a-284f-4cf6-8f89-cdcfe30bf978 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.165143 May 23 13:35:24.914315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 188/376] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:24 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:25.005413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:25.013434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:25.014950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:25.016131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f5851b9-6d1a-4597-9cd7-b37f7cec495e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.160766 May 23 13:35:25.016709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 189/377] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:24 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:25.871789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7eec8014-628f-46fa-9c81-8837bc8e49a7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:25.872396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7eec8014-628f-46fa-9c81-8837bc8e49a7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:25.878844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7eec8014-628f-46fa-9c81-8837bc8e49a7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:25.879289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7eec8014-628f-46fa-9c81-8837bc8e49a7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:25.880061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7eec8014-628f-46fa-9c81-8837bc8e49a7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:25.880509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7eec8014-628f-46fa-9c81-8837bc8e49a7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:25.930317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d089b7b9-6ede-46e6-ad63-a91cae282daa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:25.931040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d089b7b9-6ede-46e6-ad63-a91cae282daa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:25.937577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d089b7b9-6ede-46e6-ad63-a91cae282daa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:25.938021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d089b7b9-6ede-46e6-ad63-a91cae282daa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:25.938790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d089b7b9-6ede-46e6-ad63-a91cae282daa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:25.939222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d089b7b9-6ede-46e6-ad63-a91cae282daa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:26.020241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7eec8014-628f-46fa-9c81-8837bc8e49a7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:26.030494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7eec8014-628f-46fa-9c81-8837bc8e49a7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.163254 May 23 13:35:26.031089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 189/378] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:25 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:26.036392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:26.042713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:26.044452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:26.045017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:26.045873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:26.046394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:26.082467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d089b7b9-6ede-46e6-ad63-a91cae282daa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:26.090159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d089b7b9-6ede-46e6-ad63-a91cae282daa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.163659 May 23 13:35:26.100021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 190/379] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:25 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:26.180604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:26.188728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:26.191156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:26.192616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-af01f6b5-50f1-44ec-be33-78f757bc9828 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.160554 May 23 13:35:26.193221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 190/380] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:27.047844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-811082a6-efd7-4f25-b23d-fbc068078a7d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:27.048560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-811082a6-efd7-4f25-b23d-fbc068078a7d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:27.055460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-811082a6-efd7-4f25-b23d-fbc068078a7d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:27.055905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-811082a6-efd7-4f25-b23d-fbc068078a7d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:27.056707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-811082a6-efd7-4f25-b23d-fbc068078a7d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:27.057137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-811082a6-efd7-4f25-b23d-fbc068078a7d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:27.107125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-38770e55-e863-40b0-94c4-9eefe88c5a04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:27.107758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-38770e55-e863-40b0-94c4-9eefe88c5a04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:27.115007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38770e55-e863-40b0-94c4-9eefe88c5a04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:27.115452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38770e55-e863-40b0-94c4-9eefe88c5a04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:27.116206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38770e55-e863-40b0-94c4-9eefe88c5a04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:27.116662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38770e55-e863-40b0-94c4-9eefe88c5a04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:27.204541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-811082a6-efd7-4f25-b23d-fbc068078a7d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:27.213595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-811082a6-efd7-4f25-b23d-fbc068078a7d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.169587 May 23 13:35:27.214196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 191/381] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:27 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:27.218796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:27.230100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:27.230100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:27.230100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:27.230100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:27.230497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:27.262615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-38770e55-e863-40b0-94c4-9eefe88c5a04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:27.271809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-38770e55-e863-40b0-94c4-9eefe88c5a04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.168379 May 23 13:35:27.272395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 191/382] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:27 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:27.378481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:27.380721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:27.387340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:27.388962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:27.390169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b59f9b8-c7ad-4655-945a-2c04e9091f34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.175057 May 23 13:35:27.390732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 192/383] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:28.245821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-01eda3e1-0675-4ac2-af9b-5c155c6171c8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:28.246421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-01eda3e1-0675-4ac2-af9b-5c155c6171c8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:28.253458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01eda3e1-0675-4ac2-af9b-5c155c6171c8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:28.254982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01eda3e1-0675-4ac2-af9b-5c155c6171c8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:28.255832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01eda3e1-0675-4ac2-af9b-5c155c6171c8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:28.256236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01eda3e1-0675-4ac2-af9b-5c155c6171c8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:28.290647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d4a0176b-4191-4b5f-a8fa-635943ee8b41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:28.291658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d4a0176b-4191-4b5f-a8fa-635943ee8b41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:28.302560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4a0176b-4191-4b5f-a8fa-635943ee8b41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:28.303252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4a0176b-4191-4b5f-a8fa-635943ee8b41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:28.304460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4a0176b-4191-4b5f-a8fa-635943ee8b41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:28.309222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4a0176b-4191-4b5f-a8fa-635943ee8b41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:28.397143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-01eda3e1-0675-4ac2-af9b-5c155c6171c8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:28.406401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-01eda3e1-0675-4ac2-af9b-5c155c6171c8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.164709 May 23 13:35:28.407162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 192/384] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:28 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:28.412475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:28.418268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:28.419833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:28.420363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:28.421335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:28.421772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:28.454102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d4a0176b-4191-4b5f-a8fa-635943ee8b41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:28.462809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d4a0176b-4191-4b5f-a8fa-635943ee8b41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.178012 May 23 13:35:28.463381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 193/385] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:28 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:28.557880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:28.566380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:28.567917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:28.569100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-02cfe92b-f9ce-40ce-b935-c025137a4fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.160388 May 23 13:35:28.569654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 193/386] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:28 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:29.232853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fe1a054-e4d2-439e-817b-63f51908bbb3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:29.233355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fe1a054-e4d2-439e-817b-63f51908bbb3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:29.240450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fe1a054-e4d2-439e-817b-63f51908bbb3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:29.240920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fe1a054-e4d2-439e-817b-63f51908bbb3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:29.241687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fe1a054-e4d2-439e-817b-63f51908bbb3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:29.242122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fe1a054-e4d2-439e-817b-63f51908bbb3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:29.370480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-2fe1a054-e4d2-439e-817b-63f51908bbb3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'services' on Instance uuid 57d8fc5f-0889-4ea2-942c-90bde9a763c4 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:35:29.423995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4422000d-2f7c-48a6-942a-16c2fe80c1b8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:29.424863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4422000d-2f7c-48a6-942a-16c2fe80c1b8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:29.431880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4422000d-2f7c-48a6-942a-16c2fe80c1b8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:29.432417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4422000d-2f7c-48a6-942a-16c2fe80c1b8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:29.433283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4422000d-2f7c-48a6-942a-16c2fe80c1b8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:29.433788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4422000d-2f7c-48a6-942a-16c2fe80c1b8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:29.565582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4422000d-2f7c-48a6-942a-16c2fe80c1b8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:29.573253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4422000d-2f7c-48a6-942a-16c2fe80c1b8 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.153034 May 23 13:35:29.573832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 194/387] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:29 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:29.578304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ebb3dce7-5800-4370-a432-b8787435769a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:29.578908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ebb3dce7-5800-4370-a432-b8787435769a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:29.585803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebb3dce7-5800-4370-a432-b8787435769a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:29.586252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebb3dce7-5800-4370-a432-b8787435769a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:29.587015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebb3dce7-5800-4370-a432-b8787435769a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:29.587452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebb3dce7-5800-4370-a432-b8787435769a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:29.717414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fe1a054-e4d2-439e-817b-63f51908bbb3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4/os-volume_attachments/40cadf9a-a621-41fe-ac36-7bb8ff08e500" status: 202 len: 0 microversion: 2.1 time: 0.488535 May 23 13:35:29.721313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 194/388] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:35:29 2022] DELETE /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4/os-volume_attachments/40cadf9a-a621-41fe-ac36-7bb8ff08e500 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:35:29.723616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebb3dce7-5800-4370-a432-b8787435769a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:29.727491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:29.728210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:29.733441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ebb3dce7-5800-4370-a432-b8787435769a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.158386 May 23 13:35:29.735720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 195/389] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:29 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:29.737424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:29.738014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:29.738891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:29.739309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:29.881117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:29.888923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:29.890416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:29.891557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c3617815-d984-4870-98a5-e5e27fb36ebd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.171798 May 23 13:35:29.892099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 195/390] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:29 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:30.591064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ea1711a4-75d5-45ca-9f74-dfabb2033653 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:30.591668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ea1711a4-75d5-45ca-9f74-dfabb2033653 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:30.598536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea1711a4-75d5-45ca-9f74-dfabb2033653 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:30.600398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea1711a4-75d5-45ca-9f74-dfabb2033653 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:30.600398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea1711a4-75d5-45ca-9f74-dfabb2033653 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:30.600398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea1711a4-75d5-45ca-9f74-dfabb2033653 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:30.733338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea1711a4-75d5-45ca-9f74-dfabb2033653 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:30.741152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ea1711a4-75d5-45ca-9f74-dfabb2033653 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.154269 May 23 13:35:30.741722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 196/391] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:30 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:30.752091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e6a4798-3836-4e2e-b62b-8699c61b25e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:30.753296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e6a4798-3836-4e2e-b62b-8699c61b25e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:30.759822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e6a4798-3836-4e2e-b62b-8699c61b25e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:30.760328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e6a4798-3836-4e2e-b62b-8699c61b25e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:30.761133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e6a4798-3836-4e2e-b62b-8699c61b25e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:30.761576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e6a4798-3836-4e2e-b62b-8699c61b25e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:30.911066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:30.911926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:30.914070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e6a4798-3836-4e2e-b62b-8699c61b25e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:30.919059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:30.919521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:30.920297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:30.920965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:30.922260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e6a4798-3836-4e2e-b62b-8699c61b25e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.173863 May 23 13:35:30.923070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 196/392] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:30 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:30.953202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-a2b9c217-449f-438f-9e9d-ca55a16c8fbb req-c1e83f30-3adf-4642-a615-fa145fd38916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384389ea-0e81-4681-bab8-bac7bb161a22", "name": "network-vif-plugged", "status": "completed", "tag": "4c62e3ce-841b-4c5a-95e9-fb578399174d"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:30.959208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a2b9c217-449f-438f-9e9d-ca55a16c8fbb req-c1e83f30-3adf-4642-a615-fa145fd38916 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:30.959683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a2b9c217-449f-438f-9e9d-ca55a16c8fbb req-c1e83f30-3adf-4642-a615-fa145fd38916 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:30.971275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-a2b9c217-449f-438f-9e9d-ca55a16c8fbb req-c1e83f30-3adf-4642-a615-fa145fd38916 service nova] Creating event network-vif-plugged:4c62e3ce-841b-4c5a-95e9-fb578399174d for instance 384389ea-0e81-4681-bab8-bac7bb161a22 on hv-cinder-82549 May 23 13:35:30.977106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-a2b9c217-449f-438f-9e9d-ca55a16c8fbb req-c1e83f30-3adf-4642-a615-fa145fd38916 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036204 May 23 13:35:30.977906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 197/393] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:31.058131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:31.066677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:31.068254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:31.069479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-03fdbf0b-55bc-42de-8785-1d8637ba8afd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.163671 May 23 13:35:31.079016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 197/394] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:31.759924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5b8117bc-9750-462e-b48f-17a8d5d2f8a9 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:31.760687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5b8117bc-9750-462e-b48f-17a8d5d2f8a9 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:31.766935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b8117bc-9750-462e-b48f-17a8d5d2f8a9 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:31.767357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b8117bc-9750-462e-b48f-17a8d5d2f8a9 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:31.768666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b8117bc-9750-462e-b48f-17a8d5d2f8a9 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:31.769070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b8117bc-9750-462e-b48f-17a8d5d2f8a9 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:31.907958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5b8117bc-9750-462e-b48f-17a8d5d2f8a9 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:31.916985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5b8117bc-9750-462e-b48f-17a8d5d2f8a9 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.161751 May 23 13:35:31.917934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 198/395] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:31 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:31.939735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07b8adf2-ae98-4038-b9b2-439fe212c650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:31.940507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07b8adf2-ae98-4038-b9b2-439fe212c650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:31.947845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07b8adf2-ae98-4038-b9b2-439fe212c650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:31.948374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07b8adf2-ae98-4038-b9b2-439fe212c650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:31.949299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07b8adf2-ae98-4038-b9b2-439fe212c650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:31.949808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07b8adf2-ae98-4038-b9b2-439fe212c650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:32.084558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07b8adf2-ae98-4038-b9b2-439fe212c650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:32.088098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:32.088732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:32.092016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07b8adf2-ae98-4038-b9b2-439fe212c650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.156762 May 23 13:35:32.092601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 198/396] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:31 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:32.094679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:32.095131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:32.095896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:32.096381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:32.226662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:32.234489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:32.236146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:32.237786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d1ef2bc-b8aa-4687-9bb8-8832e37b19ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.153549 May 23 13:35:32.243732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 199/397] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:32 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:35:32.935622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-246f639d-30e2-49d2-aa4a-ac0b75f3bad7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:32.936475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-246f639d-30e2-49d2-aa4a-ac0b75f3bad7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:32.950721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-246f639d-30e2-49d2-aa4a-ac0b75f3bad7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:32.951327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-246f639d-30e2-49d2-aa4a-ac0b75f3bad7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:32.951951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-246f639d-30e2-49d2-aa4a-ac0b75f3bad7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:32.952382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-246f639d-30e2-49d2-aa4a-ac0b75f3bad7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:33.109871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fcdfe956-ec72-4772-b262-2b92caf27079 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:33.110660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fcdfe956-ec72-4772-b262-2b92caf27079 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:33.118580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcdfe956-ec72-4772-b262-2b92caf27079 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:33.119043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcdfe956-ec72-4772-b262-2b92caf27079 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:33.119849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcdfe956-ec72-4772-b262-2b92caf27079 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:33.120288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcdfe956-ec72-4772-b262-2b92caf27079 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:33.155744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-246f639d-30e2-49d2-aa4a-ac0b75f3bad7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:33.159872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:33.164442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-246f639d-30e2-49d2-aa4a-ac0b75f3bad7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.233837 May 23 13:35:33.165050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 199/398] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:32 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:33.257185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:33.257805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:33.262469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fcdfe956-ec72-4772-b262-2b92caf27079 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:33.263823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:33.264273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:33.265064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:33.265498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:33.271437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fcdfe956-ec72-4772-b262-2b92caf27079 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.166212 May 23 13:35:33.272131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 200/399] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:33 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:33.398951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:33.406749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:33.408257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:33.410229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-93411567-eab7-4ded-9e3d-91ec62d8ee6a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.157228 May 23 13:35:33.410774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 200/400] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:35:34.181413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c116f8d1-0050-4717-bc34-44e7b6d78dd2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:34.182080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c116f8d1-0050-4717-bc34-44e7b6d78dd2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:34.188801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c116f8d1-0050-4717-bc34-44e7b6d78dd2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:34.189256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c116f8d1-0050-4717-bc34-44e7b6d78dd2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:34.190099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c116f8d1-0050-4717-bc34-44e7b6d78dd2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:34.190545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c116f8d1-0050-4717-bc34-44e7b6d78dd2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:34.288559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f236e1af-325f-405b-929d-0f0f9b717218 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:34.289196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f236e1af-325f-405b-929d-0f0f9b717218 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:34.296155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f236e1af-325f-405b-929d-0f0f9b717218 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:34.296625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f236e1af-325f-405b-929d-0f0f9b717218 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:34.297399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f236e1af-325f-405b-929d-0f0f9b717218 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:34.297837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f236e1af-325f-405b-929d-0f0f9b717218 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:34.321005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c116f8d1-0050-4717-bc34-44e7b6d78dd2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:34.328525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c116f8d1-0050-4717-bc34-44e7b6d78dd2 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.150870 May 23 13:35:34.329129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 201/401] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:34 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:34.426727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f236e1af-325f-405b-929d-0f0f9b717218 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:34.428699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:34.429382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:34.434261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f236e1af-325f-405b-929d-0f0f9b717218 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.149597 May 23 13:35:34.434832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 201/402] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:34 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:34.435443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:34.435964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:34.436840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:34.437284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:34.570192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:34.578074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:34.579574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:34.581272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef97a362-1385-41cb-86fd-aa2ca3988799 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.156663 May 23 13:35:34.581838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 202/403] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:34 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:35:35.345346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b86d22f4-05c6-4bfb-9794-2352c07952ec tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:35.345917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b86d22f4-05c6-4bfb-9794-2352c07952ec tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:35.353847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b86d22f4-05c6-4bfb-9794-2352c07952ec tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:35.354303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b86d22f4-05c6-4bfb-9794-2352c07952ec tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:35.355075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b86d22f4-05c6-4bfb-9794-2352c07952ec tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:35.355511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b86d22f4-05c6-4bfb-9794-2352c07952ec tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:35.452120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e0eca28-e0df-47ae-8c4b-ef5ffbcfd1a6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:35.452773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e0eca28-e0df-47ae-8c4b-ef5ffbcfd1a6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:35.460468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e0eca28-e0df-47ae-8c4b-ef5ffbcfd1a6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:35.467614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e0eca28-e0df-47ae-8c4b-ef5ffbcfd1a6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:35.467614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e0eca28-e0df-47ae-8c4b-ef5ffbcfd1a6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:35.467614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e0eca28-e0df-47ae-8c4b-ef5ffbcfd1a6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:35.506738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b86d22f4-05c6-4bfb-9794-2352c07952ec tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:35.514490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b86d22f4-05c6-4bfb-9794-2352c07952ec tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.173026 May 23 13:35:35.515263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 202/404] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:35 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:35.592138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e0eca28-e0df-47ae-8c4b-ef5ffbcfd1a6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:35.599995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:35.600672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:35.601319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e0eca28-e0df-47ae-8c4b-ef5ffbcfd1a6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.153243 May 23 13:35:35.601944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 203/405] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:35 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:35.607055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:35.607501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:35.608258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:35.608716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:35.746880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:35.755406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:35.756936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:35.758095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2f1e0359-16ae-4821-927a-0d4e9b972f8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1724 microversion: 2.20 time: 0.162818 May 23 13:35:35.758643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 203/406] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:35 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:35:36.257765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1368951303", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1405250442", "security_groups": [{"name": "tempest-secgroup-smoke-1059160264"}], "networks": [{"uuid": "86da9f46-7f33-4a3a-aac4-18ea6333b5b4"}], "block_device_mapping_v2": [{"uuid": "83265e45-b4dd-49bb-abdf-ac59976e48c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:36.379436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] validate_networks() for [('86da9f46-7f33-4a3a-aac4-18ea6333b5b4', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:35:36.533951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3f6a6843-a02a-4557-8842-9a1c3d17de2d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:36.534692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3f6a6843-a02a-4557-8842-9a1c3d17de2d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:36.545279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f6a6843-a02a-4557-8842-9a1c3d17de2d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:36.545947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f6a6843-a02a-4557-8842-9a1c3d17de2d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:36.560091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f6a6843-a02a-4557-8842-9a1c3d17de2d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:36.560091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f6a6843-a02a-4557-8842-9a1c3d17de2d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:36.699265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f6a6843-a02a-4557-8842-9a1c3d17de2d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:36.704343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3f6a6843-a02a-4557-8842-9a1c3d17de2d tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1313 microversion: 2.1 time: 0.175160 May 23 13:35:36.704952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 204/407] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:36 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:36.709646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e3e680c-a599-4b7a-9e08-2448577d5963 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:36.710243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e3e680c-a599-4b7a-9e08-2448577d5963 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:36.716255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e3e680c-a599-4b7a-9e08-2448577d5963 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:36.716975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e3e680c-a599-4b7a-9e08-2448577d5963 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:36.717764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e3e680c-a599-4b7a-9e08-2448577d5963 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:36.718198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e3e680c-a599-4b7a-9e08-2448577d5963 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:36.766027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:35:36.766789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:35:36.766980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:35:36.767323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:35:36.767730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:35:36.780767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:36.781219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:36.782079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:36.782505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:36.800720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Getting quotas for project 8441389e662041a1945ee7164ad17159. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:35:36.804896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Getting quotas for user 86ffd5c4601c4ccf90d09be72f41a33f and project 8441389e662041a1945ee7164ad17159. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:35:36.854538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e3e680c-a599-4b7a-9e08-2448577d5963 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:36.862124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e3e680c-a599-4b7a-9e08-2448577d5963 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.156102 May 23 13:35:36.871564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 205/408] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:36 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:36.871993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:35:36.872088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-3bf5ee8f-ed3d-4a65-afbd-1a22750ea98d req-fa962e5c-1e72-46a1-b390-62e2472c1f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ddd2ac-4582-4472-a43f-e3a8b4944ed2", "name": "network-vif-plugged", "status": "completed", "tag": "c4681035-db92-4c8b-8c08-d28d81ee09fa"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:36.872212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83265e45-b4dd-49bb-abdf-ac59976e48c4',volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:35:36.877221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3bf5ee8f-ed3d-4a65-afbd-1a22750ea98d req-fa962e5c-1e72-46a1-b390-62e2472c1f4a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:36.878556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3bf5ee8f-ed3d-4a65-afbd-1a22750ea98d req-fa962e5c-1e72-46a1-b390-62e2472c1f4a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:36.891045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-3bf5ee8f-ed3d-4a65-afbd-1a22750ea98d req-fa962e5c-1e72-46a1-b390-62e2472c1f4a service nova] Creating event network-vif-plugged:c4681035-db92-4c8b-8c08-d28d81ee09fa for instance 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 on hv-cinder-82549 May 23 13:35:36.900108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-3bf5ee8f-ed3d-4a65-afbd-1a22750ea98d req-fa962e5c-1e72-46a1-b390-62e2472c1f4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 May 23 13:35:36.900108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 206/409] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:36.902234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:36.902918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:36.909030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:36.909467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:36.910224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:36.910647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:37.298440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:37.315402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:37.318143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:37.319561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9c82492a-68b6-4e95-8f82-b3f6b680d9a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1745 microversion: 2.20 time: 0.421335 May 23 13:35:37.320867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 207/410] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:36 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1745 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:37.516242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-53c31dc9-0908-4fbb-8b61-719bfd73ab9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.262196 May 23 13:35:37.522141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 204/411] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:35:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 13:35:37.530284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59e93d72-4441-4521-999b-a6426bd8afaa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:37.530976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59e93d72-4441-4521-999b-a6426bd8afaa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:37.587409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59e93d72-4441-4521-999b-a6426bd8afaa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:37.594446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59e93d72-4441-4521-999b-a6426bd8afaa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1089 microversion: 2.1 time: 0.070053 May 23 13:35:37.595027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 208/412] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:37 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:37.722293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9a5c50e-6005-42bb-90dc-4f43d52fe818 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:37.722935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9a5c50e-6005-42bb-90dc-4f43d52fe818 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:37.729355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9a5c50e-6005-42bb-90dc-4f43d52fe818 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:37.732904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9a5c50e-6005-42bb-90dc-4f43d52fe818 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:37.732904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9a5c50e-6005-42bb-90dc-4f43d52fe818 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:37.732904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9a5c50e-6005-42bb-90dc-4f43d52fe818 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:37.867120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9a5c50e-6005-42bb-90dc-4f43d52fe818 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:37.875290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9a5c50e-6005-42bb-90dc-4f43d52fe818 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1496 microversion: 2.1 time: 0.157488 May 23 13:35:37.875879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 205/413] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:37 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:37.879768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d1f8b228-dfc5-4092-b0c7-82dfa371d9e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:37.880388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d1f8b228-dfc5-4092-b0c7-82dfa371d9e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:37.887827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1f8b228-dfc5-4092-b0c7-82dfa371d9e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:37.888252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1f8b228-dfc5-4092-b0c7-82dfa371d9e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:37.889060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1f8b228-dfc5-4092-b0c7-82dfa371d9e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:37.889507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1f8b228-dfc5-4092-b0c7-82dfa371d9e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:38.032404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d1f8b228-dfc5-4092-b0c7-82dfa371d9e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:38.041306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d1f8b228-dfc5-4092-b0c7-82dfa371d9e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.165876 May 23 13:35:38.041879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 209/414] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:37 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:38.339320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:38.339930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:38.346647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:38.347110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:38.347919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:38.348335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:38.506412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:38.514981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:38.517763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:38.518493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d24baf4-d918-4923-a170-e6c6187718e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1745 microversion: 2.20 time: 0.182719 May 23 13:35:38.519083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 206/415] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:38 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:38.610951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-486fed21-a535-4b42-abb4-f9f7444da977 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:38.611560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-486fed21-a535-4b42-abb4-f9f7444da977 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:38.676733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-486fed21-a535-4b42-abb4-f9f7444da977 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:38.676733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-486fed21-a535-4b42-abb4-f9f7444da977 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1089 microversion: 2.1 time: 0.066168 May 23 13:35:38.676733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 210/416] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:38 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:39.058582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a10c503-a8fc-4a22-b11a-14733319a7e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:39.059201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a10c503-a8fc-4a22-b11a-14733319a7e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:39.066180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a10c503-a8fc-4a22-b11a-14733319a7e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.066633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a10c503-a8fc-4a22-b11a-14733319a7e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.072205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a10c503-a8fc-4a22-b11a-14733319a7e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.072205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a10c503-a8fc-4a22-b11a-14733319a7e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.213855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a10c503-a8fc-4a22-b11a-14733319a7e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:39.223328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a10c503-a8fc-4a22-b11a-14733319a7e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.168804 May 23 13:35:39.225386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 207/417] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:39 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:39.257680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b4318de-3927-4427-a3d8-0d344e846baa tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:39.258249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b4318de-3927-4427-a3d8-0d344e846baa tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:39.264420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b4318de-3927-4427-a3d8-0d344e846baa tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.264913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b4318de-3927-4427-a3d8-0d344e846baa tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.265808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b4318de-3927-4427-a3d8-0d344e846baa tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.266244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b4318de-3927-4427-a3d8-0d344e846baa tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.298581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b4318de-3927-4427-a3d8-0d344e846baa tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:35:39.537122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:39.537734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:39.544356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.544842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.545608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.546295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.686663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:39.695752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:39.697362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:39.698468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b351ebb1-50fb-46f6-bee0-b4b8f931145a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1745 microversion: 2.20 time: 0.166029 May 23 13:35:39.699020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 208/418] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:39 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:35:39.703511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b97050f5-20eb-4b6c-b285-bf02bd513897 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:39.704120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b97050f5-20eb-4b6c-b285-bf02bd513897 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:39.710297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b97050f5-20eb-4b6c-b285-bf02bd513897 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.710751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b97050f5-20eb-4b6c-b285-bf02bd513897 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.711523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b97050f5-20eb-4b6c-b285-bf02bd513897 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.711960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b97050f5-20eb-4b6c-b285-bf02bd513897 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.772955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b97050f5-20eb-4b6c-b285-bf02bd513897 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:39.780389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b97050f5-20eb-4b6c-b285-bf02bd513897 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1139 microversion: 2.1 time: 0.080422 May 23 13:35:39.780996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 209/419] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:39 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:39.837236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b4318de-3927-4427-a3d8-0d344e846baa tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "DELETE /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 204 len: 0 microversion: 2.1 time: 0.584986 May 23 13:35:39.837841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 211/420] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:35:39 2022] DELETE /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 13:35:39.845957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2c9d237-1a10-4b91-bb6a-a61498d40915 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:39.846613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c2c9d237-1a10-4b91-bb6a-a61498d40915 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:39.852884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2c9d237-1a10-4b91-bb6a-a61498d40915 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.853337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2c9d237-1a10-4b91-bb6a-a61498d40915 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.854090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2c9d237-1a10-4b91-bb6a-a61498d40915 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:39.854524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2c9d237-1a10-4b91-bb6a-a61498d40915 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:39.857273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:39.985751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c2c9d237-1a10-4b91-bb6a-a61498d40915 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:39.993444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2c9d237-1a10-4b91-bb6a-a61498d40915 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1502 microversion: 2.1 time: 0.150947 May 23 13:35:39.994014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 210/421] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:39 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:40.241070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-981a19ee-dc9c-4c4e-a8a9-5ae13f5aaad9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:40.241734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-981a19ee-dc9c-4c4e-a8a9-5ae13f5aaad9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:40.248346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-981a19ee-dc9c-4c4e-a8a9-5ae13f5aaad9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:40.248842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-981a19ee-dc9c-4c4e-a8a9-5ae13f5aaad9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:40.249671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-981a19ee-dc9c-4c4e-a8a9-5ae13f5aaad9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:40.250105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-981a19ee-dc9c-4c4e-a8a9-5ae13f5aaad9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:40.391423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-981a19ee-dc9c-4c4e-a8a9-5ae13f5aaad9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:40.399640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-981a19ee-dc9c-4c4e-a8a9-5ae13f5aaad9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.163073 May 23 13:35:40.400169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 212/422] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:40 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:40.527804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-c45bf2c4-7e5d-4f83-aea8-422bab129c32 req-5c7a1f39-87f7-4918-b405-e1ea5d863e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011172-f0cf-4b8a-9791-2535bb8bcaa4", "name": "network-vif-plugged", "status": "completed", "tag": "8fcc06ea-c028-490c-8ab1-e434a5b0c699"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:40.537641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c45bf2c4-7e5d-4f83-aea8-422bab129c32 req-5c7a1f39-87f7-4918-b405-e1ea5d863e0c service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:40.538094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c45bf2c4-7e5d-4f83-aea8-422bab129c32 req-5c7a1f39-87f7-4918-b405-e1ea5d863e0c service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:40.550452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-c45bf2c4-7e5d-4f83-aea8-422bab129c32 req-5c7a1f39-87f7-4918-b405-e1ea5d863e0c service nova] Creating event network-vif-plugged:8fcc06ea-c028-490c-8ab1-e434a5b0c699 for instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 on hv-cinder-82549 May 23 13:35:40.555521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-c45bf2c4-7e5d-4f83-aea8-422bab129c32 req-5c7a1f39-87f7-4918-b405-e1ea5d863e0c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032540 May 23 13:35:40.556114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 211/423] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:35:40.720211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:40.720991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:40.728678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:40.729227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:40.730005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:40.730445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:40.798726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0358dca4-f3f0-4752-980a-31c2bee802ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:40.799493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0358dca4-f3f0-4752-980a-31c2bee802ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:40.806050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0358dca4-f3f0-4752-980a-31c2bee802ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:40.806582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0358dca4-f3f0-4752-980a-31c2bee802ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:40.807510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0358dca4-f3f0-4752-980a-31c2bee802ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:40.808018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0358dca4-f3f0-4752-980a-31c2bee802ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:40.862611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:40.871290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:40.872929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:40.873253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0358dca4-f3f0-4752-980a-31c2bee802ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:40.874246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c8f7df41-89a4-4b58-ac6d-2f5d3791630c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1745 microversion: 2.20 time: 0.159827 May 23 13:35:40.874803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 213/424] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:40.884383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0358dca4-f3f0-4752-980a-31c2bee802ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1131 microversion: 2.1 time: 0.090299 May 23 13:35:40.885096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 212/425] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:40 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1131 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:41.011136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-634c992a-08f3-4345-aa3e-ef9a9733ebfb tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:41.011734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-634c992a-08f3-4345-aa3e-ef9a9733ebfb tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:41.019896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-634c992a-08f3-4345-aa3e-ef9a9733ebfb tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:41.019896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-634c992a-08f3-4345-aa3e-ef9a9733ebfb tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:41.020288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-634c992a-08f3-4345-aa3e-ef9a9733ebfb tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:41.020756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-634c992a-08f3-4345-aa3e-ef9a9733ebfb tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:41.152180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-634c992a-08f3-4345-aa3e-ef9a9733ebfb tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:41.160092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-634c992a-08f3-4345-aa3e-ef9a9733ebfb tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1502 microversion: 2.1 time: 0.153065 May 23 13:35:41.160682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 214/426] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:41 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:41.418422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2a36306e-1caa-4851-8a3c-4e6772c1c0ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:41.419084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2a36306e-1caa-4851-8a3c-4e6772c1c0ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:41.430353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a36306e-1caa-4851-8a3c-4e6772c1c0ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:41.430353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a36306e-1caa-4851-8a3c-4e6772c1c0ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:41.430353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a36306e-1caa-4851-8a3c-4e6772c1c0ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:41.430353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a36306e-1caa-4851-8a3c-4e6772c1c0ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:41.556959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2a36306e-1caa-4851-8a3c-4e6772c1c0ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:41.564315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2a36306e-1caa-4851-8a3c-4e6772c1c0ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.151504 May 23 13:35:41.565591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 213/427] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:41 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:41.893740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:41.894393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:41.901064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:41.901516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:41.902292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:41.902728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:41.908384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10337faa-158b-48e8-a2e7-f3fb0a4f1a62 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:41.910302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10337faa-158b-48e8-a2e7-f3fb0a4f1a62 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:41.916710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10337faa-158b-48e8-a2e7-f3fb0a4f1a62 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:41.917167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10337faa-158b-48e8-a2e7-f3fb0a4f1a62 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:41.917942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10337faa-158b-48e8-a2e7-f3fb0a4f1a62 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:41.918382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10337faa-158b-48e8-a2e7-f3fb0a4f1a62 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:41.980452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10337faa-158b-48e8-a2e7-f3fb0a4f1a62 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:41.988984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10337faa-158b-48e8-a2e7-f3fb0a4f1a62 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1131 microversion: 2.1 time: 0.084391 May 23 13:35:41.989560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 214/428] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:41 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1131 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:42.044015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:42.052725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:42.054238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:42.055395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1a4500b9-c43f-4bc4-84c6-592b26a017e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1745 microversion: 2.20 time: 0.165748 May 23 13:35:42.055946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 215/429] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:41 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:42.177704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-89d52f86-0ee4-435f-b434-642beb3c59ad tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:42.178211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-89d52f86-0ee4-435f-b434-642beb3c59ad tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:42.184426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89d52f86-0ee4-435f-b434-642beb3c59ad tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:42.184896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89d52f86-0ee4-435f-b434-642beb3c59ad tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:42.185659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89d52f86-0ee4-435f-b434-642beb3c59ad tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:42.186092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89d52f86-0ee4-435f-b434-642beb3c59ad tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:42.319417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-89d52f86-0ee4-435f-b434-642beb3c59ad tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:42.326841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-89d52f86-0ee4-435f-b434-642beb3c59ad tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1502 microversion: 2.1 time: 0.153265 May 23 13:35:42.327391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 215/430] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:42 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:42.583140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23531b02-28ee-44d7-94d4-b46493726b9d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:42.583748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-23531b02-28ee-44d7-94d4-b46493726b9d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:42.591297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23531b02-28ee-44d7-94d4-b46493726b9d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:42.591297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23531b02-28ee-44d7-94d4-b46493726b9d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:42.592220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23531b02-28ee-44d7-94d4-b46493726b9d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:42.592686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23531b02-28ee-44d7-94d4-b46493726b9d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:42.732493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-23531b02-28ee-44d7-94d4-b46493726b9d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:42.740851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23531b02-28ee-44d7-94d4-b46493726b9d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1357 microversion: 2.1 time: 0.162544 May 23 13:35:42.741422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 216/431] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:42 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:43.006812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17f3755b-74a9-4f9c-9a9b-03a92ef25454 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:43.007358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17f3755b-74a9-4f9c-9a9b-03a92ef25454 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:43.013818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17f3755b-74a9-4f9c-9a9b-03a92ef25454 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.014277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17f3755b-74a9-4f9c-9a9b-03a92ef25454 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.015103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17f3755b-74a9-4f9c-9a9b-03a92ef25454 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.015564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17f3755b-74a9-4f9c-9a9b-03a92ef25454 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.074292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:43.074937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:43.082470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.082924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.083572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-17f3755b-74a9-4f9c-9a9b-03a92ef25454 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:43.084250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.084777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.091958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17f3755b-74a9-4f9c-9a9b-03a92ef25454 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1187 microversion: 2.1 time: 0.089479 May 23 13:35:43.092533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 216/432] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:43 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:43.106258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:43.231983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:43.239959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:43.241546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:43.242687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2660fc7-55a5-4025-9df4-e1d56b1d4514 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1745 microversion: 2.20 time: 0.173387 May 23 13:35:43.243502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 217/433] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:43 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:35:43.344695 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f69bf4ca-59d5-470d-af1a-5fdd5961178b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:43.345226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f69bf4ca-59d5-470d-af1a-5fdd5961178b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:43.351500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f69bf4ca-59d5-470d-af1a-5fdd5961178b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.351961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f69bf4ca-59d5-470d-af1a-5fdd5961178b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.354763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f69bf4ca-59d5-470d-af1a-5fdd5961178b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.354763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f69bf4ca-59d5-470d-af1a-5fdd5961178b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.484932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f69bf4ca-59d5-470d-af1a-5fdd5961178b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:43.492334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f69bf4ca-59d5-470d-af1a-5fdd5961178b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1502 microversion: 2.1 time: 0.151555 May 23 13:35:43.493187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 217/434] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:43 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:43.624215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-76236cd7-97c6-4a40-a009-77dbe89f7a83 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:43.632140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76236cd7-97c6-4a40-a009-77dbe89f7a83 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.632637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76236cd7-97c6-4a40-a009-77dbe89f7a83 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.695008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-76236cd7-97c6-4a40-a009-77dbe89f7a83 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Going to try to stop instance {{(pid=124830) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 13:35:43.759353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6cb537f-5658-4cc1-9dc7-2a71a76a1974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:43.760119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6cb537f-5658-4cc1-9dc7-2a71a76a1974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:43.767132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6cb537f-5658-4cc1-9dc7-2a71a76a1974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.767720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6cb537f-5658-4cc1-9dc7-2a71a76a1974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.769024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6cb537f-5658-4cc1-9dc7-2a71a76a1974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.769614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6cb537f-5658-4cc1-9dc7-2a71a76a1974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.903160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6cb537f-5658-4cc1-9dc7-2a71a76a1974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:43.910775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6cb537f-5658-4cc1-9dc7-2a71a76a1974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1548 microversion: 2.1 time: 0.155626 May 23 13:35:43.922936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 218/435] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:43 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:43.927252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0e684eda-b5be-4187-b15b-d6cf0e70c712 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:43.927874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0e684eda-b5be-4187-b15b-d6cf0e70c712 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:43.934028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e684eda-b5be-4187-b15b-d6cf0e70c712 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.934524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e684eda-b5be-4187-b15b-d6cf0e70c712 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:43.935325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e684eda-b5be-4187-b15b-d6cf0e70c712 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:43.935765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e684eda-b5be-4187-b15b-d6cf0e70c712 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.061157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-76236cd7-97c6-4a40-a009-77dbe89f7a83 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "POST /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/action" status: 202 len: 0 microversion: 2.1 time: 0.441401 May 23 13:35:44.066477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 218/436] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:35:43 2022] POST /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:35:44.070343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-059676dd-ac07-48cb-904e-dfcfe00d193c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:44.071073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-059676dd-ac07-48cb-904e-dfcfe00d193c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:44.071967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0e684eda-b5be-4187-b15b-d6cf0e70c712 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:44.079310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-059676dd-ac07-48cb-904e-dfcfe00d193c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.079845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-059676dd-ac07-48cb-904e-dfcfe00d193c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.080841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-059676dd-ac07-48cb-904e-dfcfe00d193c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.081701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-059676dd-ac07-48cb-904e-dfcfe00d193c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.085315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0e684eda-b5be-4187-b15b-d6cf0e70c712 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1548 microversion: 2.1 time: 0.162286 May 23 13:35:44.086189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 219/437] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:43 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:44.107670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-25d31548-eae2-4e74-ab6b-b0f1266cc960 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:44.115709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-25d31548-eae2-4e74-ab6b-b0f1266cc960 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:44.116974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-25d31548-eae2-4e74-ab6b-b0f1266cc960 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Searching by: {'deleted': False, 'project_id': '3407c9665e0448e18fd87ec20b0843e4'} {{(pid=124831) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 13:35:44.127544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25d31548-eae2-4e74-ab6b-b0f1266cc960 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.128235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25d31548-eae2-4e74-ab6b-b0f1266cc960 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.129515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25d31548-eae2-4e74-ab6b-b0f1266cc960 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.130433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25d31548-eae2-4e74-ab6b-b0f1266cc960 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.228756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.multi_cell_list [None req-25d31548-eae2-4e74-ab6b-b0f1266cc960 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 13:35:44.328243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-25d31548-eae2-4e74-ab6b-b0f1266cc960 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.228941 May 23 13:35:44.328862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 220/438] 10.222.0.70 () {58 vars in 1124 bytes} [Mon May 23 13:35:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:35:44.334426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-077e0685-83c3-42c2-84f3-ac96f2c77356 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:44.335162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-077e0685-83c3-42c2-84f3-ac96f2c77356 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:44.341445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-077e0685-83c3-42c2-84f3-ac96f2c77356 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.341895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-077e0685-83c3-42c2-84f3-ac96f2c77356 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.342707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-077e0685-83c3-42c2-84f3-ac96f2c77356 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.343143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-077e0685-83c3-42c2-84f3-ac96f2c77356 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.398210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-059676dd-ac07-48cb-904e-dfcfe00d193c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:44.406507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-059676dd-ac07-48cb-904e-dfcfe00d193c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.340218 May 23 13:35:44.410831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-077e0685-83c3-42c2-84f3-ac96f2c77356 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:44.415243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 219/439] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:44 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:44.421276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-077e0685-83c3-42c2-84f3-ac96f2c77356 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1195 microversion: 2.1 time: 0.091316 May 23 13:35:44.421734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:44.422355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:44.423158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 221/440] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:44 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1195 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:44.430180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.430897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.431856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.432550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.434726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3cfd39f0-92c9-48f4-893c-f4316cf899f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:44.435445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3cfd39f0-92c9-48f4-893c-f4316cf899f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:44.447940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cfd39f0-92c9-48f4-893c-f4316cf899f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.451209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cfd39f0-92c9-48f4-893c-f4316cf899f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.451209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cfd39f0-92c9-48f4-893c-f4316cf899f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.451209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cfd39f0-92c9-48f4-893c-f4316cf899f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.652448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3cfd39f0-92c9-48f4-893c-f4316cf899f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:44.668971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3cfd39f0-92c9-48f4-893c-f4316cf899f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1548 microversion: 2.1 time: 0.242646 May 23 13:35:44.670588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 222/441] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:44 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:44.678224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-479ddd00-060f-4e52-9778-eb8b3845910b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:44.679289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-479ddd00-060f-4e52-9778-eb8b3845910b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:44.681044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:44.691238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-479ddd00-060f-4e52-9778-eb8b3845910b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.691238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-479ddd00-060f-4e52-9778-eb8b3845910b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.691238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-479ddd00-060f-4e52-9778-eb8b3845910b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.691238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-479ddd00-060f-4e52-9778-eb8b3845910b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.701867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:44.701867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:44.701867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-de575218-95bc-4d0b-8972-a7e8c1fcd8ac tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1745 microversion: 2.20 time: 0.282621 May 23 13:35:44.702219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 220/442] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:44 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1745 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:44.959043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-3b7ab5bf-61f6-471b-9854-65c17cbac9c7 req-dfc4bd1f-1850-43a5-80c7-1f87245b751d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384389ea-0e81-4681-bab8-bac7bb161a22", "name": "network-vif-deleted", "tag": "4c62e3ce-841b-4c5a-95e9-fb578399174d"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:44.961321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-479ddd00-060f-4e52-9778-eb8b3845910b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:44.968799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3b7ab5bf-61f6-471b-9854-65c17cbac9c7 req-dfc4bd1f-1850-43a5-80c7-1f87245b751d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:44.969500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3b7ab5bf-61f6-471b-9854-65c17cbac9c7 req-dfc4bd1f-1850-43a5-80c7-1f87245b751d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:44.971300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-479ddd00-060f-4e52-9778-eb8b3845910b tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1502 microversion: 2.1 time: 0.297861 May 23 13:35:44.972046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 223/443] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:44 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:44.983003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-3b7ab5bf-61f6-471b-9854-65c17cbac9c7 req-dfc4bd1f-1850-43a5-80c7-1f87245b751d service nova] Creating event network-vif-deleted:4c62e3ce-841b-4c5a-95e9-fb578399174d for instance 384389ea-0e81-4681-bab8-bac7bb161a22 on hv-cinder-82549 May 23 13:35:44.989737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-3b7ab5bf-61f6-471b-9854-65c17cbac9c7 req-dfc4bd1f-1850-43a5-80c7-1f87245b751d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 May 23 13:35:44.990376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 221/444] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:35:45.428954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2ecbd455-41ef-4edd-a2f3-af5e4e93f98e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:45.429687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2ecbd455-41ef-4edd-a2f3-af5e4e93f98e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:45.435945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ecbd455-41ef-4edd-a2f3-af5e4e93f98e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:45.436407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ecbd455-41ef-4edd-a2f3-af5e4e93f98e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:45.437232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ecbd455-41ef-4edd-a2f3-af5e4e93f98e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:45.437699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ecbd455-41ef-4edd-a2f3-af5e4e93f98e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:45.445553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2062c46-b8bb-441c-a4bd-59c6455679e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:45.446657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c2062c46-b8bb-441c-a4bd-59c6455679e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:45.453196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2062c46-b8bb-441c-a4bd-59c6455679e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:45.453745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2062c46-b8bb-441c-a4bd-59c6455679e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:45.454625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2062c46-b8bb-441c-a4bd-59c6455679e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:45.455975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2062c46-b8bb-441c-a4bd-59c6455679e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:45.630763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c2062c46-b8bb-441c-a4bd-59c6455679e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:45.647273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c2062c46-b8bb-441c-a4bd-59c6455679e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.207022 May 23 13:35:45.648938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 222/445] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:45 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:45.722902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ecbd455-41ef-4edd-a2f3-af5e4e93f98e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:45.723751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:45.724396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:45.733387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:45.733728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2ecbd455-41ef-4edd-a2f3-af5e4e93f98e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.309226 May 23 13:35:45.734377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:45.735309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:45.735751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:45.739763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 224/446] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:45 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:45.885551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:45.894162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:45.895797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:45.896998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a92a2fa-a3de-430a-a1af-20450a559ca3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1745 microversion: 2.20 time: 0.178300 May 23 13:35:45.897598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 223/447] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:45.988672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:45.989407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:45.996413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:45.996920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:45.997698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:45.998139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:46.030774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:46.031233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:46.031690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lazy-loading 'fault' on Instance uuid 384389ea-0e81-4681-bab8-bac7bb161a22 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:35:46.073756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740cc82ff2c04228b8ba32ecc034944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3808ebec9df4a4c937ab961f3683dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:46.081927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a40ef7c9-76e4-4494-810e-9bf389a61d63 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 200 len: 1303 microversion: 2.1 time: 0.097515 May 23 13:35:46.082598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 225/448] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:45 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:46.672411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ec9b3e0-c3d5-4954-859a-bb3d2d135a6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:46.673807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ec9b3e0-c3d5-4954-859a-bb3d2d135a6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:46.681612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec9b3e0-c3d5-4954-859a-bb3d2d135a6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:46.682058 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec9b3e0-c3d5-4954-859a-bb3d2d135a6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:46.682818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec9b3e0-c3d5-4954-859a-bb3d2d135a6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:46.683517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec9b3e0-c3d5-4954-859a-bb3d2d135a6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:46.758140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-74cf7276-a881-4a0a-932e-f41b1e083457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:46.758842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-74cf7276-a881-4a0a-932e-f41b1e083457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:46.766552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:46.802943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74cf7276-a881-4a0a-932e-f41b1e083457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:46.802943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74cf7276-a881-4a0a-932e-f41b1e083457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:46.802943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74cf7276-a881-4a0a-932e-f41b1e083457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:46.802943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74cf7276-a881-4a0a-932e-f41b1e083457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:46.872152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:46.875834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ec9b3e0-c3d5-4954-859a-bb3d2d135a6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:46.893147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ec9b3e0-c3d5-4954-859a-bb3d2d135a6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.224476 May 23 13:35:46.894672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 224/449] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:46 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:46.915345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:46.916037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:46.923681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:46.924792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:46.925571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:46.942822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:47.093511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-74cf7276-a881-4a0a-932e-f41b1e083457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:47.103494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:47.108112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-74cf7276-a881-4a0a-932e-f41b1e083457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.353995 May 23 13:35:47.108726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 226/450] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:46 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:47.122236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:47.122921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] [instance: 384389ea-0e81-4681-bab8-bac7bb161a22] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:47.139648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:47.141518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:47.144389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:47.145763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:47.180630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] HTTP exception thrown: Instance 384389ea-0e81-4681-bab8-bac7bb161a22 could not be found. May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Request method failure captured: May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 HTTP/1.1 May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii41ScIre4ZNrxW7JeA4XFzze_VM2ND8MMQDpsxeV1iYuZKuXAp5vLkbj2l8qTeCGKA9yS7c4nMmlssJX6Lre-KhsDljLwpcqX4BK-yAgVsU6eU44aF039myuhpU_3oCwDeNPPtpIgF69dapJGf1sEwUSObbzHdihZzTF85YNOvZiEYc May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: b3808ebec9df4a4c937ab961f3683dda May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesActionsTest-771051636 May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:35:47.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b3808ebec9df4a4c937ab961f3683dda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b3808ebec9df4a4c937ab961f3683dda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b3808ebec9df4a4c937ab961f3683dda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b3808ebec9df4a4c937ab961f3683dda"}]}] May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesActionsTest-771051636 May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: b3808ebec9df4a4c937ab961f3683dda May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesActionsTest-771051636 May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesActionsTest-771051636-project May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 740cc82ff2c04228b8ba32ecc034944f May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesActionsTest-771051636-project May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance 384389ea-0e81-4681-bab8-bac7bb161a22 could not be found. May 23 13:35:47.188993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '384389ea-0e81-4681-bab8-bac7bb161a22'} May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384389ea-0e81-4681-bab8-bac7bb161a22 could not be found. May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:35:47.190290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384389ea-0e81-4681-bab8-bac7bb161a22 could not be found. May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384389ea-0e81-4681-bab8-bac7bb161a22 could not be found. May 23 13:35:47.192352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:35:47.196162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] Returning 404 to user: Instance 384389ea-0e81-4681-bab8-bac7bb161a22 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:35:47.199014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d22d1acc-3657-4b8a-833f-fc9dcdec0bf7 tempest-VolumesActionsTest-771051636 tempest-VolumesActionsTest-771051636-project] 10.222.0.70 "GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22" status: 404 len: 111 microversion: 2.1 time: 0.089326 May 23 13:35:47.200067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 227/451] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:47 2022] GET /compute/v2.1/servers/384389ea-0e81-4681-bab8-bac7bb161a22 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 13:35:47.236155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:47.246582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:47.249546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:47.254103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b132ee4-8ad7-45cd-9206-7e202d7f9aa5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.340244 May 23 13:35:47.258049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 225/452] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:35:47.342949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-6088aede-ffb9-44d5-829d-c107cc2a73c6 req-e5aa2f36-b6ef-426f-9fb6-014d066941f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83ea9db-9db3-48c0-83a5-c423a1151195", "tag": "fcdea6af-6005-431d-b6d7-10f18e37002a"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:47.371949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6088aede-ffb9-44d5-829d-c107cc2a73c6 req-e5aa2f36-b6ef-426f-9fb6-014d066941f4 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:47.372791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6088aede-ffb9-44d5-829d-c107cc2a73c6 req-e5aa2f36-b6ef-426f-9fb6-014d066941f4 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:47.415894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-6088aede-ffb9-44d5-829d-c107cc2a73c6 req-e5aa2f36-b6ef-426f-9fb6-014d066941f4 service nova] Creating event network-changed:fcdea6af-6005-431d-b6d7-10f18e37002a for instance f83ea9db-9db3-48c0-83a5-c423a1151195 on hv-cinder-82549 May 23 13:35:47.428501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-6088aede-ffb9-44d5-829d-c107cc2a73c6 req-e5aa2f36-b6ef-426f-9fb6-014d066941f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087810 May 23 13:35:47.430224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 228/453] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:47.917052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e44614c-6f77-464f-aa05-ae7bd0ac3c88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:47.917859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e44614c-6f77-464f-aa05-ae7bd0ac3c88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:47.922958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efa5050f-38dd-4969-b27f-6b13761c2d41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97d0c08d-8b73-4e27-b687-aa249e246ccb"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:47.926476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efa5050f-38dd-4969-b27f-6b13761c2d41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:47.937940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-38dd-4969-b27f-6b13761c2d41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:47.938793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-38dd-4969-b27f-6b13761c2d41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:47.949772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e44614c-6f77-464f-aa05-ae7bd0ac3c88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:47.950605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e44614c-6f77-464f-aa05-ae7bd0ac3c88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:47.953430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e44614c-6f77-464f-aa05-ae7bd0ac3c88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:47.955091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-38dd-4969-b27f-6b13761c2d41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:47.956395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-38dd-4969-b27f-6b13761c2d41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:47.961292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e44614c-6f77-464f-aa05-ae7bd0ac3c88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:48.209150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6e44614c-6f77-464f-aa05-ae7bd0ac3c88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:48.216448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e44614c-6f77-464f-aa05-ae7bd0ac3c88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.303431 May 23 13:35:48.221606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 226/454] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:47 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:48.237671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f071767-a651-438d-aa0a-04c364fc00c4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:48.244290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f071767-a651-438d-aa0a-04c364fc00c4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:48.251177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f071767-a651-438d-aa0a-04c364fc00c4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:48.251969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f071767-a651-438d-aa0a-04c364fc00c4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:48.254046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f071767-a651-438d-aa0a-04c364fc00c4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:48.254994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f071767-a651-438d-aa0a-04c364fc00c4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:48.489305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f071767-a651-438d-aa0a-04c364fc00c4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:48.536663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f071767-a651-438d-aa0a-04c364fc00c4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.294973 May 23 13:35:48.541980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 227/455] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:48.548833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:48.550188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:48.553836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:48.558042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:48.558816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:48.559804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:48.560441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:48.670700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:48.781525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:48.791684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:48.793498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:48.801336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7a1a3fa9-d03c-4e27-9dca-caf9fa52be4e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.252409 May 23 13:35:48.802540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 228/456] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:49.240613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cec74472-c781-415e-9e81-0e9258be1800 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:49.241406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cec74472-c781-415e-9e81-0e9258be1800 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:49.248881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cec74472-c781-415e-9e81-0e9258be1800 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:49.249618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cec74472-c781-415e-9e81-0e9258be1800 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:49.250383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cec74472-c781-415e-9e81-0e9258be1800 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:49.250989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cec74472-c781-415e-9e81-0e9258be1800 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:49.298752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efa5050f-38dd-4969-b27f-6b13761c2d41 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "POST /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.385216 May 23 13:35:49.300367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 229/457] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 13:35:47 2022] POST /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments => generated 194 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:49.443794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cec74472-c781-415e-9e81-0e9258be1800 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:49.454243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cec74472-c781-415e-9e81-0e9258be1800 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.219625 May 23 13:35:49.455311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 229/458] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:49 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:35:49.560918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f2f1d49-acdb-461f-92de-4092fe7cbdac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:49.561858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f2f1d49-acdb-461f-92de-4092fe7cbdac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:49.570293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f2f1d49-acdb-461f-92de-4092fe7cbdac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:49.571048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f2f1d49-acdb-461f-92de-4092fe7cbdac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:49.571937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f2f1d49-acdb-461f-92de-4092fe7cbdac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:49.572409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f2f1d49-acdb-461f-92de-4092fe7cbdac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:49.751913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f2f1d49-acdb-461f-92de-4092fe7cbdac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:49.760643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f2f1d49-acdb-461f-92de-4092fe7cbdac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.204796 May 23 13:35:49.761820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 230/459] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:49 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:49.829288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:49.829898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:49.838663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:49.842941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:49.842941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:49.842941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:49.991461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:50.005511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:50.005904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:50.006912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3582d420-5830-4d4a-af62-0a1054f57164 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.181495 May 23 13:35:50.007469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 230/460] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:49 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:50.478593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a6a9a1c-d8b0-46bc-b8e2-08cd29a2d904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:50.479222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a6a9a1c-d8b0-46bc-b8e2-08cd29a2d904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:50.485444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a6a9a1c-d8b0-46bc-b8e2-08cd29a2d904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:50.485900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a6a9a1c-d8b0-46bc-b8e2-08cd29a2d904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:50.487439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a6a9a1c-d8b0-46bc-b8e2-08cd29a2d904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:50.487933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a6a9a1c-d8b0-46bc-b8e2-08cd29a2d904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:50.633330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a6a9a1c-d8b0-46bc-b8e2-08cd29a2d904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:50.641070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a6a9a1c-d8b0-46bc-b8e2-08cd29a2d904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.173562 May 23 13:35:50.641639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 231/461] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:50 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:50.778610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf99da45-8501-4e5d-b1ca-f4a6827a2547 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:50.779244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf99da45-8501-4e5d-b1ca-f4a6827a2547 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:50.785933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf99da45-8501-4e5d-b1ca-f4a6827a2547 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:50.786388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf99da45-8501-4e5d-b1ca-f4a6827a2547 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:50.787151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf99da45-8501-4e5d-b1ca-f4a6827a2547 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:50.787591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf99da45-8501-4e5d-b1ca-f4a6827a2547 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:50.925278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bf99da45-8501-4e5d-b1ca-f4a6827a2547 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:50.933310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf99da45-8501-4e5d-b1ca-f4a6827a2547 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.158600 May 23 13:35:50.933871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 231/462] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:51.031185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:51.031730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:51.038784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:51.039236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:51.040012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:51.040455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:51.201703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:51.211114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:51.212735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:51.214007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1010d4cf-c22d-4874-9c15-a7ba1e79762b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.187213 May 23 13:35:51.214768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 232/463] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:51 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:35:51.660193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8caca452-55c6-438f-a833-2df9e3b6865f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:51.661157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8caca452-55c6-438f-a833-2df9e3b6865f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:51.667446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8caca452-55c6-438f-a833-2df9e3b6865f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:51.667887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8caca452-55c6-438f-a833-2df9e3b6865f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:51.668672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8caca452-55c6-438f-a833-2df9e3b6865f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:51.669101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8caca452-55c6-438f-a833-2df9e3b6865f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:51.832133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8caca452-55c6-438f-a833-2df9e3b6865f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:51.843552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8caca452-55c6-438f-a833-2df9e3b6865f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.189204 May 23 13:35:51.844270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 232/464] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:51 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:51.951927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01a3fac6-d648-412f-ae4e-ef49de59e5f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:51.952554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-01a3fac6-d648-412f-ae4e-ef49de59e5f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:51.959817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01a3fac6-d648-412f-ae4e-ef49de59e5f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:51.960305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01a3fac6-d648-412f-ae4e-ef49de59e5f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:51.961122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01a3fac6-d648-412f-ae4e-ef49de59e5f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:51.961903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01a3fac6-d648-412f-ae4e-ef49de59e5f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:52.138218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-01a3fac6-d648-412f-ae4e-ef49de59e5f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:52.147009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01a3fac6-d648-412f-ae4e-ef49de59e5f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.199368 May 23 13:35:52.147831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 233/465] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:51 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:52.233950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:52.234642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:52.241482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:52.242307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:52.243420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:52.243924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:52.403277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:52.406910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:52.412922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:52.414671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:52.416131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a173dcc4-6ceb-4c64-8750-a7519065245c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.186229 May 23 13:35:52.418611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 233/466] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:52 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:52.861269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6ec32680-58b0-42a8-86e6-94668e1456ad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:52.862572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6ec32680-58b0-42a8-86e6-94668e1456ad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:52.869518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ec32680-58b0-42a8-86e6-94668e1456ad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:52.870053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ec32680-58b0-42a8-86e6-94668e1456ad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:52.870900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ec32680-58b0-42a8-86e6-94668e1456ad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:52.871407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ec32680-58b0-42a8-86e6-94668e1456ad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:53.036997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6ec32680-58b0-42a8-86e6-94668e1456ad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:53.044796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6ec32680-58b0-42a8-86e6-94668e1456ad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.187124 May 23 13:35:53.054405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 234/467] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:52 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:53.167802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fc226e28-64f7-4bf5-b391-59e1b368d3cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:53.168546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fc226e28-64f7-4bf5-b391-59e1b368d3cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:53.177846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc226e28-64f7-4bf5-b391-59e1b368d3cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:53.178630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc226e28-64f7-4bf5-b391-59e1b368d3cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:53.179712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc226e28-64f7-4bf5-b391-59e1b368d3cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:53.180523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc226e28-64f7-4bf5-b391-59e1b368d3cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:53.345265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc226e28-64f7-4bf5-b391-59e1b368d3cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:53.354729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fc226e28-64f7-4bf5-b391-59e1b368d3cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.192127 May 23 13:35:53.357398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 234/468] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:53 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:53.445560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:53.446343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:53.464523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:53.465181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:53.466086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:53.467719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:53.636011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:53.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:53.651060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:53.663367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d2bef0a-fe2a-4a24-b3b8-dfda27ea5541 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.223855 May 23 13:35:53.665911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 235/469] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:53 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:54.062156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-40428380-8644-4357-a40e-32b85b534fc1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:54.062676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-40428380-8644-4357-a40e-32b85b534fc1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:54.069200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40428380-8644-4357-a40e-32b85b534fc1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:54.069643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40428380-8644-4357-a40e-32b85b534fc1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:54.070391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40428380-8644-4357-a40e-32b85b534fc1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:54.070829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40428380-8644-4357-a40e-32b85b534fc1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:54.213121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40428380-8644-4357-a40e-32b85b534fc1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:54.221652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-40428380-8644-4357-a40e-32b85b534fc1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.163358 May 23 13:35:54.222228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 235/470] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:54 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:54.378992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ac9cf139-0178-48aa-9e48-006fd80adf75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:54.379606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ac9cf139-0178-48aa-9e48-006fd80adf75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:54.382140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:54.387157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac9cf139-0178-48aa-9e48-006fd80adf75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:54.387682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac9cf139-0178-48aa-9e48-006fd80adf75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:54.388351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac9cf139-0178-48aa-9e48-006fd80adf75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:54.388844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac9cf139-0178-48aa-9e48-006fd80adf75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:54.544812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ac9cf139-0178-48aa-9e48-006fd80adf75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:54.555222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ac9cf139-0178-48aa-9e48-006fd80adf75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.180641 May 23 13:35:54.556150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 236/471] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:54 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:54.682399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:54.683015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:54.690696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:54.695620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:54.695620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:54.695620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:54.876305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:54.886219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:54.888055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:54.889370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2324b996-5099-46d7-870e-dcd9b6d9bb00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.211011 May 23 13:35:54.890011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 236/472] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:54 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:35:55.241274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-760f01cf-3901-4094-af3e-ffb997614436 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:55.242316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-760f01cf-3901-4094-af3e-ffb997614436 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:55.250766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-760f01cf-3901-4094-af3e-ffb997614436 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:55.251596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-760f01cf-3901-4094-af3e-ffb997614436 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:55.253708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-760f01cf-3901-4094-af3e-ffb997614436 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:55.254382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-760f01cf-3901-4094-af3e-ffb997614436 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:55.453653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-760f01cf-3901-4094-af3e-ffb997614436 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:55.464877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-760f01cf-3901-4094-af3e-ffb997614436 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.229398 May 23 13:35:55.467679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 237/473] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:55 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:55.573831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2ef95f5-8582-4050-9b92-f0dc8979a246 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:55.575892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c2ef95f5-8582-4050-9b92-f0dc8979a246 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:55.585536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2ef95f5-8582-4050-9b92-f0dc8979a246 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:55.586491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2ef95f5-8582-4050-9b92-f0dc8979a246 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:55.587521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2ef95f5-8582-4050-9b92-f0dc8979a246 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:55.588162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2ef95f5-8582-4050-9b92-f0dc8979a246 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:55.785861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c2ef95f5-8582-4050-9b92-f0dc8979a246 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:55.795776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c2ef95f5-8582-4050-9b92-f0dc8979a246 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.226026 May 23 13:35:55.797360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 237/474] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:55 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:55.912956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:55.913577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:55.921638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:55.922849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:55.922980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:55.923360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:56.104933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:56.116729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:56.118478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:56.119889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8139f2bb-8120-496b-bbc5-5f12f006b870 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.213137 May 23 13:35:56.120514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 238/475] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:55 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:56.483385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b49a8810-85ab-4c97-80f1-b17eece2d546 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:56.484149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b49a8810-85ab-4c97-80f1-b17eece2d546 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:56.495739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49a8810-85ab-4c97-80f1-b17eece2d546 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:56.497152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49a8810-85ab-4c97-80f1-b17eece2d546 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:56.497931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49a8810-85ab-4c97-80f1-b17eece2d546 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:56.498425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49a8810-85ab-4c97-80f1-b17eece2d546 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:56.710789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b49a8810-85ab-4c97-80f1-b17eece2d546 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:56.725818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b49a8810-85ab-4c97-80f1-b17eece2d546 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.246171 May 23 13:35:56.726726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 238/476] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:56 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:56.820330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b81d4ec8-f13d-4b2c-861e-cdcd7929c206 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:56.821622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b81d4ec8-f13d-4b2c-861e-cdcd7929c206 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:56.829813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b81d4ec8-f13d-4b2c-861e-cdcd7929c206 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:56.830906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b81d4ec8-f13d-4b2c-861e-cdcd7929c206 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:56.832156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b81d4ec8-f13d-4b2c-861e-cdcd7929c206 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:56.832942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b81d4ec8-f13d-4b2c-861e-cdcd7929c206 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:56.998290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b81d4ec8-f13d-4b2c-861e-cdcd7929c206 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:57.020818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b81d4ec8-f13d-4b2c-861e-cdcd7929c206 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.205346 May 23 13:35:57.021568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 239/477] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:56 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:57.140381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:57.141158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:57.169727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d851506e-2b68-4c68-abd2-b2dc16fff30e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: .version_select at 0x7effb1ddce50>, body: {"keypair": {"name": "tempest-keypair-835842796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyCPBopMdc+9nyBbox2Aybi/ujeLp64ePbzDfkmr9yj+nQg2fi/nrGo9rs70Mwjcv6mSFpwJnFmG7tYLZAHA7Fem0y4d3c7QJ3CBxNllOKOiVkSkBKM8RfgBwC5Y8FtDA=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:35:57.177957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:57.179697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:57.184084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:57.184835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:57.209453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-d851506e-2b68-4c68-abd2-b2dc16fff30e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for project 7649fa9a0ae4411aabf060f99e691520. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:35:57.218090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-d851506e-2b68-4c68-abd2-b2dc16fff30e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for user cf30fa512142489a8dea40ce426a5f36 and project 7649fa9a0ae4411aabf060f99e691520. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:35:57.324726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d851506e-2b68-4c68-abd2-b2dc16fff30e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159211 May 23 13:35:57.329550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 240/478] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 13:35:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:35:57.457653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:57.472116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:57.474783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:57.476431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1ba8ac76-13b9-491a-b444-f1bd09a81835 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.341364 May 23 13:35:57.488895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 239/479] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:57 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:57.746802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-79ce63ee-cfb4-445f-81d1-957a366f9e2f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:57.747466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-79ce63ee-cfb4-445f-81d1-957a366f9e2f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:57.764393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79ce63ee-cfb4-445f-81d1-957a366f9e2f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:57.764878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79ce63ee-cfb4-445f-81d1-957a366f9e2f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:57.765806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79ce63ee-cfb4-445f-81d1-957a366f9e2f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:57.766119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79ce63ee-cfb4-445f-81d1-957a366f9e2f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:58.040019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8548ab6a-d364-4e56-9c8c-7d8335904a8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:58.041284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8548ab6a-d364-4e56-9c8c-7d8335904a8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:58.047847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8548ab6a-d364-4e56-9c8c-7d8335904a8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:58.052685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8548ab6a-d364-4e56-9c8c-7d8335904a8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:58.053702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8548ab6a-d364-4e56-9c8c-7d8335904a8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:58.054280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8548ab6a-d364-4e56-9c8c-7d8335904a8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:58.353967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8548ab6a-d364-4e56-9c8c-7d8335904a8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:58.392033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8548ab6a-d364-4e56-9c8c-7d8335904a8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.339550 May 23 13:35:58.418966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 240/480] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:58 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:58.499429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:58.501723 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:58.511711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:58.512623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:58.513670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:58.514333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:58.555683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-79ce63ee-cfb4-445f-81d1-957a366f9e2f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:58.589378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-79ce63ee-cfb4-445f-81d1-957a366f9e2f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.846313 May 23 13:35:58.590349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 241/481] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:57 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:58.722890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:58.742546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:58.744922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:58.747041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-09622553-aa16-45c7-a25a-d426fa9ae041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.254480 May 23 13:35:58.748123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 241/482] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:35:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:35:58.909555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a029a64-b24c-4fd8-9380-9475cc125884 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:58.910660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a029a64-b24c-4fd8-9380-9475cc125884 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:58.923191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a029a64-b24c-4fd8-9380-9475cc125884 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:58.925318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a029a64-b24c-4fd8-9380-9475cc125884 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:58.926763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a029a64-b24c-4fd8-9380-9475cc125884 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:58.928550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a029a64-b24c-4fd8-9380-9475cc125884 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:58.969128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a029a64-b24c-4fd8-9380-9475cc125884 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:35:59.206782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:35:59.421495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97d4e1c9-4211-4242-85a1-ce8f9ebcd73f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:59.422885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97d4e1c9-4211-4242-85a1-ce8f9ebcd73f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:59.451155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97d4e1c9-4211-4242-85a1-ce8f9ebcd73f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:59.460258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97d4e1c9-4211-4242-85a1-ce8f9ebcd73f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:59.473099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97d4e1c9-4211-4242-85a1-ce8f9ebcd73f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:59.473935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97d4e1c9-4211-4242-85a1-ce8f9ebcd73f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:59.545094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a029a64-b24c-4fd8-9380-9475cc125884 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 204 len: 0 microversion: 2.1 time: 0.640492 May 23 13:35:59.553119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 242/483] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:35:58 2022] DELETE /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 13:35:59.569515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-06701be8-c322-4d10-bdea-0474a8072418 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:59.573068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-06701be8-c322-4d10-bdea-0474a8072418 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:35:59.622626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06701be8-c322-4d10-bdea-0474a8072418 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:59.623827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06701be8-c322-4d10-bdea-0474a8072418 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:59.625330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06701be8-c322-4d10-bdea-0474a8072418 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:35:59.626093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06701be8-c322-4d10-bdea-0474a8072418 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:35:59.927959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97d4e1c9-4211-4242-85a1-ce8f9ebcd73f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:35:59.956273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97d4e1c9-4211-4242-85a1-ce8f9ebcd73f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.540467 May 23 13:35:59.957381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 242/484] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:59 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:35:59.988513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-653c3bc7-9b0e-4402-914a-e6a5313b6109 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:35:59.989670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-653c3bc7-9b0e-4402-914a-e6a5313b6109 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:00.008450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653c3bc7-9b0e-4402-914a-e6a5313b6109 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:00.011539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653c3bc7-9b0e-4402-914a-e6a5313b6109 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:00.012342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653c3bc7-9b0e-4402-914a-e6a5313b6109 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:00.012867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653c3bc7-9b0e-4402-914a-e6a5313b6109 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:00.042129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-06701be8-c322-4d10-bdea-0474a8072418 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:00.051365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-06701be8-c322-4d10-bdea-0474a8072418 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1513 microversion: 2.1 time: 0.493785 May 23 13:36:00.057141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 243/485] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:59 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1513 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:00.066577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:00.081612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:00.091745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:00.092642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:00.094080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:00.101710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:00.293041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-653c3bc7-9b0e-4402-914a-e6a5313b6109 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:00.319223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-653c3bc7-9b0e-4402-914a-e6a5313b6109 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.345865 May 23 13:36:00.330506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 243/486] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:35:59 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:00.387378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:00.400222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:00.402664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:00.404322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3b3f8996-ac34-44f2-beff-094b58e3d3f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.344356 May 23 13:36:00.405316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 244/487] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:00.999748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6c791576-cd85-48ac-8ed9-442e53b9777e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:01.000388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6c791576-cd85-48ac-8ed9-442e53b9777e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:01.007612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c791576-cd85-48ac-8ed9-442e53b9777e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:01.008054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c791576-cd85-48ac-8ed9-442e53b9777e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:01.009377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c791576-cd85-48ac-8ed9-442e53b9777e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:01.009975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c791576-cd85-48ac-8ed9-442e53b9777e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:01.082181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6e821747-bac4-45a7-9403-9aefb788c67f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:01.083577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6e821747-bac4-45a7-9403-9aefb788c67f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:01.097329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e821747-bac4-45a7-9403-9aefb788c67f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:01.097781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e821747-bac4-45a7-9403-9aefb788c67f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:01.098560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e821747-bac4-45a7-9403-9aefb788c67f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:01.099019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e821747-bac4-45a7-9403-9aefb788c67f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:01.173776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6c791576-cd85-48ac-8ed9-442e53b9777e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:01.187327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6c791576-cd85-48ac-8ed9-442e53b9777e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1722 microversion: 2.1 time: 0.213319 May 23 13:36:01.187327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 244/488] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:00 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:01.263190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e821747-bac4-45a7-9403-9aefb788c67f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:01.271051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6e821747-bac4-45a7-9403-9aefb788c67f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1513 microversion: 2.1 time: 0.193820 May 23 13:36:01.271629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 245/489] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:01 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:01.343374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e85ca7dd-c5f5-4e8b-aad7-a282cf5c9a3c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:01.347409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e85ca7dd-c5f5-4e8b-aad7-a282cf5c9a3c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:01.366439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e85ca7dd-c5f5-4e8b-aad7-a282cf5c9a3c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:01.367436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e85ca7dd-c5f5-4e8b-aad7-a282cf5c9a3c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:01.369134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e85ca7dd-c5f5-4e8b-aad7-a282cf5c9a3c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:01.370651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e85ca7dd-c5f5-4e8b-aad7-a282cf5c9a3c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:01.444405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:01.445336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:01.453120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:01.453971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:01.455894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:01.456701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:01.582909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e85ca7dd-c5f5-4e8b-aad7-a282cf5c9a3c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:01.594456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e85ca7dd-c5f5-4e8b-aad7-a282cf5c9a3c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1273 microversion: 2.1 time: 0.255170 May 23 13:36:01.599429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 245/490] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:01 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:01.654877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:01.669789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:01.681369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:01.681369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92ee32c8-db2e-4fc6-926e-0a84042176ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.235095 May 23 13:36:01.685563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 246/491] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:01 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:02.213905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-906698d2-d358-4a6e-917d-562733b6c384 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:02.213905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-906698d2-d358-4a6e-917d-562733b6c384 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:02.229737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-906698d2-d358-4a6e-917d-562733b6c384 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:02.230106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-906698d2-d358-4a6e-917d-562733b6c384 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:02.230889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-906698d2-d358-4a6e-917d-562733b6c384 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:02.231327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-906698d2-d358-4a6e-917d-562733b6c384 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:02.288558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9c8d4c4-60e1-403a-9e82-f81f3fbc0280 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:02.289200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9c8d4c4-60e1-403a-9e82-f81f3fbc0280 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:02.296516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c8d4c4-60e1-403a-9e82-f81f3fbc0280 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:02.297007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c8d4c4-60e1-403a-9e82-f81f3fbc0280 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:02.297801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c8d4c4-60e1-403a-9e82-f81f3fbc0280 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:02.298231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c8d4c4-60e1-403a-9e82-f81f3fbc0280 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:02.370679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-906698d2-d358-4a6e-917d-562733b6c384 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:02.379287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-906698d2-d358-4a6e-917d-562733b6c384 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1699 microversion: 2.1 time: 0.181330 May 23 13:36:02.380028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 246/492] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:02 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1699 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:02.385230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-766175828", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ebb3f7b-57db-46b5-ba41-00b71beb6e1e"}], "security_groups": [{"name": "tempest-securitygroup--1734081151"}], "key_name": "tempest-keypair-835842796", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:02.442552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d9c8d4c4-60e1-403a-9e82-f81f3fbc0280 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:02.451886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9c8d4c4-60e1-403a-9e82-f81f3fbc0280 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1513 microversion: 2.1 time: 0.167885 May 23 13:36:02.452786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 247/493] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:02 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:02.458528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb026e7d-b9ad-49af-ab76-a4f49138062c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:02.464942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb026e7d-b9ad-49af-ab76-a4f49138062c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:02.465924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb026e7d-b9ad-49af-ab76-a4f49138062c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:02.537472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb026e7d-b9ad-49af-ab76-a4f49138062c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Going to try to start instance {{(pid=124831) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 13:36:02.573532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] validate_networks() for [('2ebb3f7b-57db-46b5-ba41-00b71beb6e1e', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:36:02.782425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb026e7d-b9ad-49af-ab76-a4f49138062c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "POST /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/action" status: 202 len: 0 microversion: 2.1 time: 0.328135 May 23 13:36:02.784454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 248/494] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:36:02 2022] POST /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:36:02.792322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e26edc89-6669-4b68-988a-cdbdbb42552c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:02.793558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e26edc89-6669-4b68-988a-cdbdbb42552c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:02.823773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e26edc89-6669-4b68-988a-cdbdbb42552c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:02.824238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e26edc89-6669-4b68-988a-cdbdbb42552c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:02.825112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e26edc89-6669-4b68-988a-cdbdbb42552c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:02.825557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e26edc89-6669-4b68-988a-cdbdbb42552c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:03.044295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e26edc89-6669-4b68-988a-cdbdbb42552c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:03.056328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e26edc89-6669-4b68-988a-cdbdbb42552c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.269349 May 23 13:36:03.057286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 249/495] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:02 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:03.065906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:03.068134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:03.073722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:03.074255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:03.077382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:03.077930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:03.106093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:36:03.106529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:36:03.107011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:36:03.107612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:36:03.108034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:36:03.124217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:03.124792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:03.126047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:03.126530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:03.154477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for project 7649fa9a0ae4411aabf060f99e691520. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:36:03.164455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for user cf30fa512142489a8dea40ce426a5f36 and project 7649fa9a0ae4411aabf060f99e691520. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:36:03.195829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:36:03.198532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:36:03.245968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:03.255853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:03.257583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:03.258779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a0bd458-7124-46ab-953f-27d7f5eef4eb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1740 microversion: 2.20 time: 0.200433 May 23 13:36:03.259650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 250/496] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:03 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:03.264525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-630c388a-67d5-45e1-809a-e45b3c6cb972 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:03.265171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-630c388a-67d5-45e1-809a-e45b3c6cb972 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:03.273048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-630c388a-67d5-45e1-809a-e45b3c6cb972 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:03.273518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-630c388a-67d5-45e1-809a-e45b3c6cb972 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:03.274319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-630c388a-67d5-45e1-809a-e45b3c6cb972 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:03.275087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-630c388a-67d5-45e1-809a-e45b3c6cb972 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:03.361800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f54e95f7-d893-4ee1-9a37-f7ae16802341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.979810 May 23 13:36:03.374402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 247/497] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:36:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 13:36:03.380812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d8031487-62c6-4e11-973e-f83fb6bddb23 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:03.381815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d8031487-62c6-4e11-973e-f83fb6bddb23 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:03.461510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d8031487-62c6-4e11-973e-f83fb6bddb23 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:03.469181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d8031487-62c6-4e11-973e-f83fb6bddb23 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1240 microversion: 2.1 time: 0.093381 May 23 13:36:03.469972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 248/498] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:03 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:03.472822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-630c388a-67d5-45e1-809a-e45b3c6cb972 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:03.483490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-630c388a-67d5-45e1-809a-e45b3c6cb972 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1708 microversion: 2.1 time: 0.222782 May 23 13:36:03.484308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 251/499] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:03 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1708 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:03.494138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f1a39a7-6328-4bd5-a2f7-a0e679b799b7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:03.494138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f1a39a7-6328-4bd5-a2f7-a0e679b799b7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:03.495797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1a39a7-6328-4bd5-a2f7-a0e679b799b7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:03.496353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1a39a7-6328-4bd5-a2f7-a0e679b799b7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:03.497297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1a39a7-6328-4bd5-a2f7-a0e679b799b7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:03.498779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1a39a7-6328-4bd5-a2f7-a0e679b799b7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:03.674632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f1a39a7-6328-4bd5-a2f7-a0e679b799b7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:03.684204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f1a39a7-6328-4bd5-a2f7-a0e679b799b7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1513 microversion: 2.1 time: 0.206259 May 23 13:36:03.685638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 249/500] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:03 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:04.075625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c19199a6-d5d2-4a90-a2c7-a073fd3a885f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:04.076499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c19199a6-d5d2-4a90-a2c7-a073fd3a885f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:04.084505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c19199a6-d5d2-4a90-a2c7-a073fd3a885f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.085157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c19199a6-d5d2-4a90-a2c7-a073fd3a885f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.086209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c19199a6-d5d2-4a90-a2c7-a073fd3a885f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.086790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c19199a6-d5d2-4a90-a2c7-a073fd3a885f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.278681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c19199a6-d5d2-4a90-a2c7-a073fd3a885f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:04.278850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:04.279438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:04.290396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c19199a6-d5d2-4a90-a2c7-a073fd3a885f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.217235 May 23 13:36:04.291833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 252/501] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:04 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:04.303949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.304421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.305233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.305675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.488981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-601f0c20-6883-488b-9c6b-8b05b37b7315 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:04.489955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:04.490983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-601f0c20-6883-488b-9c6b-8b05b37b7315 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:04.500337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:04.501246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-601f0c20-6883-488b-9c6b-8b05b37b7315 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.502293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-601f0c20-6883-488b-9c6b-8b05b37b7315 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.502644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:04.503494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-601f0c20-6883-488b-9c6b-8b05b37b7315 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.504167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-601f0c20-6883-488b-9c6b-8b05b37b7315 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.504298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3c87f4f0-fb4f-4408-a0fb-37e13a2b1013 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1722 microversion: 2.20 time: 0.229189 May 23 13:36:04.505236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 250/502] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:04 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:04.511966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8efb5735-d781-40a7-93cc-708d03506f8b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:04.512751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8efb5735-d781-40a7-93cc-708d03506f8b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:04.519622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8efb5735-d781-40a7-93cc-708d03506f8b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.520188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8efb5735-d781-40a7-93cc-708d03506f8b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.521638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8efb5735-d781-40a7-93cc-708d03506f8b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.521638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8efb5735-d781-40a7-93cc-708d03506f8b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.587355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-601f0c20-6883-488b-9c6b-8b05b37b7315 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:04.597130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-601f0c20-6883-488b-9c6b-8b05b37b7315 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1244 microversion: 2.1 time: 0.113310 May 23 13:36:04.598419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 253/503] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:04 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1244 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:04.685199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8efb5735-d781-40a7-93cc-708d03506f8b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:04.703019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0fe3ca43-5177-4e50-8024-460a08ca4bcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:04.703862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0fe3ca43-5177-4e50-8024-460a08ca4bcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:04.704613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8efb5735-d781-40a7-93cc-708d03506f8b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1708 microversion: 2.1 time: 0.198242 May 23 13:36:04.715331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 251/504] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:04 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1708 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:04.731713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fe3ca43-5177-4e50-8024-460a08ca4bcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.732278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fe3ca43-5177-4e50-8024-460a08ca4bcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.733156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fe3ca43-5177-4e50-8024-460a08ca4bcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:04.733598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fe3ca43-5177-4e50-8024-460a08ca4bcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:04.890352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0fe3ca43-5177-4e50-8024-460a08ca4bcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:04.902172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0fe3ca43-5177-4e50-8024-460a08ca4bcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1513 microversion: 2.1 time: 0.203043 May 23 13:36:04.902836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 254/505] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:04 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:05.311168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c3e5381-d35c-464c-9390-fd0643c1ff28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:05.312072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c3e5381-d35c-464c-9390-fd0643c1ff28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:05.320266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c3e5381-d35c-464c-9390-fd0643c1ff28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.321282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c3e5381-d35c-464c-9390-fd0643c1ff28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:05.322376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c3e5381-d35c-464c-9390-fd0643c1ff28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.323026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c3e5381-d35c-464c-9390-fd0643c1ff28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:05.347067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:05.483909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3c3e5381-d35c-464c-9390-fd0643c1ff28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:05.493462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3c3e5381-d35c-464c-9390-fd0643c1ff28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.189306 May 23 13:36:05.495088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 252/506] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:05 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:05.527333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:05.528042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:05.537654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.538439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:05.539397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.540126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:05.619703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4afba2bd-08eb-4e93-be5e-b3666b66448d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:05.620680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4afba2bd-08eb-4e93-be5e-b3666b66448d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:05.627556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4afba2bd-08eb-4e93-be5e-b3666b66448d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.628043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4afba2bd-08eb-4e93-be5e-b3666b66448d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:05.628967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4afba2bd-08eb-4e93-be5e-b3666b66448d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.629583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4afba2bd-08eb-4e93-be5e-b3666b66448d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:05.699958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4afba2bd-08eb-4e93-be5e-b3666b66448d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:05.709728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4afba2bd-08eb-4e93-be5e-b3666b66448d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1244 microversion: 2.1 time: 0.097537 May 23 13:36:05.710907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 253/507] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:05 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1244 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:05.726066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-11e03260-f30f-4372-8e06-6c34792e9515 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:05.726696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-11e03260-f30f-4372-8e06-6c34792e9515 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:05.729850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:05.737487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11e03260-f30f-4372-8e06-6c34792e9515 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.737930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11e03260-f30f-4372-8e06-6c34792e9515 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:05.739413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11e03260-f30f-4372-8e06-6c34792e9515 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.739912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11e03260-f30f-4372-8e06-6c34792e9515 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:05.750775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:05.753339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:05.754856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e67aa9a9-4951-4ea1-bf30-f4a4ee754a23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1722 microversion: 2.20 time: 0.231339 May 23 13:36:05.759173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 255/508] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:05 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:05.922760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-11e03260-f30f-4372-8e06-6c34792e9515 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:05.932320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-11e03260-f30f-4372-8e06-6c34792e9515 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1708 microversion: 2.1 time: 0.212998 May 23 13:36:05.934227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 254/509] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:05 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1708 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:05.943083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-76c00f43-7c28-4af0-9f25-797c772351ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:05.945338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-76c00f43-7c28-4af0-9f25-797c772351ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:05.950728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76c00f43-7c28-4af0-9f25-797c772351ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.951196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76c00f43-7c28-4af0-9f25-797c772351ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:05.952025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76c00f43-7c28-4af0-9f25-797c772351ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:05.952483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76c00f43-7c28-4af0-9f25-797c772351ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:06.097948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-76c00f43-7c28-4af0-9f25-797c772351ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:06.106371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-76c00f43-7c28-4af0-9f25-797c772351ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1513 microversion: 2.1 time: 0.167252 May 23 13:36:06.117194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 256/510] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:05 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:06.511703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb2de242-b287-4603-896a-1836a58a300d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:06.512303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb2de242-b287-4603-896a-1836a58a300d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:06.535151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2de242-b287-4603-896a-1836a58a300d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:06.537267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2de242-b287-4603-896a-1836a58a300d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:06.538303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2de242-b287-4603-896a-1836a58a300d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:06.541023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb2de242-b287-4603-896a-1836a58a300d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:06.727832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-79d02471-b776-42a1-803a-7e88a1377dc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:06.728382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-79d02471-b776-42a1-803a-7e88a1377dc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:06.739856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79d02471-b776-42a1-803a-7e88a1377dc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:06.740324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79d02471-b776-42a1-803a-7e88a1377dc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:06.744148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79d02471-b776-42a1-803a-7e88a1377dc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:06.744739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79d02471-b776-42a1-803a-7e88a1377dc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:06.853991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bb2de242-b287-4603-896a-1836a58a300d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:06.866785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb2de242-b287-4603-896a-1836a58a300d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.358240 May 23 13:36:06.868076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 255/511] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:06 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:06.882805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:06.888208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:06.891897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:06.892835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:06.894023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:06.894569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:06.896019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-79d02471-b776-42a1-803a-7e88a1377dc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:06.909166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-79d02471-b776-42a1-803a-7e88a1377dc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1244 microversion: 2.1 time: 0.183887 May 23 13:36:06.914094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 257/512] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:06 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1244 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:06.945193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-f57b4f24-070c-447d-9217-be3736531955 req-dae90f1e-6671-4a50-a0d9-04dba0bfa2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d8fc5f-0889-4ea2-942c-90bde9a763c4", "name": "network-vif-unplugged", "status": "completed", "tag": "83142355-7e3c-401f-948d-197d0ec1724e"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:06.959458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f57b4f24-070c-447d-9217-be3736531955 req-dae90f1e-6671-4a50-a0d9-04dba0bfa2ac service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:06.962506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f57b4f24-070c-447d-9217-be3736531955 req-dae90f1e-6671-4a50-a0d9-04dba0bfa2ac service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:06.992193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-f57b4f24-070c-447d-9217-be3736531955 req-dae90f1e-6671-4a50-a0d9-04dba0bfa2ac service nova] Creating event network-vif-unplugged:83142355-7e3c-401f-948d-197d0ec1724e for instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 on hv-cinder-82549 May 23 13:36:07.001016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-f57b4f24-070c-447d-9217-be3736531955 req-dae90f1e-6671-4a50-a0d9-04dba0bfa2ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061100 May 23 13:36:07.004352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 258/513] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:36:07.011695 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7758070c-b705-4ce6-a5df-783bfa869505 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:07.019241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7758070c-b705-4ce6-a5df-783bfa869505 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:07.034346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7758070c-b705-4ce6-a5df-783bfa869505 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:07.037305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7758070c-b705-4ce6-a5df-783bfa869505 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:07.038611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7758070c-b705-4ce6-a5df-783bfa869505 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:07.041254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7758070c-b705-4ce6-a5df-783bfa869505 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:07.048048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:07.233826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:07.377680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7758070c-b705-4ce6-a5df-783bfa869505 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:07.389919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7758070c-b705-4ce6-a5df-783bfa869505 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1708 microversion: 2.1 time: 0.384061 May 23 13:36:07.399530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 259/514] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:07 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1708 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:07.399928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0fa57e3f-e338-40b3-9c9b-fc87fd1eadb7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:07.400468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0fa57e3f-e338-40b3-9c9b-fc87fd1eadb7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:07.417169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fa57e3f-e338-40b3-9c9b-fc87fd1eadb7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:07.417811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fa57e3f-e338-40b3-9c9b-fc87fd1eadb7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:07.418610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fa57e3f-e338-40b3-9c9b-fc87fd1eadb7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:07.419052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fa57e3f-e338-40b3-9c9b-fc87fd1eadb7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:07.568339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0fa57e3f-e338-40b3-9c9b-fc87fd1eadb7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:07.576893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0fa57e3f-e338-40b3-9c9b-fc87fd1eadb7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1471 microversion: 2.1 time: 0.185122 May 23 13:36:07.591825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 260/515] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:07 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:07.697473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:07.728934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:07.728934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:07.728934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-153dcd46-f6f4-4d97-99f0-192e2810a557 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1722 microversion: 2.20 time: 0.846510 May 23 13:36:07.729751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-0df4a7b3-302e-4397-88d8-fca26bd6e01d req-c74c89f3-9053-4041-bc73-cb65590934ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d8fc5f-0889-4ea2-942c-90bde9a763c4", "name": "network-vif-deleted", "tag": "83142355-7e3c-401f-948d-197d0ec1724e"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:07.733406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 256/516] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:06 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1722 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:07.768817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-0df4a7b3-302e-4397-88d8-fca26bd6e01d req-c74c89f3-9053-4041-bc73-cb65590934ba service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:07.769176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-0df4a7b3-302e-4397-88d8-fca26bd6e01d req-c74c89f3-9053-4041-bc73-cb65590934ba service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:07.802824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-0df4a7b3-302e-4397-88d8-fca26bd6e01d req-c74c89f3-9053-4041-bc73-cb65590934ba service nova] Creating event network-vif-deleted:83142355-7e3c-401f-948d-197d0ec1724e for instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 on hv-cinder-82549 May 23 13:36:07.810883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-0df4a7b3-302e-4397-88d8-fca26bd6e01d req-c74c89f3-9053-4041-bc73-cb65590934ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090459 May 23 13:36:07.811798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 261/517] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:36:07.887017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a6028a84-1ec9-4e13-801e-9b19f34036c5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:07.887931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a6028a84-1ec9-4e13-801e-9b19f34036c5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:07.903996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6028a84-1ec9-4e13-801e-9b19f34036c5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:07.905492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6028a84-1ec9-4e13-801e-9b19f34036c5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:07.906901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6028a84-1ec9-4e13-801e-9b19f34036c5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:07.907509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6028a84-1ec9-4e13-801e-9b19f34036c5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:07.932137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01a844d6-f733-45d4-a413-c40e296c81cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:07.934149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-01a844d6-f733-45d4-a413-c40e296c81cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:07.957842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01a844d6-f733-45d4-a413-c40e296c81cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:07.966917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01a844d6-f733-45d4-a413-c40e296c81cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:07.975196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01a844d6-f733-45d4-a413-c40e296c81cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:07.975760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01a844d6-f733-45d4-a413-c40e296c81cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.144625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-01a844d6-f733-45d4-a413-c40e296c81cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:08.156322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01a844d6-f733-45d4-a413-c40e296c81cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1292 microversion: 2.1 time: 0.228709 May 23 13:36:08.157616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 262/518] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:07 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1292 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:08.188436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a4d8439d-13b0-4781-ae54-ce798f2bfdcd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:08.194124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a4d8439d-13b0-4781-ae54-ce798f2bfdcd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:08.196445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4d8439d-13b0-4781-ae54-ce798f2bfdcd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:08.196903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4d8439d-13b0-4781-ae54-ce798f2bfdcd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.197682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4d8439d-13b0-4781-ae54-ce798f2bfdcd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:08.198250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4d8439d-13b0-4781-ae54-ce798f2bfdcd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.209517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a6028a84-1ec9-4e13-801e-9b19f34036c5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:08.234009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a6028a84-1ec9-4e13-801e-9b19f34036c5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.349645 May 23 13:36:08.243784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 257/519] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:07 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:08.379939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a4d8439d-13b0-4781-ae54-ce798f2bfdcd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:08.394400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a4d8439d-13b0-4781-ae54-ce798f2bfdcd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1594 microversion: 2.1 time: 0.209857 May 23 13:36:08.395551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 263/520] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:08 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1594 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:08.409582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d11e3714-36f1-4c1a-8b1f-f55bf9dc843c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:08.410215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d11e3714-36f1-4c1a-8b1f-f55bf9dc843c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:08.420063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d11e3714-36f1-4c1a-8b1f-f55bf9dc843c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:08.420525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d11e3714-36f1-4c1a-8b1f-f55bf9dc843c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.422215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d11e3714-36f1-4c1a-8b1f-f55bf9dc843c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:08.422690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d11e3714-36f1-4c1a-8b1f-f55bf9dc843c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.593518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:08.594051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:08.607378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:08.607879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.608902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:08.609396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.622407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d11e3714-36f1-4c1a-8b1f-f55bf9dc843c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:08.639739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d11e3714-36f1-4c1a-8b1f-f55bf9dc843c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1708 microversion: 2.1 time: 0.237042 May 23 13:36:08.648671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 258/521] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:08 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1708 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:08.680840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:08.682130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.682764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'fault' on Instance uuid 57d8fc5f-0889-4ea2-942c-90bde9a763c4 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:36:08.738705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:08.740316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:08.752386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:08.766648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01dee7e2-5a76-426f-8ea6-f1f829b68a7f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1308 microversion: 2.1 time: 0.176579 May 23 13:36:08.777904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:08.778983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 264/522] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:08 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:08.782637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.785809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:08.786987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:08.969883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:08.979332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:08.981004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:08.982309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3002ab6a-db11-4d33-a77a-6109cadcc470 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1722 microversion: 2.20 time: 0.250899 May 23 13:36:08.983003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 259/523] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:08 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:36:09.179427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-352161c1-285d-422d-b781-117a8c239b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:09.180714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-352161c1-285d-422d-b781-117a8c239b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:09.193741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-352161c1-285d-422d-b781-117a8c239b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.194350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-352161c1-285d-422d-b781-117a8c239b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.195618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-352161c1-285d-422d-b781-117a8c239b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.196159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-352161c1-285d-422d-b781-117a8c239b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.238031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-7723e558-1af8-447b-9f53-ed3d4b2c026e req-85632f87-aa1b-4519-8569-e9186157859e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011172-f0cf-4b8a-9791-2535bb8bcaa4", "name": "network-vif-unplugged", "status": "completed", "tag": "8fcc06ea-c028-490c-8ab1-e434a5b0c699"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:09.249520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7723e558-1af8-447b-9f53-ed3d4b2c026e req-85632f87-aa1b-4519-8569-e9186157859e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.250114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7723e558-1af8-447b-9f53-ed3d4b2c026e req-85632f87-aa1b-4519-8569-e9186157859e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.278222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-352161c1-285d-422d-b781-117a8c239b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:09.282952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-7723e558-1af8-447b-9f53-ed3d4b2c026e req-85632f87-aa1b-4519-8569-e9186157859e service nova] Creating event network-vif-unplugged:8fcc06ea-c028-490c-8ab1-e434a5b0c699 for instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 on hv-cinder-82549 May 23 13:36:09.287165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-352161c1-285d-422d-b781-117a8c239b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1300 microversion: 2.1 time: 0.112037 May 23 13:36:09.287165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 265/524] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:09 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:09.295623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-7723e558-1af8-447b-9f53-ed3d4b2c026e req-85632f87-aa1b-4519-8569-e9186157859e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060493 May 23 13:36:09.295623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 260/525] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:36:09.296202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b83d27df-f852-4a85-85dd-8a1437548ecd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:09.296202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b83d27df-f852-4a85-85dd-8a1437548ecd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:09.300022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83d27df-f852-4a85-85dd-8a1437548ecd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.300487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83d27df-f852-4a85-85dd-8a1437548ecd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.301290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83d27df-f852-4a85-85dd-8a1437548ecd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.301734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83d27df-f852-4a85-85dd-8a1437548ecd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.441100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b83d27df-f852-4a85-85dd-8a1437548ecd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:09.454393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b83d27df-f852-4a85-85dd-8a1437548ecd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.165624 May 23 13:36:09.467740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 266/526] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:09 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:09.661597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e9405d1-4f5b-4b10-adc7-cc6fa9c4c41f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:09.662383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e9405d1-4f5b-4b10-adc7-cc6fa9c4c41f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:09.675139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e9405d1-4f5b-4b10-adc7-cc6fa9c4c41f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.675502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e9405d1-4f5b-4b10-adc7-cc6fa9c4c41f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.676538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e9405d1-4f5b-4b10-adc7-cc6fa9c4c41f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.677146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e9405d1-4f5b-4b10-adc7-cc6fa9c4c41f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.787303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:09.788025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:09.790041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:09.802254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.807938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.808825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.809533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.848280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:09.849025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:09.849695 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'fault' on Instance uuid 57d8fc5f-0889-4ea2-942c-90bde9a763c4 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:36:09.900007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:09.912057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f87569b-8844-4506-a73d-0bec60903991 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1308 microversion: 2.1 time: 0.129514 May 23 13:36:09.912672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 267/527] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:09 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:09.969459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e9405d1-4f5b-4b10-adc7-cc6fa9c4c41f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:09.981306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e9405d1-4f5b-4b10-adc7-cc6fa9c4c41f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1708 microversion: 2.1 time: 0.325011 May 23 13:36:09.983179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 261/528] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:09 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1708 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:10.005789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:10.009541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:10.014022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:10.014775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:10.015740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:10.016184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:10.186909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:10.196762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:10.200152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:10.201780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-874b778d-b17a-4746-bd64-5d93cde821ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1722 microversion: 2.20 time: 0.202427 May 23 13:36:10.213374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 268/529] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:09 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:10.312387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a5385167-7fd0-42b1-bc39-0e4f972b2ddf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:10.313206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a5385167-7fd0-42b1-bc39-0e4f972b2ddf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:10.319419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5385167-7fd0-42b1-bc39-0e4f972b2ddf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:10.320137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5385167-7fd0-42b1-bc39-0e4f972b2ddf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:10.321316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5385167-7fd0-42b1-bc39-0e4f972b2ddf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:10.321754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5385167-7fd0-42b1-bc39-0e4f972b2ddf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:10.414852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a5385167-7fd0-42b1-bc39-0e4f972b2ddf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:10.432433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a5385167-7fd0-42b1-bc39-0e4f972b2ddf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1300 microversion: 2.1 time: 0.124636 May 23 13:36:10.435217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 262/530] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:10 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:10.476875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31b60211-96f9-4305-9f2a-62f8204a1515 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:10.478314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-31b60211-96f9-4305-9f2a-62f8204a1515 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:10.489262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b60211-96f9-4305-9f2a-62f8204a1515 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:10.489871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b60211-96f9-4305-9f2a-62f8204a1515 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:10.498589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b60211-96f9-4305-9f2a-62f8204a1515 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:10.498589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b60211-96f9-4305-9f2a-62f8204a1515 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:10.688107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-31b60211-96f9-4305-9f2a-62f8204a1515 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:10.697178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31b60211-96f9-4305-9f2a-62f8204a1515 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.227097 May 23 13:36:10.697926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 269/531] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:10 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:10.929673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:10.930199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:10.938977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:10.940024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:10.941050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:10.949804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:10.995939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:10.997107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:10.997736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'fault' on Instance uuid 57d8fc5f-0889-4ea2-942c-90bde9a763c4 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:36:11.001085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c37b67a8-c7b0-44d3-a0b4-d4a1dd172498 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:11.003920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c37b67a8-c7b0-44d3-a0b4-d4a1dd172498 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:11.017179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c37b67a8-c7b0-44d3-a0b4-d4a1dd172498 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.019750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c37b67a8-c7b0-44d3-a0b4-d4a1dd172498 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.021799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c37b67a8-c7b0-44d3-a0b4-d4a1dd172498 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.022435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c37b67a8-c7b0-44d3-a0b4-d4a1dd172498 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.182235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:11.197533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d1882035-47e9-40d7-98ab-2e4ae6fdbab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 200 len: 1308 microversion: 2.1 time: 0.267210 May 23 13:36:11.208487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 263/532] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:10 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:11.247332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:11.248312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:11.261487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.262502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.263475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.264076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.286960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c37b67a8-c7b0-44d3-a0b4-d4a1dd172498 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:11.304446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c37b67a8-c7b0-44d3-a0b4-d4a1dd172498 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1708 microversion: 2.1 time: 0.300966 May 23 13:36:11.309583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 270/533] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:10 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1708 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:11.316319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-fd66c11b-b831-470c-a6d9-6bfd8195ff2b req-ac923fd8-d7c4-4e80-8f75-b25b3c83f0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83ea9db-9db3-48c0-83a5-c423a1151195", "name": "network-vif-plugged", "status": "completed", "tag": "fcdea6af-6005-431d-b6d7-10f18e37002a"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:11.344403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-fd66c11b-b831-470c-a6d9-6bfd8195ff2b req-ac923fd8-d7c4-4e80-8f75-b25b3c83f0da service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.344927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-fd66c11b-b831-470c-a6d9-6bfd8195ff2b req-ac923fd8-d7c4-4e80-8f75-b25b3c83f0da service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.358886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-fd66c11b-b831-470c-a6d9-6bfd8195ff2b req-ac923fd8-d7c4-4e80-8f75-b25b3c83f0da service nova] Creating event network-vif-plugged:fcdea6af-6005-431d-b6d7-10f18e37002a for instance f83ea9db-9db3-48c0-83a5-c423a1151195 on hv-cinder-82549 May 23 13:36:11.365121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-fd66c11b-b831-470c-a6d9-6bfd8195ff2b req-ac923fd8-d7c4-4e80-8f75-b25b3c83f0da service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054015 May 23 13:36:11.366300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 271/534] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:36:11.455102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2859d7f4-9316-4579-a01a-e6171ac99e9e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:11.456808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2859d7f4-9316-4579-a01a-e6171ac99e9e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:11.473525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2859d7f4-9316-4579-a01a-e6171ac99e9e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.474590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2859d7f4-9316-4579-a01a-e6171ac99e9e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.476555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2859d7f4-9316-4579-a01a-e6171ac99e9e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.477295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2859d7f4-9316-4579-a01a-e6171ac99e9e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.577575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:11.596545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:11.605256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2859d7f4-9316-4579-a01a-e6171ac99e9e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:11.618246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2859d7f4-9316-4579-a01a-e6171ac99e9e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1310 microversion: 2.1 time: 0.167793 May 23 13:36:11.619626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 272/535] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:11 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1310 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:11.625017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:11.626324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-54ca343d-c56d-472f-9a27-12a7c4601d54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1722 microversion: 2.20 time: 0.402019 May 23 13:36:11.637594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 264/536] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1722 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:11.715973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-371dfc95-b86b-4a41-83d3-c94f5f11bd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:11.716935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-371dfc95-b86b-4a41-83d3-c94f5f11bd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:11.732076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371dfc95-b86b-4a41-83d3-c94f5f11bd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.732549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371dfc95-b86b-4a41-83d3-c94f5f11bd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.733626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371dfc95-b86b-4a41-83d3-c94f5f11bd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.734076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371dfc95-b86b-4a41-83d3-c94f5f11bd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.748181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-c64cc14d-6845-458a-be68-833ff4208bc4 req-f2b432d0-e416-47c0-8be1-d6011b335e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ddd2ac-4582-4472-a43f-e3a8b4944ed2", "tag": "c4681035-db92-4c8b-8c08-d28d81ee09fa"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:11.763862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c64cc14d-6845-458a-be68-833ff4208bc4 req-f2b432d0-e416-47c0-8be1-d6011b335e74 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:11.764691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c64cc14d-6845-458a-be68-833ff4208bc4 req-f2b432d0-e416-47c0-8be1-d6011b335e74 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:11.778667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-c64cc14d-6845-458a-be68-833ff4208bc4 req-f2b432d0-e416-47c0-8be1-d6011b335e74 service nova] Creating event network-changed:c4681035-db92-4c8b-8c08-d28d81ee09fa for instance 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 on hv-cinder-82549 May 23 13:36:11.787725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-c64cc14d-6845-458a-be68-833ff4208bc4 req-f2b432d0-e416-47c0-8be1-d6011b335e74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043008 May 23 13:36:11.800557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 265/537] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:36:12.003016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-371dfc95-b86b-4a41-83d3-c94f5f11bd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:12.023713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-371dfc95-b86b-4a41-83d3-c94f5f11bd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.312030 May 23 13:36:12.039847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 273/538] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:11 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:12.216666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:12.218081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 57d8fc5f-0889-4ea2-942c-90bde9a763c4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:12.240749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:12.241530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:12.243768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:12.246430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:12.279299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] HTTP exception thrown: Instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 could not be found. May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Request method failure captured: May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 HTTP/1.1 May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii40vd-P_YQXvsLwcStOUniM2vkJyRg_9f4ypUf1NkkYBUuBYj2FbSHcSv09Y9UyJFDGDsNJcps9rLkf-R9JngusICk7Pshxpnmguo79u6cuDaKW3P7O5Kr8RUgShdV8NPhuCdPEBp1AigrrZ-EzRROO12MbsaMVt6LTwkGHqvChOO6M May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:36:12.283308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}] May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 659caf32fa614f64bcd780a264674e33 May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 could not be found. May 23 13:36:12.285316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '57d8fc5f-0889-4ea2-942c-90bde9a763c4'} May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 could not be found. May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:36:12.286245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 could not be found. May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 could not be found. May 23 13:36:12.287488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:36:12.291860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Returning 404 to user: Instance 57d8fc5f-0889-4ea2-942c-90bde9a763c4 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:36:12.293112 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-33bcae8e-7726-4e2d-86fe-2341b7cbcd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4" status: 404 len: 111 microversion: 2.1 time: 0.081704 May 23 13:36:12.294202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 266/539] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:12 2022] GET /compute/v2.1/servers/57d8fc5f-0889-4ea2-942c-90bde9a763c4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 13:36:12.326306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-06b0c831-eee4-4fb2-91a9-8aba97bb6ea3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:12.326933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-06b0c831-eee4-4fb2-91a9-8aba97bb6ea3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:12.347631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06b0c831-eee4-4fb2-91a9-8aba97bb6ea3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:12.349254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06b0c831-eee4-4fb2-91a9-8aba97bb6ea3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:12.352946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06b0c831-eee4-4fb2-91a9-8aba97bb6ea3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:12.354883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-06b0c831-eee4-4fb2-91a9-8aba97bb6ea3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:12.639060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-078c49ed-a5f6-4ec4-bd8c-257f72a85b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:12.639557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-06b0c831-eee4-4fb2-91a9-8aba97bb6ea3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:12.640409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-078c49ed-a5f6-4ec4-bd8c-257f72a85b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:12.649643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-06b0c831-eee4-4fb2-91a9-8aba97bb6ea3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1712 microversion: 2.1 time: 0.327351 May 23 13:36:12.649875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-078c49ed-a5f6-4ec4-bd8c-257f72a85b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:12.650472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 274/540] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:12 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1712 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:12.650710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-078c49ed-a5f6-4ec4-bd8c-257f72a85b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:12.652061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-078c49ed-a5f6-4ec4-bd8c-257f72a85b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:12.652706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-078c49ed-a5f6-4ec4-bd8c-257f72a85b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:12.665150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:12.673855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:12.686706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:12.687567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:12.688728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:12.690295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:13.102398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:13.117931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:13.120380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:13.121721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ed3bf02-10dd-4e44-91ae-5ce477c0bf0c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1725 microversion: 2.20 time: 0.465305 May 23 13:36:13.136482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 275/541] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1725 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:13.137357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:13.144850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b3458ae1-bc5e-4b99-9c65-0fb6397d9f32 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:13.147719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b3458ae1-bc5e-4b99-9c65-0fb6397d9f32 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:13.153269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3458ae1-bc5e-4b99-9c65-0fb6397d9f32 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:13.154013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3458ae1-bc5e-4b99-9c65-0fb6397d9f32 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:13.155223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3458ae1-bc5e-4b99-9c65-0fb6397d9f32 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:13.155938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3458ae1-bc5e-4b99-9c65-0fb6397d9f32 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:13.181463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:13.300390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-078c49ed-a5f6-4ec4-bd8c-257f72a85b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:13.323590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-078c49ed-a5f6-4ec4-bd8c-257f72a85b98 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.689541 May 23 13:36:13.326641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 267/542] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:12 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:13.347009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4c6025ea-5a88-43b0-b6e5-61e1c5984b6d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "583986c3-e30b-4c13-8331-a2f233c845c6"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:13.354017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4c6025ea-5a88-43b0-b6e5-61e1c5984b6d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:13.368039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:13.374005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c6025ea-5a88-43b0-b6e5-61e1c5984b6d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:13.374636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c6025ea-5a88-43b0-b6e5-61e1c5984b6d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:13.375795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c6025ea-5a88-43b0-b6e5-61e1c5984b6d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:13.380700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c6025ea-5a88-43b0-b6e5-61e1c5984b6d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:13.483381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:13.757954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3458ae1-bc5e-4b99-9c65-0fb6397d9f32 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:13.773499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b3458ae1-bc5e-4b99-9c65-0fb6397d9f32 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.635159 May 23 13:36:13.774452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 276/543] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:13 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:14.353903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a671b26-af2b-4cf2-8270-10a8bbb506a0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:14.358892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a671b26-af2b-4cf2-8270-10a8bbb506a0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:14.367685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:14.379068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a671b26-af2b-4cf2-8270-10a8bbb506a0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:14.379535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a671b26-af2b-4cf2-8270-10a8bbb506a0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:14.380487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a671b26-af2b-4cf2-8270-10a8bbb506a0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:14.381720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a671b26-af2b-4cf2-8270-10a8bbb506a0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:14.734525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a671b26-af2b-4cf2-8270-10a8bbb506a0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:14.746784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a671b26-af2b-4cf2-8270-10a8bbb506a0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.407190 May 23 13:36:14.747449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 277/544] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:14 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:14.764212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-a7c1df40-e05c-4450-a4c9-9ed458a64ac5 req-3f5e3428-60a7-4547-836f-a977245f0f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5275ae-cf1f-40bb-8971-dc5c99868bc6", "tag": "863a3713-4b07-46b6-b471-63faa10fd123"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:14.775780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a7c1df40-e05c-4450-a4c9-9ed458a64ac5 req-3f5e3428-60a7-4547-836f-a977245f0f80 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:14.776445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a7c1df40-e05c-4450-a4c9-9ed458a64ac5 req-3f5e3428-60a7-4547-836f-a977245f0f80 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:14.791578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-a7c1df40-e05c-4450-a4c9-9ed458a64ac5 req-3f5e3428-60a7-4547-836f-a977245f0f80 service nova] Creating event network-changed:863a3713-4b07-46b6-b471-63faa10fd123 for instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 on hv-cinder-82549 May 23 13:36:14.811708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-a7c1df40-e05c-4450-a4c9-9ed458a64ac5 req-3f5e3428-60a7-4547-836f-a977245f0f80 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062766 May 23 13:36:14.816494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 278/545] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:36:14.823037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-083c82b7-61e8-4fac-ae0d-ec2cda7d3dd7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:14.823701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-083c82b7-61e8-4fac-ae0d-ec2cda7d3dd7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:14.845674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-083c82b7-61e8-4fac-ae0d-ec2cda7d3dd7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:14.846881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-083c82b7-61e8-4fac-ae0d-ec2cda7d3dd7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:14.847324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-083c82b7-61e8-4fac-ae0d-ec2cda7d3dd7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:14.847796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-083c82b7-61e8-4fac-ae0d-ec2cda7d3dd7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:14.899836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4c6025ea-5a88-43b0-b6e5-61e1c5984b6d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.571498 May 23 13:36:14.900644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 268/546] 10.222.0.70 () {62 vars in 1363 bytes} [Mon May 23 13:36:13 2022] POST /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 188 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:36:15.051134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-083c82b7-61e8-4fac-ae0d-ec2cda7d3dd7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:15.066490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-083c82b7-61e8-4fac-ae0d-ec2cda7d3dd7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.248306 May 23 13:36:15.067274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 279/547] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:14 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:15.099140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-614d8412-5283-4fdc-8b16-57a56c93f93f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:15.099970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-614d8412-5283-4fdc-8b16-57a56c93f93f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:15.112762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-614d8412-5283-4fdc-8b16-57a56c93f93f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:15.112762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-614d8412-5283-4fdc-8b16-57a56c93f93f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:15.112762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-614d8412-5283-4fdc-8b16-57a56c93f93f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:15.112762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-614d8412-5283-4fdc-8b16-57a56c93f93f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:15.419170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-614d8412-5283-4fdc-8b16-57a56c93f93f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/action" status: 202 len: 0 microversion: 2.20 time: 0.331322 May 23 13:36:15.423305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 269/548] 10.222.0.70 () {62 vars in 1318 bytes} [Mon May 23 13:36:15 2022] POST /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 13:36:15.430583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:15.431841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:15.439729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:15.440186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:15.441232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:15.442108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:15.638362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:15.648770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:15.650872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:15.652328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-27ce763c-00c9-4b36-a1a0-18ad87b3dd8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1751 microversion: 2.20 time: 0.226851 May 23 13:36:15.653072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 280/549] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:15 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:15.766966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-26091a4b-7684-4546-97fc-74c260b977f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:15.768059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-26091a4b-7684-4546-97fc-74c260b977f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:15.776304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26091a4b-7684-4546-97fc-74c260b977f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:15.777805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26091a4b-7684-4546-97fc-74c260b977f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:15.779345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26091a4b-7684-4546-97fc-74c260b977f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:15.780054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26091a4b-7684-4546-97fc-74c260b977f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:15.959452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-26091a4b-7684-4546-97fc-74c260b977f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:15.967245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-26091a4b-7684-4546-97fc-74c260b977f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.207860 May 23 13:36:15.967971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 270/550] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:15 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:16.055653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-432175ea-a42a-4954-893c-52842e5e04db tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1036551435"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:16.056506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-432175ea-a42a-4954-893c-52842e5e04db tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:16.065056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-432175ea-a42a-4954-893c-52842e5e04db tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:16.065662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-432175ea-a42a-4954-893c-52842e5e04db tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:16.066680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-432175ea-a42a-4954-893c-52842e5e04db tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:16.067158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-432175ea-a42a-4954-893c-52842e5e04db tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:16.093876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f61de520-4dbb-48e8-b69f-3ce219fe92c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:16.095700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f61de520-4dbb-48e8-b69f-3ce219fe92c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:16.113081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f61de520-4dbb-48e8-b69f-3ce219fe92c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:16.113796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f61de520-4dbb-48e8-b69f-3ce219fe92c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:16.114797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f61de520-4dbb-48e8-b69f-3ce219fe92c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:16.115391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f61de520-4dbb-48e8-b69f-3ce219fe92c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:16.267153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.network.security_group_api [None req-432175ea-a42a-4954-893c-52842e5e04db tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Adding security group 4842aed0-a821-4ba5-b2c6-10304be9d7a3 to port c4681035-db92-4c8b-8c08-d28d81ee09fa May 23 13:36:16.348248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f61de520-4dbb-48e8-b69f-3ce219fe92c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:16.365687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f61de520-4dbb-48e8-b69f-3ce219fe92c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.278215 May 23 13:36:16.366575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 271/551] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:16 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:16.673632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:16.675246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:16.686030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:16.686800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:16.687777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:16.688434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:16.959576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:16.969422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:16.971864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:16.973094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e95f11a-abd8-48f7-b702-88ecc2916b43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1751 microversion: 2.20 time: 0.303593 May 23 13:36:16.973650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 272/552] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1751 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:16.990851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ebd9b6d2-e4bd-4333-88a5-0097c0f18bb1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:16.991459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ebd9b6d2-e4bd-4333-88a5-0097c0f18bb1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:16.999921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebd9b6d2-e4bd-4333-88a5-0097c0f18bb1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:17.000369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebd9b6d2-e4bd-4333-88a5-0097c0f18bb1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:17.004283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebd9b6d2-e4bd-4333-88a5-0097c0f18bb1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:17.004283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebd9b6d2-e4bd-4333-88a5-0097c0f18bb1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:17.075370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-432175ea-a42a-4954-893c-52842e5e04db tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "POST /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/action" status: 202 len: 0 microversion: 2.1 time: 1.020684 May 23 13:36:17.075792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 281/553] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:36:16 2022] POST /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/action => generated 0 bytes in 1025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:36:17.080593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d8052d21-a90b-42fb-aaf2-c5ba9c90939e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:17.081222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d8052d21-a90b-42fb-aaf2-c5ba9c90939e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:17.095998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8052d21-a90b-42fb-aaf2-c5ba9c90939e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:17.096458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8052d21-a90b-42fb-aaf2-c5ba9c90939e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:17.097281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8052d21-a90b-42fb-aaf2-c5ba9c90939e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:17.097724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8052d21-a90b-42fb-aaf2-c5ba9c90939e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:17.249213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebd9b6d2-e4bd-4333-88a5-0097c0f18bb1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:17.262502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ebd9b6d2-e4bd-4333-88a5-0097c0f18bb1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.275693 May 23 13:36:17.264727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 273/554] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:16 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:17.279233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-c5e7b459-4dac-4766-a8c7-a0bfc396211b req-3fb94dd5-0959-4be5-80b3-3d499397ae8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ddd2ac-4582-4472-a43f-e3a8b4944ed2", "tag": "c4681035-db92-4c8b-8c08-d28d81ee09fa"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:17.308945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c5e7b459-4dac-4766-a8c7-a0bfc396211b req-3fb94dd5-0959-4be5-80b3-3d499397ae8e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:17.309774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c5e7b459-4dac-4766-a8c7-a0bfc396211b req-3fb94dd5-0959-4be5-80b3-3d499397ae8e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:17.328515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-c5e7b459-4dac-4766-a8c7-a0bfc396211b req-3fb94dd5-0959-4be5-80b3-3d499397ae8e service nova] Creating event network-changed:c4681035-db92-4c8b-8c08-d28d81ee09fa for instance 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 on hv-cinder-82549 May 23 13:36:17.333908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-c5e7b459-4dac-4766-a8c7-a0bfc396211b req-3fb94dd5-0959-4be5-80b3-3d499397ae8e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058727 May 23 13:36:17.335702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 274/555] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:36:17.379905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d8052d21-a90b-42fb-aaf2-c5ba9c90939e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:17.385181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2fb2a0e3-9364-4f69-beea-284412f11e1d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:17.386060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2fb2a0e3-9364-4f69-beea-284412f11e1d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:17.392831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d8052d21-a90b-42fb-aaf2-c5ba9c90939e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1641 microversion: 2.1 time: 0.314702 May 23 13:36:17.393599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 282/556] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:17 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1641 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:17.397726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fb2a0e3-9364-4f69-beea-284412f11e1d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:17.398191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fb2a0e3-9364-4f69-beea-284412f11e1d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:17.398958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fb2a0e3-9364-4f69-beea-284412f11e1d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:17.399395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fb2a0e3-9364-4f69-beea-284412f11e1d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:17.583741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2fb2a0e3-9364-4f69-beea-284412f11e1d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:17.594651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2fb2a0e3-9364-4f69-beea-284412f11e1d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.213988 May 23 13:36:17.596524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 275/557] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:17 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:17.993397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:17.994124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:18.002074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:18.002944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:18.003989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:18.004490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:18.281409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-740fd6d8-3399-4a73-a7a4-7fa7fd1c9066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:18.282224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-740fd6d8-3399-4a73-a7a4-7fa7fd1c9066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:18.296930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-740fd6d8-3399-4a73-a7a4-7fa7fd1c9066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:18.299184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-740fd6d8-3399-4a73-a7a4-7fa7fd1c9066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:18.300552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-740fd6d8-3399-4a73-a7a4-7fa7fd1c9066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:18.301844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-740fd6d8-3399-4a73-a7a4-7fa7fd1c9066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:18.410836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:18.421056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:18.425373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:18.444725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-93f404d1-9a9e-443c-ac38-76c12b764cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1751 microversion: 2.20 time: 0.448998 May 23 13:36:18.445724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 283/558] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1751 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:18.617630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e181f7cd-88b8-46a7-ab2d-c646c34b04d0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:18.621971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e181f7cd-88b8-46a7-ab2d-c646c34b04d0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:18.627280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-740fd6d8-3399-4a73-a7a4-7fa7fd1c9066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:18.637629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-740fd6d8-3399-4a73-a7a4-7fa7fd1c9066 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.360395 May 23 13:36:18.639056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 276/559] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:18 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:18.643550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e181f7cd-88b8-46a7-ab2d-c646c34b04d0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:18.644698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e181f7cd-88b8-46a7-ab2d-c646c34b04d0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:18.645631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e181f7cd-88b8-46a7-ab2d-c646c34b04d0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:18.646174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e181f7cd-88b8-46a7-ab2d-c646c34b04d0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:18.807601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e181f7cd-88b8-46a7-ab2d-c646c34b04d0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:18.817494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e181f7cd-88b8-46a7-ab2d-c646c34b04d0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.207910 May 23 13:36:18.818928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 284/560] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:18 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:19.465921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:19.466491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:19.474066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:19.474507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:19.475275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:19.475702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:19.656189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5def5bfb-4faa-4b8f-81bf-25c538dce4f6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:19.659879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5def5bfb-4faa-4b8f-81bf-25c538dce4f6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:19.669389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5def5bfb-4faa-4b8f-81bf-25c538dce4f6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:19.669853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5def5bfb-4faa-4b8f-81bf-25c538dce4f6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:19.670671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5def5bfb-4faa-4b8f-81bf-25c538dce4f6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:19.671123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5def5bfb-4faa-4b8f-81bf-25c538dce4f6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:19.766333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:19.785321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:19.785321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:19.786086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7e1718c-0eeb-4334-88ec-f64478545f67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1751 microversion: 2.20 time: 0.324149 May 23 13:36:19.786843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 277/561] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:19 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1751 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:19.835554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3777cf21-2d48-45d8-8750-2359d8924f9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:19.836886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3777cf21-2d48-45d8-8750-2359d8924f9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:19.842932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3777cf21-2d48-45d8-8750-2359d8924f9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:19.843610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3777cf21-2d48-45d8-8750-2359d8924f9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:19.844539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3777cf21-2d48-45d8-8750-2359d8924f9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:19.845097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3777cf21-2d48-45d8-8750-2359d8924f9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:19.935276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5def5bfb-4faa-4b8f-81bf-25c538dce4f6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:19.944446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5def5bfb-4faa-4b8f-81bf-25c538dce4f6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.292962 May 23 13:36:19.954061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 285/562] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:19 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:20.000489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3777cf21-2d48-45d8-8750-2359d8924f9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:20.008810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3777cf21-2d48-45d8-8750-2359d8924f9b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1261 microversion: 2.1 time: 0.177341 May 23 13:36:20.009367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 278/563] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:19 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:20.805852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:20.806953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:20.818413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:20.818882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:20.819873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:20.820324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:20.963566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-673e9869-ad96-49be-bd1c-adedf107df5d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:20.965031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-673e9869-ad96-49be-bd1c-adedf107df5d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:20.981800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-673e9869-ad96-49be-bd1c-adedf107df5d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:20.982303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-673e9869-ad96-49be-bd1c-adedf107df5d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:20.983041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-673e9869-ad96-49be-bd1c-adedf107df5d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:20.983479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-673e9869-ad96-49be-bd1c-adedf107df5d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:21.092458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:21.102479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:21.108310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:21.109238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dca9b9b9-1b64-44df-a29d-0245b9011b9e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1753 microversion: 2.20 time: 0.307779 May 23 13:36:21.109825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 286/564] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1753 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:21.118943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6c15bcfb-bb41-43c3-a38f-95605c92e9fe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:21.119935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6c15bcfb-bb41-43c3-a38f-95605c92e9fe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:21.141212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c15bcfb-bb41-43c3-a38f-95605c92e9fe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:21.143486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c15bcfb-bb41-43c3-a38f-95605c92e9fe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:21.144825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c15bcfb-bb41-43c3-a38f-95605c92e9fe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:21.145287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c15bcfb-bb41-43c3-a38f-95605c92e9fe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:21.252373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-673e9869-ad96-49be-bd1c-adedf107df5d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:21.261269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-673e9869-ad96-49be-bd1c-adedf107df5d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.302930 May 23 13:36:21.262184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 279/565] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:20 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:21.418983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c15bcfb-bb41-43c3-a38f-95605c92e9fe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:21.435838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6c15bcfb-bb41-43c3-a38f-95605c92e9fe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1445 microversion: 2.1 time: 0.321906 May 23 13:36:21.437306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 287/566] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:21 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1445 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:21.457972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6fac3981-58a2-4c49-bd84-c22d9adafcf1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:21.458973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6fac3981-58a2-4c49-bd84-c22d9adafcf1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:21.466341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fac3981-58a2-4c49-bd84-c22d9adafcf1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:21.466773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fac3981-58a2-4c49-bd84-c22d9adafcf1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:21.467730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fac3981-58a2-4c49-bd84-c22d9adafcf1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:21.468170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fac3981-58a2-4c49-bd84-c22d9adafcf1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:21.635681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6fac3981-58a2-4c49-bd84-c22d9adafcf1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:21.645995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6fac3981-58a2-4c49-bd84-c22d9adafcf1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1445 microversion: 2.1 time: 0.191193 May 23 13:36:21.645995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 280/567] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:21 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1445 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:22.132422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:22.133073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:22.139678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:22.141347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:22.142902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:22.143462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:22.281251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d6a86eb6-8803-4c32-9370-6f2109e55230 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:22.281865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d6a86eb6-8803-4c32-9370-6f2109e55230 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:22.289710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6a86eb6-8803-4c32-9370-6f2109e55230 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:22.290388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6a86eb6-8803-4c32-9370-6f2109e55230 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:22.291362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6a86eb6-8803-4c32-9370-6f2109e55230 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:22.291952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6a86eb6-8803-4c32-9370-6f2109e55230 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:22.297460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:22.309352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:22.310870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:22.312042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d907b87f-df5e-41cf-acfe-30d2812656bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1753 microversion: 2.20 time: 0.183760 May 23 13:36:22.318701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 288/568] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:22 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:22.520736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6a86eb6-8803-4c32-9370-6f2109e55230 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:22.528105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d6a86eb6-8803-4c32-9370-6f2109e55230 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.250996 May 23 13:36:22.529164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 281/569] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:22 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:23.336495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:23.337048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:23.343450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:23.343894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:23.344682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:23.345661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:23.481783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:23.490719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:23.492938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:23.494175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6e442271-e6f5-46ca-b624-6c0fcae6e435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1753 microversion: 2.20 time: 0.161658 May 23 13:36:23.494775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 289/570] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:23.545609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e80ac54b-fd34-4509-b130-b8d212a45510 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:23.546350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e80ac54b-fd34-4509-b130-b8d212a45510 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:23.553766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e80ac54b-fd34-4509-b130-b8d212a45510 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:23.554302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e80ac54b-fd34-4509-b130-b8d212a45510 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:23.555130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e80ac54b-fd34-4509-b130-b8d212a45510 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:23.555627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e80ac54b-fd34-4509-b130-b8d212a45510 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:23.796597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e80ac54b-fd34-4509-b130-b8d212a45510 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:23.804379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e80ac54b-fd34-4509-b130-b8d212a45510 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.262719 May 23 13:36:23.804989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 282/571] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:23 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:24.255944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-170f9b15-e31c-487b-8455-824f338671be req-4e5cb109-09c3-4a8c-bf1e-64a243a08312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83ea9db-9db3-48c0-83a5-c423a1151195", "tag": "fcdea6af-6005-431d-b6d7-10f18e37002a"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:24.264346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-170f9b15-e31c-487b-8455-824f338671be req-4e5cb109-09c3-4a8c-bf1e-64a243a08312 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:24.267336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-170f9b15-e31c-487b-8455-824f338671be req-4e5cb109-09c3-4a8c-bf1e-64a243a08312 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:24.276386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-170f9b15-e31c-487b-8455-824f338671be req-4e5cb109-09c3-4a8c-bf1e-64a243a08312 service nova] Creating event network-changed:fcdea6af-6005-431d-b6d7-10f18e37002a for instance f83ea9db-9db3-48c0-83a5-c423a1151195 on hv-cinder-82549 May 23 13:36:24.281931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-170f9b15-e31c-487b-8455-824f338671be req-4e5cb109-09c3-4a8c-bf1e-64a243a08312 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030255 May 23 13:36:24.282542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 290/572] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:36:24.512266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:24.513143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:24.528840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:24.529296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:24.530205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:24.530508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:24.663651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:24.672510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:24.674104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:24.675268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f85d9c2-f8f2-4f12-9516-04c579071612 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1753 microversion: 2.20 time: 0.166880 May 23 13:36:24.675824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 283/573] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:24 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:24.823936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce14894e-5ee6-4dc6-893b-4c3ebd23e680 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:24.824558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ce14894e-5ee6-4dc6-893b-4c3ebd23e680 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:24.832362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce14894e-5ee6-4dc6-893b-4c3ebd23e680 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:24.833447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce14894e-5ee6-4dc6-893b-4c3ebd23e680 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:24.834225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce14894e-5ee6-4dc6-893b-4c3ebd23e680 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:24.834663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce14894e-5ee6-4dc6-893b-4c3ebd23e680 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:24.974158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ce14894e-5ee6-4dc6-893b-4c3ebd23e680 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:24.982013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce14894e-5ee6-4dc6-893b-4c3ebd23e680 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.162906 May 23 13:36:24.982605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 291/574] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:24 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:25.694511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:25.695026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:25.701515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:25.701966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:25.702729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:25.703157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:25.707800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:25.836672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:25.845973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:25.847473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:25.848658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d142750-5fde-4a8d-ada2-93f260ab5475 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1753 microversion: 2.20 time: 0.158072 May 23 13:36:25.849217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 284/575] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:25.999334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6973025-0e8a-42a5-9f0f-46e541ce5999 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:25.999941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d6973025-0e8a-42a5-9f0f-46e541ce5999 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:26.007182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6973025-0e8a-42a5-9f0f-46e541ce5999 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:26.007626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6973025-0e8a-42a5-9f0f-46e541ce5999 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:26.011142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6973025-0e8a-42a5-9f0f-46e541ce5999 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:26.011142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6973025-0e8a-42a5-9f0f-46e541ce5999 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:26.142984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6973025-0e8a-42a5-9f0f-46e541ce5999 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:26.150482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d6973025-0e8a-42a5-9f0f-46e541ce5999 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.155152 May 23 13:36:26.151039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 292/576] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:25 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:26.867971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:26.868580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:26.875129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:26.875578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:26.876624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:26.877062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:27.008073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:27.017050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:27.018604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:27.019813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8baedc7d-e154-43b0-b5fa-23e8e9b10109 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1753 microversion: 2.20 time: 0.156409 May 23 13:36:27.020370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 285/577] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:27.167199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5e7d39bb-e277-4642-8e32-5a36f6b1d677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:27.167809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5e7d39bb-e277-4642-8e32-5a36f6b1d677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:27.174501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e7d39bb-e277-4642-8e32-5a36f6b1d677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:27.174946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e7d39bb-e277-4642-8e32-5a36f6b1d677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:27.175709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e7d39bb-e277-4642-8e32-5a36f6b1d677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:27.176141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e7d39bb-e277-4642-8e32-5a36f6b1d677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:27.305135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e7d39bb-e277-4642-8e32-5a36f6b1d677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:27.312522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5e7d39bb-e277-4642-8e32-5a36f6b1d677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.149204 May 23 13:36:27.313113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 293/578] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:27 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:27.635069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-611374246", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "networks": [{"uuid": "2d77765d-c719-42d2-a70b-26bbabd2e1b8"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:27.687292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] validate_networks() for [('2d77765d-c719-42d2-a70b-26bbabd2e1b8', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 13:36:28.044119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:28.044974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:28.051461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:28.051931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 13:36:28.052371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:28.052482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 13:36:28.052879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:28.052984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 13:36:28.053273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 13:36:28.053372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:28.053688 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 13:36:28.064213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:28.065041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:28.065846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:28.066284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:28.084886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Getting quotas for project 562a3f075cb64d668a76838fd4f9c8f5. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 13:36:28.089053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Getting quotas for user 659caf32fa614f64bcd780a264674e33 and project 562a3f075cb64d668a76838fd4f9c8f5. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 13:36:28.101539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 13:36:28.103834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 13:36:28.225663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-793c2b01-d412-46dd-b633-e2dc425018ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594395 May 23 13:36:28.226524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 286/579] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 13:36:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 13:36:28.239438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7b0d75e-7ab8-449e-b081-59511bd92bf6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:28.240054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7b0d75e-7ab8-449e-b081-59511bd92bf6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:28.293962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:28.297008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7b0d75e-7ab8-449e-b081-59511bd92bf6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:28.304920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:28.310127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7b0d75e-7ab8-449e-b081-59511bd92bf6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1218 microversion: 2.1 time: 0.075395 May 23 13:36:28.317182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 287/580] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:28 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:28.325735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:28.341119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:28.341446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da6945bc-2052-4263-9272-55b88f807227 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:28.341446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da6945bc-2052-4263-9272-55b88f807227 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:28.341602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33c325ba-4399-42da-9fb0-178cc61c9bb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1753 microversion: 2.20 time: 0.292043 May 23 13:36:28.341602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 294/581] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:28 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1753 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:28.341734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da6945bc-2052-4263-9272-55b88f807227 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:28.341734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da6945bc-2052-4263-9272-55b88f807227 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:28.341734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da6945bc-2052-4263-9272-55b88f807227 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:28.341734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da6945bc-2052-4263-9272-55b88f807227 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:28.565553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da6945bc-2052-4263-9272-55b88f807227 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:28.573586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da6945bc-2052-4263-9272-55b88f807227 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.248767 May 23 13:36:28.574172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 288/582] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:28 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:29.331280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1bfac144-c011-4b68-ac99-d1a550e5958b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:29.331902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1bfac144-c011-4b68-ac99-d1a550e5958b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:29.355267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:29.355869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:29.364274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:29.364809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:29.365520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:29.366119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:29.402831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bfac144-c011-4b68-ac99-d1a550e5958b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:29.409749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1bfac144-c011-4b68-ac99-d1a550e5958b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1218 microversion: 2.1 time: 0.083871 May 23 13:36:29.410589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 295/583] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:29 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:29.576047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:29.585510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:29.586885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:29.588075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-20035c2d-9575-40c2-9152-c0ab3cabbb4d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1753 microversion: 2.20 time: 0.239229 May 23 13:36:29.588838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 289/584] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:29 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1753 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:29.591590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f59ef20b-a6e0-4b0a-a23f-35a52f87edad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:29.592190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f59ef20b-a6e0-4b0a-a23f-35a52f87edad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:29.598760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f59ef20b-a6e0-4b0a-a23f-35a52f87edad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:29.599309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f59ef20b-a6e0-4b0a-a23f-35a52f87edad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:29.600305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f59ef20b-a6e0-4b0a-a23f-35a52f87edad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:29.600769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f59ef20b-a6e0-4b0a-a23f-35a52f87edad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:29.740132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f59ef20b-a6e0-4b0a-a23f-35a52f87edad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:29.748288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f59ef20b-a6e0-4b0a-a23f-35a52f87edad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.160610 May 23 13:36:29.748895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 296/585] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:29 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:30.427099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ad6f85ee-ecd7-4b8a-b11b-a6dead6ea0d6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:30.427702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ad6f85ee-ecd7-4b8a-b11b-a6dead6ea0d6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:30.433811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ee-ecd7-4b8a-b11b-a6dead6ea0d6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:30.434265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ee-ecd7-4b8a-b11b-a6dead6ea0d6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:30.435018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ee-ecd7-4b8a-b11b-a6dead6ea0d6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:30.435451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ee-ecd7-4b8a-b11b-a6dead6ea0d6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:30.495810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ad6f85ee-ecd7-4b8a-b11b-a6dead6ea0d6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:30.504313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ad6f85ee-ecd7-4b8a-b11b-a6dead6ea0d6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1214 microversion: 2.1 time: 0.082026 May 23 13:36:30.511030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 290/586] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:30 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:30.607336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:30.607949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:30.619822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:30.620225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:30.621072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:30.621541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:30.772383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a768e3a5-b968-4689-8793-652387725610 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:30.773428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a768e3a5-b968-4689-8793-652387725610 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:30.789102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a768e3a5-b968-4689-8793-652387725610 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:30.789678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a768e3a5-b968-4689-8793-652387725610 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:30.790519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a768e3a5-b968-4689-8793-652387725610 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:30.791073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a768e3a5-b968-4689-8793-652387725610 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:30.823025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:30.834775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:30.836659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:30.837869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3f1e3bad-d679-477e-b56f-66f54a7a9e58 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.234466 May 23 13:36:30.849067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 297/587] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:30.880824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-054bd181-e9da-48ae-9228-b9b8fe2629ff req-fe7ed537-36e2-4806-96bb-fc2874066d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5275ae-cf1f-40bb-8971-dc5c99868bc6", "name": "network-vif-plugged", "status": "completed", "tag": "863a3713-4b07-46b6-b471-63faa10fd123"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:30.892659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-054bd181-e9da-48ae-9228-b9b8fe2629ff req-fe7ed537-36e2-4806-96bb-fc2874066d09 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:30.894572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-054bd181-e9da-48ae-9228-b9b8fe2629ff req-fe7ed537-36e2-4806-96bb-fc2874066d09 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:30.907393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-054bd181-e9da-48ae-9228-b9b8fe2629ff req-fe7ed537-36e2-4806-96bb-fc2874066d09 service nova] Creating event network-vif-plugged:863a3713-4b07-46b6-b471-63faa10fd123 for instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 on hv-cinder-82549 May 23 13:36:30.913082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-054bd181-e9da-48ae-9228-b9b8fe2629ff req-fe7ed537-36e2-4806-96bb-fc2874066d09 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039120 May 23 13:36:30.917378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 298/588] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:36:30.975787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a768e3a5-b968-4689-8793-652387725610 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:30.983746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a768e3a5-b968-4689-8793-652387725610 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.215666 May 23 13:36:30.984449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 291/589] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:30 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:31.532816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-03299103-f758-4215-b054-ad35dddff8a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:31.532816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-03299103-f758-4215-b054-ad35dddff8a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:31.536205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03299103-f758-4215-b054-ad35dddff8a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:31.536710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03299103-f758-4215-b054-ad35dddff8a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:31.537540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03299103-f758-4215-b054-ad35dddff8a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:31.537985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03299103-f758-4215-b054-ad35dddff8a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:31.629359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03299103-f758-4215-b054-ad35dddff8a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:31.640539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-03299103-f758-4215-b054-ad35dddff8a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1214 microversion: 2.1 time: 0.121565 May 23 13:36:31.641385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 299/590] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:31 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:31.861624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:31.862783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:31.871293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:31.871784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:31.872554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:31.873018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:32.003972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-417dfba8-413a-4db7-9a8e-3d3fc5ae67aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:32.004679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-417dfba8-413a-4db7-9a8e-3d3fc5ae67aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:32.012465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-417dfba8-413a-4db7-9a8e-3d3fc5ae67aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:32.012952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-417dfba8-413a-4db7-9a8e-3d3fc5ae67aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:32.013738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-417dfba8-413a-4db7-9a8e-3d3fc5ae67aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:32.018507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-417dfba8-413a-4db7-9a8e-3d3fc5ae67aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:32.018919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:32.027990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:32.029526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:32.030769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ca3fbbf-d429-4291-b005-1f4789cb33a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.177387 May 23 13:36:32.031350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 292/591] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:31 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:32.153018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-417dfba8-413a-4db7-9a8e-3d3fc5ae67aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:32.161172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-417dfba8-413a-4db7-9a8e-3d3fc5ae67aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.162614 May 23 13:36:32.161735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 300/592] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:31 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:32.659710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-545c6f85-79ab-4a37-bb80-63920c02e919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:32.660321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-545c6f85-79ab-4a37-bb80-63920c02e919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:32.666726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-545c6f85-79ab-4a37-bb80-63920c02e919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:32.667176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-545c6f85-79ab-4a37-bb80-63920c02e919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:32.667938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-545c6f85-79ab-4a37-bb80-63920c02e919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:32.668372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-545c6f85-79ab-4a37-bb80-63920c02e919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:32.730721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-545c6f85-79ab-4a37-bb80-63920c02e919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:32.738232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-545c6f85-79ab-4a37-bb80-63920c02e919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1270 microversion: 2.1 time: 0.083385 May 23 13:36:32.738792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 293/593] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:32 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:33.050163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:33.050682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:33.057249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:33.057711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:33.058485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:33.058938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:33.189147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ce23559-d93b-4de6-a5fd-d351e9fcb359 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:33.190569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ce23559-d93b-4de6-a5fd-d351e9fcb359 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:33.195806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:33.197137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ce23559-d93b-4de6-a5fd-d351e9fcb359 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:33.197592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ce23559-d93b-4de6-a5fd-d351e9fcb359 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:33.198360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ce23559-d93b-4de6-a5fd-d351e9fcb359 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:33.198793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ce23559-d93b-4de6-a5fd-d351e9fcb359 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:33.204372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:33.205975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:33.207131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ddc65a7e-6841-44c2-8274-aa39b18ea3da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.161180 May 23 13:36:33.207685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 301/594] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:33.333514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9ce23559-d93b-4de6-a5fd-d351e9fcb359 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:33.342295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ce23559-d93b-4de6-a5fd-d351e9fcb359 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1366 microversion: 2.1 time: 0.168472 May 23 13:36:33.342970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 294/595] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:33 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:33.756266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4fc61069-b9f9-42f0-863d-3a99ecb793c2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:33.756907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4fc61069-b9f9-42f0-863d-3a99ecb793c2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:33.763226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fc61069-b9f9-42f0-863d-3a99ecb793c2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:33.764008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fc61069-b9f9-42f0-863d-3a99ecb793c2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:33.764908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fc61069-b9f9-42f0-863d-3a99ecb793c2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:33.765348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fc61069-b9f9-42f0-863d-3a99ecb793c2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:33.830348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4fc61069-b9f9-42f0-863d-3a99ecb793c2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:33.838800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4fc61069-b9f9-42f0-863d-3a99ecb793c2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1278 microversion: 2.1 time: 0.086650 May 23 13:36:33.839760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 302/596] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:33 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:34.224829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:34.225444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:34.231950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:34.232423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:34.233217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:34.233652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:34.361718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-726065eb-9331-4d7a-8090-58a57d3861c1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:34.362342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-726065eb-9331-4d7a-8090-58a57d3861c1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:34.369821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-726065eb-9331-4d7a-8090-58a57d3861c1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:34.370571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-726065eb-9331-4d7a-8090-58a57d3861c1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:34.371342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-726065eb-9331-4d7a-8090-58a57d3861c1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:34.371777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-726065eb-9331-4d7a-8090-58a57d3861c1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:34.437799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:34.446950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:34.452814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:34.458100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e4fa75fb-7c38-49ee-8f0a-e14303db4cb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.237023 May 23 13:36:34.459172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 295/597] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:34 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:34.592747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-726065eb-9331-4d7a-8090-58a57d3861c1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:34.601764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-726065eb-9331-4d7a-8090-58a57d3861c1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1555 microversion: 2.1 time: 0.245036 May 23 13:36:34.602360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 303/598] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:34 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:36:34.627353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3736b9d7-2ee2-4c74-a577-34cf987820e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:34.628156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3736b9d7-2ee2-4c74-a577-34cf987820e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:34.635954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3736b9d7-2ee2-4c74-a577-34cf987820e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:34.636784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3736b9d7-2ee2-4c74-a577-34cf987820e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:34.637812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3736b9d7-2ee2-4c74-a577-34cf987820e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:34.638438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3736b9d7-2ee2-4c74-a577-34cf987820e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:34.731457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3736b9d7-2ee2-4c74-a577-34cf987820e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109139 May 23 13:36:34.732053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 296/599] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 23 13:36:34 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:36:34.860356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d4be7f2-9979-4744-8d77-72fa44610dbf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:34.861213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d4be7f2-9979-4744-8d77-72fa44610dbf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:34.868697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d4be7f2-9979-4744-8d77-72fa44610dbf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:34.869423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d4be7f2-9979-4744-8d77-72fa44610dbf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:34.870415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d4be7f2-9979-4744-8d77-72fa44610dbf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:34.871160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d4be7f2-9979-4744-8d77-72fa44610dbf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:34.956217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d4be7f2-9979-4744-8d77-72fa44610dbf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:35.003433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d4be7f2-9979-4744-8d77-72fa44610dbf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1288 microversion: 2.1 time: 0.148815 May 23 13:36:35.037373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 304/600] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:34 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1288 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:35.478548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:35.479300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:35.491393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:35.492016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:35.496122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:35.496721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:35.802749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:35.812794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:35.815084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:35.816289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-040d32d3-9bbb-429f-9740-9fdfe82c7d0a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.342626 May 23 13:36:35.816900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 297/601] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:35 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:36.033642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02830ec9-9f17-4719-b304-f41ff830b023 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:36.034590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02830ec9-9f17-4719-b304-f41ff830b023 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:36.041351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02830ec9-9f17-4719-b304-f41ff830b023 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:36.041810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02830ec9-9f17-4719-b304-f41ff830b023 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:36.042775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02830ec9-9f17-4719-b304-f41ff830b023 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:36.043223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02830ec9-9f17-4719-b304-f41ff830b023 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:36.233977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-08871210-9262-45fb-8822-f84acd1f2fd0 req-a0491800-3a9d-4a87-966c-94ba1932788c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5275ae-cf1f-40bb-8971-dc5c99868bc6", "tag": "863a3713-4b07-46b6-b471-63faa10fd123"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:36.245955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-08871210-9262-45fb-8822-f84acd1f2fd0 req-a0491800-3a9d-4a87-966c-94ba1932788c service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:36.246576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-08871210-9262-45fb-8822-f84acd1f2fd0 req-a0491800-3a9d-4a87-966c-94ba1932788c service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:36.291166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-08871210-9262-45fb-8822-f84acd1f2fd0 req-a0491800-3a9d-4a87-966c-94ba1932788c service nova] Creating event network-changed:863a3713-4b07-46b6-b471-63faa10fd123 for instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 on hv-cinder-82549 May 23 13:36:36.300906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-08871210-9262-45fb-8822-f84acd1f2fd0 req-a0491800-3a9d-4a87-966c-94ba1932788c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071738 May 23 13:36:36.302971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 298/602] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:36:36.475811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02830ec9-9f17-4719-b304-f41ff830b023 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:36.489043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02830ec9-9f17-4719-b304-f41ff830b023 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.459749 May 23 13:36:36.490118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 305/603] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:36 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:36.836919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:36.837612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:36.844151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:36.845205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:36.845976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:36.846409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:37.069743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:37.078326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:37.080672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:37.081855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae5eb07d-948f-49a2-8618-6cc17dfad56f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.249844 May 23 13:36:37.082417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 299/604] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:36 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:37.509738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b92ba91c-f098-47b8-84ab-21317821f354 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:37.512737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b92ba91c-f098-47b8-84ab-21317821f354 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:37.518435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b92ba91c-f098-47b8-84ab-21317821f354 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:37.519208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b92ba91c-f098-47b8-84ab-21317821f354 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:37.520177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b92ba91c-f098-47b8-84ab-21317821f354 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:37.520647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b92ba91c-f098-47b8-84ab-21317821f354 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:37.655300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b92ba91c-f098-47b8-84ab-21317821f354 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:37.662987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b92ba91c-f098-47b8-84ab-21317821f354 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.158057 May 23 13:36:37.663566 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 306/605] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:37 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:38.100232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:38.100878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:38.103324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:38.108178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:38.108665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:38.109433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:38.114970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:38.253793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:38.263191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:38.264979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:38.267182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07736816-d560-4959-a69c-2ac9451d6cfb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.170394 May 23 13:36:38.267956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 300/606] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:38 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:36:38.679390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ef6e1f5-7404-49f7-8285-cde87afc2198 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:38.680044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ef6e1f5-7404-49f7-8285-cde87afc2198 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:38.686599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ef6e1f5-7404-49f7-8285-cde87afc2198 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:38.687054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ef6e1f5-7404-49f7-8285-cde87afc2198 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:38.687825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ef6e1f5-7404-49f7-8285-cde87afc2198 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:38.688827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ef6e1f5-7404-49f7-8285-cde87afc2198 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:38.844491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0ef6e1f5-7404-49f7-8285-cde87afc2198 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:38.852174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ef6e1f5-7404-49f7-8285-cde87afc2198 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.176694 May 23 13:36:38.852776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 307/607] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:38 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:39.287107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:39.288460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:39.292288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:39.297363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:39.298497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:39.299308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:39.299748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:39.454215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:39.463221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:39.464914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:39.466209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9c4f7ec6-ced9-4c50-aa95-2c5e3df5241e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.184524 May 23 13:36:39.466804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 301/608] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:39 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:39.869469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cc11b64a-ee04-42eb-836e-8eef538c86e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:39.870093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cc11b64a-ee04-42eb-836e-8eef538c86e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:39.872059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:39.877464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc11b64a-ee04-42eb-836e-8eef538c86e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:39.877914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc11b64a-ee04-42eb-836e-8eef538c86e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:39.878685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc11b64a-ee04-42eb-836e-8eef538c86e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:39.879122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc11b64a-ee04-42eb-836e-8eef538c86e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:40.058065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cc11b64a-ee04-42eb-836e-8eef538c86e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:40.066317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cc11b64a-ee04-42eb-836e-8eef538c86e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.201015 May 23 13:36:40.066895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 308/609] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:39 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:40.484313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:40.486211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:40.495454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:40.495902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:40.496948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:40.497381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:40.651095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:40.660937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:40.662923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:40.664382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-898d205a-3295-4688-b205-cf90d72b11dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.184100 May 23 13:36:40.665380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 302/610] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:41.084112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3b8dd1c6-95a5-4436-8e39-0176d69229ac tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:41.084804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3b8dd1c6-95a5-4436-8e39-0176d69229ac tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:41.088296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=88 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:41.091821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b8dd1c6-95a5-4436-8e39-0176d69229ac tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:41.092658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b8dd1c6-95a5-4436-8e39-0176d69229ac tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:41.093158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b8dd1c6-95a5-4436-8e39-0176d69229ac tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:41.099349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b8dd1c6-95a5-4436-8e39-0176d69229ac tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:41.240820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b8dd1c6-95a5-4436-8e39-0176d69229ac tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:41.249097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3b8dd1c6-95a5-4436-8e39-0176d69229ac tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.168901 May 23 13:36:41.273859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 309/611] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:41 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:41.683180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:41.683819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:41.690359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:41.690810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:41.691577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:41.692013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:41.710050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:41.857539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:41.857539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:41.857814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:41.857814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5a1934bf-144b-4f5a-abcf-2370893fb90a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.178036 May 23 13:36:41.858001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 303/612] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:41 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:42.270338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-db37d949-3b3e-49f0-88fc-509ae51d41c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:42.271441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-db37d949-3b3e-49f0-88fc-509ae51d41c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:42.279588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db37d949-3b3e-49f0-88fc-509ae51d41c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:42.280156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db37d949-3b3e-49f0-88fc-509ae51d41c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:42.281164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db37d949-3b3e-49f0-88fc-509ae51d41c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:42.281778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db37d949-3b3e-49f0-88fc-509ae51d41c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:42.426550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-db37d949-3b3e-49f0-88fc-509ae51d41c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:42.433970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-db37d949-3b3e-49f0-88fc-509ae51d41c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.168826 May 23 13:36:42.434538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 310/613] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:42 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:42.876788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:42.877448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:42.884753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:42.885188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:42.886086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:42.886521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:43.027993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:43.036743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:43.038250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:43.039420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36ccace7-60a8-44da-a2b5-39706d6eb642 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.167418 May 23 13:36:43.039986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 304/614] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:42 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:43.451033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b15dc04-3383-4267-8bd6-49f2251ec901 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:43.451755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b15dc04-3383-4267-8bd6-49f2251ec901 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:43.459745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b15dc04-3383-4267-8bd6-49f2251ec901 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:43.460802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b15dc04-3383-4267-8bd6-49f2251ec901 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:43.461706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b15dc04-3383-4267-8bd6-49f2251ec901 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:43.462218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b15dc04-3383-4267-8bd6-49f2251ec901 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:43.609887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b15dc04-3383-4267-8bd6-49f2251ec901 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:43.613804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b15dc04-3383-4267-8bd6-49f2251ec901 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.166843 May 23 13:36:43.613999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 311/615] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:43 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:44.060946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:44.060946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:44.067921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:44.068509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:44.069379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:44.069891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:44.235649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:44.245015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:44.246708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:44.247962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d590a81-17dc-451b-a40c-c7a8e26a90c3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.193069 May 23 13:36:44.248627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 305/616] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:44 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:44.633917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52e62f55-0489-4521-99c8-e111b3f5cd3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:44.635590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52e62f55-0489-4521-99c8-e111b3f5cd3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:44.647057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52e62f55-0489-4521-99c8-e111b3f5cd3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:44.647944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52e62f55-0489-4521-99c8-e111b3f5cd3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:44.649122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52e62f55-0489-4521-99c8-e111b3f5cd3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:44.650064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52e62f55-0489-4521-99c8-e111b3f5cd3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:44.827699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52e62f55-0489-4521-99c8-e111b3f5cd3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:44.835944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52e62f55-0489-4521-99c8-e111b3f5cd3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.207962 May 23 13:36:44.838617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 312/617] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:44 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:45.268878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:45.269634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:45.272171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:45.277668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:45.278204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:45.279095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:45.279742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:45.422464 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:45.432642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:45.436499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:45.436499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fbfabd14-35e1-4ad0-91f9-432c09fa0643 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.172020 May 23 13:36:45.436499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 306/618] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:45.854025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f0a2d8c4-721a-462a-bd61-b8b6e5e92515 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:45.854667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f0a2d8c4-721a-462a-bd61-b8b6e5e92515 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:45.862334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0a2d8c4-721a-462a-bd61-b8b6e5e92515 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:45.862765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0a2d8c4-721a-462a-bd61-b8b6e5e92515 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:45.863526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0a2d8c4-721a-462a-bd61-b8b6e5e92515 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:45.863956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0a2d8c4-721a-462a-bd61-b8b6e5e92515 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:45.866565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:36:46.007041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f0a2d8c4-721a-462a-bd61-b8b6e5e92515 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:46.015431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f0a2d8c4-721a-462a-bd61-b8b6e5e92515 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.165271 May 23 13:36:46.016454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 313/619] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:45 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:46.454093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:46.455470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:46.463189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:46.463936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:46.464807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:46.465241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:46.624307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:46.636755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:46.638259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:46.639447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94e97b0f-325d-441d-9034-1660bd7a9afa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.189715 May 23 13:36:46.640188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 307/620] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:47.033970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c1378481-5dab-4c20-acf5-47b12ad4acd7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:47.034587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c1378481-5dab-4c20-acf5-47b12ad4acd7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:47.041249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1378481-5dab-4c20-acf5-47b12ad4acd7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:47.041696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1378481-5dab-4c20-acf5-47b12ad4acd7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:47.042464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1378481-5dab-4c20-acf5-47b12ad4acd7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:47.042896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1378481-5dab-4c20-acf5-47b12ad4acd7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:47.198384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1378481-5dab-4c20-acf5-47b12ad4acd7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:47.206927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c1378481-5dab-4c20-acf5-47b12ad4acd7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.177351 May 23 13:36:47.207672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 314/621] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:47 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:47.658291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:47.658902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:47.665674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:47.666126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:47.666887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:47.667319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:47.801388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:47.810291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:47.811792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:47.813532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da9c4434-984e-49a1-b4d5-efc319dd11a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.159221 May 23 13:36:47.814085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 308/622] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:47 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:48.223702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9599c435-75f4-4512-8aa9-fafeb47a81bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:48.224260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9599c435-75f4-4512-8aa9-fafeb47a81bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:48.231000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9599c435-75f4-4512-8aa9-fafeb47a81bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:48.231452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9599c435-75f4-4512-8aa9-fafeb47a81bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:48.232222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9599c435-75f4-4512-8aa9-fafeb47a81bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:48.232684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9599c435-75f4-4512-8aa9-fafeb47a81bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:48.370580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9599c435-75f4-4512-8aa9-fafeb47a81bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:48.378989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9599c435-75f4-4512-8aa9-fafeb47a81bc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.159173 May 23 13:36:48.379574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 315/623] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:48 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:48.831338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:48.831937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:48.838923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:48.839373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:48.840139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:48.840591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:48.979473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:48.988849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:48.990357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:48.991522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a40de26d-f015-4c59-8bf3-77f6758072b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.164216 May 23 13:36:48.992334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 309/624] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:49.396818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ac8875e6-c369-444f-bad2-136177a11172 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:49.397506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ac8875e6-c369-444f-bad2-136177a11172 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:49.404446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac8875e6-c369-444f-bad2-136177a11172 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:49.404927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac8875e6-c369-444f-bad2-136177a11172 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:49.405687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac8875e6-c369-444f-bad2-136177a11172 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:49.406131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac8875e6-c369-444f-bad2-136177a11172 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:49.535585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ac8875e6-c369-444f-bad2-136177a11172 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:49.543098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ac8875e6-c369-444f-bad2-136177a11172 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.150522 May 23 13:36:49.543664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 316/625] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:49 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:50.010061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:50.010665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:50.018443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:50.019006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:50.019869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:50.020332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:50.159458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:50.167786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:50.169301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:50.170450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-177df3b2-d0cb-47b1-90c5-668dcfd23cdc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.164322 May 23 13:36:50.171001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 310/626] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:50 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:50.561720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-94e25f6d-77be-4a9b-8f27-489eb6fca989 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:50.566398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-94e25f6d-77be-4a9b-8f27-489eb6fca989 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:50.573484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94e25f6d-77be-4a9b-8f27-489eb6fca989 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:50.574252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94e25f6d-77be-4a9b-8f27-489eb6fca989 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:50.575732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94e25f6d-77be-4a9b-8f27-489eb6fca989 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:50.576234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94e25f6d-77be-4a9b-8f27-489eb6fca989 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:50.761151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94e25f6d-77be-4a9b-8f27-489eb6fca989 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:50.771227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-94e25f6d-77be-4a9b-8f27-489eb6fca989 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.214971 May 23 13:36:50.772170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 317/627] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:50 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:51.190872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:51.191483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:51.198061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:51.198506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:51.199267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:51.199763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:51.334763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:51.346250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:51.347980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:51.349451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd5413aa-d37e-44ad-93ce-807484a3b92d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.162403 May 23 13:36:51.350259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 311/628] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:51 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:51.788848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a3ee6261-c215-4430-81c7-3db92fe2ae4c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:51.789471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a3ee6261-c215-4430-81c7-3db92fe2ae4c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:51.795866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3ee6261-c215-4430-81c7-3db92fe2ae4c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:51.800360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3ee6261-c215-4430-81c7-3db92fe2ae4c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:51.800360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3ee6261-c215-4430-81c7-3db92fe2ae4c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:51.800360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3ee6261-c215-4430-81c7-3db92fe2ae4c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:51.931090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a3ee6261-c215-4430-81c7-3db92fe2ae4c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:51.939158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a3ee6261-c215-4430-81c7-3db92fe2ae4c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.154182 May 23 13:36:51.939724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 318/629] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:51 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:52.428752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:36:52.429831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 (ip 10.222.0.70) !!! May 23 13:36:52.488981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:52.489671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:52.496965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:52.497420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:52.498191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:52.498631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:52.636429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:52.645991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:52.647523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:52.648717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7d224af3-a91c-45cb-9104-5eea9f878f6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.283674 May 23 13:36:52.649283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 312/630] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:52 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:52.956443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f05b87a6-bdd0-425f-a08c-399a3f27514f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:52.957097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f05b87a6-bdd0-425f-a08c-399a3f27514f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:52.964145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05b87a6-bdd0-425f-a08c-399a3f27514f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:52.964637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05b87a6-bdd0-425f-a08c-399a3f27514f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:52.965433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05b87a6-bdd0-425f-a08c-399a3f27514f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:52.965875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05b87a6-bdd0-425f-a08c-399a3f27514f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:53.103632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f05b87a6-bdd0-425f-a08c-399a3f27514f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:53.111531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f05b87a6-bdd0-425f-a08c-399a3f27514f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.159657 May 23 13:36:53.122983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 319/631] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:52 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:53.667427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:53.668067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:53.674624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:53.675067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:53.675830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:53.676257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:53.813406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:53.823750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:53.825388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:53.826670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dcecf0ef-29fd-4993-a841-554f313ea6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.163252 May 23 13:36:53.827230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 313/632] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:53 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:54.129193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ee7a6c3-4e20-4f6a-9634-c4cd10d88e38 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:54.129975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ee7a6c3-4e20-4f6a-9634-c4cd10d88e38 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:54.137238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6c3-4e20-4f6a-9634-c4cd10d88e38 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:54.137680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6c3-4e20-4f6a-9634-c4cd10d88e38 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:54.138453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6c3-4e20-4f6a-9634-c4cd10d88e38 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:54.138888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6c3-4e20-4f6a-9634-c4cd10d88e38 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:54.272807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ee7a6c3-4e20-4f6a-9634-c4cd10d88e38 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:54.280216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ee7a6c3-4e20-4f6a-9634-c4cd10d88e38 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.155776 May 23 13:36:54.280820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 320/633] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:54 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:54.772937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-c63d5ee0-efa4-4ca2-baa8-b7fee895a51b req-df101f52-b7e0-4ecb-a602-31f7fa30a977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d8069e-32b9-4e3b-aabc-a8bf5bd66c55", "tag": "f2d47605-ebc6-41ec-9a5e-d82223b3b591"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:36:54.781250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c63d5ee0-efa4-4ca2-baa8-b7fee895a51b req-df101f52-b7e0-4ecb-a602-31f7fa30a977 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:54.782359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c63d5ee0-efa4-4ca2-baa8-b7fee895a51b req-df101f52-b7e0-4ecb-a602-31f7fa30a977 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:54.793467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-c63d5ee0-efa4-4ca2-baa8-b7fee895a51b req-df101f52-b7e0-4ecb-a602-31f7fa30a977 service nova] Creating event network-changed:f2d47605-ebc6-41ec-9a5e-d82223b3b591 for instance 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 on hv-cinder-82549 May 23 13:36:54.799488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-c63d5ee0-efa4-4ca2-baa8-b7fee895a51b req-df101f52-b7e0-4ecb-a602-31f7fa30a977 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030199 May 23 13:36:54.800095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 314/634] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:36:54.845940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:54.846544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:54.855634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:54.855634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:54.855634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:54.855634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:54.991444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:55.000881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:55.002419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:55.003599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2af6999d-fd3f-4f36-b092-47d73b0b4003 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.161802 May 23 13:36:55.004163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 321/635] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:54 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:55.299405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cadeedac-4a25-4b94-88ce-1babb0518f3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:55.300109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cadeedac-4a25-4b94-88ce-1babb0518f3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:55.306424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cadeedac-4a25-4b94-88ce-1babb0518f3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:55.306878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cadeedac-4a25-4b94-88ce-1babb0518f3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:55.307697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cadeedac-4a25-4b94-88ce-1babb0518f3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:55.308117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cadeedac-4a25-4b94-88ce-1babb0518f3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:55.445884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cadeedac-4a25-4b94-88ce-1babb0518f3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:55.454051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cadeedac-4a25-4b94-88ce-1babb0518f3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.159295 May 23 13:36:55.454628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 315/636] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:55 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:56.025563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:56.026184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:56.033751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:56.034271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:56.035059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:56.035529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:56.166558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:56.176202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:56.177843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:56.179061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2ff7bf70-d459-4a44-8a8a-9abcd9afa2b3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.157382 May 23 13:36:56.179622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 322/637] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:56 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:36:56.472403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-30d26a36-b4c9-471e-87ec-261812ffa90c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:56.473048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-30d26a36-b4c9-471e-87ec-261812ffa90c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:56.479790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30d26a36-b4c9-471e-87ec-261812ffa90c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:56.485190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30d26a36-b4c9-471e-87ec-261812ffa90c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:56.485190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30d26a36-b4c9-471e-87ec-261812ffa90c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:56.485190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30d26a36-b4c9-471e-87ec-261812ffa90c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:56.626477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-30d26a36-b4c9-471e-87ec-261812ffa90c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:56.634066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-30d26a36-b4c9-471e-87ec-261812ffa90c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.166268 May 23 13:36:56.635560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 316/638] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:56 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:57.198182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:57.198785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:57.207222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:57.207684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:57.208465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:57.209071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:57.391732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:57.413175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:57.414921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:57.416130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7c0de522-9fd4-4221-afa7-51e8d9164a77 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.222146 May 23 13:36:57.416728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 323/639] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:57 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:57.651306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-286bc85d-ce36-4fa0-a524-1c6b83ab1569 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:57.651953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-286bc85d-ce36-4fa0-a524-1c6b83ab1569 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:57.659158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-286bc85d-ce36-4fa0-a524-1c6b83ab1569 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:57.659276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-286bc85d-ce36-4fa0-a524-1c6b83ab1569 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:57.660073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-286bc85d-ce36-4fa0-a524-1c6b83ab1569 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:57.660499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-286bc85d-ce36-4fa0-a524-1c6b83ab1569 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:57.811567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-286bc85d-ce36-4fa0-a524-1c6b83ab1569 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:57.819771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-286bc85d-ce36-4fa0-a524-1c6b83ab1569 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.172366 May 23 13:36:57.820368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 317/640] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:57 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:58.435227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:58.435789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:58.443189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:58.443647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:58.444634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:58.445081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:58.742561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:58.750973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:58.752522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:58.753713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c9947537-615b-42e7-8033-76f70d0dc0af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.322459 May 23 13:36:58.754271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 324/641] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:58.837068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c632d61f-8198-44b3-9cb9-59e903cf2d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:58.837709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c632d61f-8198-44b3-9cb9-59e903cf2d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:58.844304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c632d61f-8198-44b3-9cb9-59e903cf2d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:58.844786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c632d61f-8198-44b3-9cb9-59e903cf2d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:58.845540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c632d61f-8198-44b3-9cb9-59e903cf2d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:58.845981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c632d61f-8198-44b3-9cb9-59e903cf2d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:58.975490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c632d61f-8198-44b3-9cb9-59e903cf2d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:58.983050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c632d61f-8198-44b3-9cb9-59e903cf2d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.150095 May 23 13:36:58.983610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 318/642] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:58 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:36:59.771533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:36:59.772056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:36:59.778503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:59.778956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:59.779730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:36:59.780171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:36:59.909223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:59.917757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:59.921241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:36:59.921241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0689f54f-19a0-44ff-b759-b8f2197f1941 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.153105 May 23 13:36:59.921241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 325/643] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:36:59 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:36:59.999864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f16d1692-d133-438d-a3dd-999544a48780 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:00.001095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f16d1692-d133-438d-a3dd-999544a48780 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:00.007464 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f16d1692-d133-438d-a3dd-999544a48780 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:00.007911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f16d1692-d133-438d-a3dd-999544a48780 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:00.008755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f16d1692-d133-438d-a3dd-999544a48780 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:00.009192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f16d1692-d133-438d-a3dd-999544a48780 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:00.139310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f16d1692-d133-438d-a3dd-999544a48780 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:00.146716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f16d1692-d133-438d-a3dd-999544a48780 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.150702 May 23 13:37:00.147296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 319/644] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:36:59 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:37:00.939889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:00.940481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:00.947018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:00.947464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:00.948216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:00.948679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:01.090459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:01.100889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:01.102864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:01.104179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1236716-99d7-4ab7-b3bf-ede7e9bb344b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.168182 May 23 13:37:01.105004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 326/645] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:01.163482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4160cfe5-f607-417f-b8a4-3bc79fc54d48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:01.164151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4160cfe5-f607-417f-b8a4-3bc79fc54d48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:01.170678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4160cfe5-f607-417f-b8a4-3bc79fc54d48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:01.171181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4160cfe5-f607-417f-b8a4-3bc79fc54d48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:01.172005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4160cfe5-f607-417f-b8a4-3bc79fc54d48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:01.172512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4160cfe5-f607-417f-b8a4-3bc79fc54d48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:01.543460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4160cfe5-f607-417f-b8a4-3bc79fc54d48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:01.547483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:37:01.551926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4160cfe5-f607-417f-b8a4-3bc79fc54d48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.392249 May 23 13:37:01.552710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 320/646] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:37:01 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:37:02.123765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:02.124376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:02.131383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:02.133813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:02.134612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:02.135061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:02.271530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:02.279969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:02.282177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:02.283502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2931d90c-4f5b-4fa3-84de-c73b2861cde6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.163616 May 23 13:37:02.284053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 327/647] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:02 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:02.569870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0b0dde3d-a0dd-4e15-a2a6-25ecfba82054 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:02.570462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0b0dde3d-a0dd-4e15-a2a6-25ecfba82054 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:02.577451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b0dde3d-a0dd-4e15-a2a6-25ecfba82054 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:02.578008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b0dde3d-a0dd-4e15-a2a6-25ecfba82054 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:02.579335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b0dde3d-a0dd-4e15-a2a6-25ecfba82054 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:02.579773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b0dde3d-a0dd-4e15-a2a6-25ecfba82054 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:02.711895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0b0dde3d-a0dd-4e15-a2a6-25ecfba82054 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:02.719456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0b0dde3d-a0dd-4e15-a2a6-25ecfba82054 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.153822 May 23 13:37:02.720117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 321/648] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:37:02 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:37:03.303141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:03.303754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:03.310676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:03.311125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:03.311913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:03.312414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:03.454984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:03.464026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:03.465690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:03.466882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a55f1df9-06e4-4d77-9f30-f1430667778f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.167816 May 23 13:37:03.467418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 328/649] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:03 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:03.737708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c60757a6-6a4e-468a-8f79-dbceb38c2ef1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:03.738490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c60757a6-6a4e-468a-8f79-dbceb38c2ef1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:03.746526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c60757a6-6a4e-468a-8f79-dbceb38c2ef1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:03.747080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c60757a6-6a4e-468a-8f79-dbceb38c2ef1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:03.747969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c60757a6-6a4e-468a-8f79-dbceb38c2ef1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:03.748499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c60757a6-6a4e-468a-8f79-dbceb38c2ef1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:03.888991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c60757a6-6a4e-468a-8f79-dbceb38c2ef1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:03.897482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c60757a6-6a4e-468a-8f79-dbceb38c2ef1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.164826 May 23 13:37:03.897991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 322/650] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:37:03 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:37:04.486380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:04.486928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:04.493632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:04.494084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:04.494852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:04.495287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:04.636249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:04.638490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:37:04.646227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:04.647745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:04.648936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3b292672-9408-4d50-ad65-797ef71ab0fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.167165 May 23 13:37:04.652356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 329/651] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:04 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:04.915305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9b568d65-3bed-425b-b43c-ae3418b81a43 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:04.915912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9b568d65-3bed-425b-b43c-ae3418b81a43 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:04.922764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b568d65-3bed-425b-b43c-ae3418b81a43 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:04.923210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b568d65-3bed-425b-b43c-ae3418b81a43 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:04.923967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b568d65-3bed-425b-b43c-ae3418b81a43 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:04.924399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b568d65-3bed-425b-b43c-ae3418b81a43 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:05.057532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b568d65-3bed-425b-b43c-ae3418b81a43 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:05.065714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9b568d65-3bed-425b-b43c-ae3418b81a43 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.154302 May 23 13:37:05.066185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 323/652] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:37:04 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:37:05.570369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-815691dc-e242-412c-b669-b83324ad4cbc req-4b16f7d2-f80f-44e3-a186-c57498ee53bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d8069e-32b9-4e3b-aabc-a8bf5bd66c55", "name": "network-vif-plugged", "status": "completed", "tag": "f2d47605-ebc6-41ec-9a5e-d82223b3b591"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:37:05.580178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-815691dc-e242-412c-b669-b83324ad4cbc req-4b16f7d2-f80f-44e3-a186-c57498ee53bf service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:05.580671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-815691dc-e242-412c-b669-b83324ad4cbc req-4b16f7d2-f80f-44e3-a186-c57498ee53bf service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:05.591779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-815691dc-e242-412c-b669-b83324ad4cbc req-4b16f7d2-f80f-44e3-a186-c57498ee53bf service nova] Creating event network-vif-plugged:f2d47605-ebc6-41ec-9a5e-d82223b3b591 for instance 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 on hv-cinder-82549 May 23 13:37:05.597545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-815691dc-e242-412c-b669-b83324ad4cbc req-4b16f7d2-f80f-44e3-a186-c57498ee53bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030927 May 23 13:37:05.598143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 330/653] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:37:05.675920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:05.677433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:05.687890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:05.688801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:05.690160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:05.691012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:05.845359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:05.854513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:05.856443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:05.857691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3da1212c-6a60-46ff-a350-aec1811880ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.190920 May 23 13:37:05.858261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 324/654] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:05 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:06.088061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-84bfca22-b54a-4397-b919-88f6f06ce0a1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:06.088807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-84bfca22-b54a-4397-b919-88f6f06ce0a1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:06.096208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84bfca22-b54a-4397-b919-88f6f06ce0a1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:06.096658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84bfca22-b54a-4397-b919-88f6f06ce0a1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:06.097437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84bfca22-b54a-4397-b919-88f6f06ce0a1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:06.097880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84bfca22-b54a-4397-b919-88f6f06ce0a1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:06.247040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84bfca22-b54a-4397-b919-88f6f06ce0a1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:06.254835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-84bfca22-b54a-4397-b919-88f6f06ce0a1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.171193 May 23 13:37:06.255404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 331/655] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:37:06 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:37:06.878368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:06.879199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:06.886072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:06.886562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:06.887326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:06.887752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:07.024043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:07.035536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:07.037102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:07.038440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c760912-8847-468e-8582-64734fe1e536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.165476 May 23 13:37:07.039108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 325/656] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:06 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:07.271992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2364ccf-fc1e-4f4d-aa02-a382397c6858 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:07.272925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2364ccf-fc1e-4f4d-aa02-a382397c6858 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:07.280047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2364ccf-fc1e-4f4d-aa02-a382397c6858 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:07.280497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2364ccf-fc1e-4f4d-aa02-a382397c6858 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:07.281843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2364ccf-fc1e-4f4d-aa02-a382397c6858 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:07.282319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2364ccf-fc1e-4f4d-aa02-a382397c6858 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:07.419065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2364ccf-fc1e-4f4d-aa02-a382397c6858 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:07.428662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2364ccf-fc1e-4f4d-aa02-a382397c6858 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1318 microversion: 2.1 time: 0.159772 May 23 13:37:07.428662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 332/657] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:37:07 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:37:08.058098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:08.058728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:08.066615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:08.067067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:08.067869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:08.068308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:08.222434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:08.231809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:08.232916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:08.234640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3e89b8e1-e7f2-4f85-8e06-bdf790ddbf65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.179903 May 23 13:37:08.235845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 326/658] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:08 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:37:08.444592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b5efaf89-60a9-4fbf-a788-544ad2443576 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:08.445273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b5efaf89-60a9-4fbf-a788-544ad2443576 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:08.451825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5efaf89-60a9-4fbf-a788-544ad2443576 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:08.458932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5efaf89-60a9-4fbf-a788-544ad2443576 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:08.459747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5efaf89-60a9-4fbf-a788-544ad2443576 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:08.460183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5efaf89-60a9-4fbf-a788-544ad2443576 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:08.598441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5efaf89-60a9-4fbf-a788-544ad2443576 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:08.605990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b5efaf89-60a9-4fbf-a788-544ad2443576 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1506 microversion: 2.1 time: 0.165478 May 23 13:37:08.606561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 333/659] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:37:08 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:37:08.623591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07be1e85-4a2a-4f16-9ac2-580022bc162e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d44b192-0fb0-44fe-8b5d-58f1d30f9737", "device": "/dev/sdb"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:37:08.625718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07be1e85-4a2a-4f16-9ac2-580022bc162e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:08.632665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07be1e85-4a2a-4f16-9ac2-580022bc162e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:08.633120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07be1e85-4a2a-4f16-9ac2-580022bc162e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:08.633932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07be1e85-4a2a-4f16-9ac2-580022bc162e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:08.634377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07be1e85-4a2a-4f16-9ac2-580022bc162e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:09.254507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:09.255276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:09.261601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:09.262884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:09.262884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:09.263266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:09.403726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:09.412916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:09.414460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:09.415705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-30aca1a8-a8f5-4395-9f79-9f1c742f7711 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.165555 May 23 13:37:09.416442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 334/660] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:09 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:37:09.800100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07be1e85-4a2a-4f16-9ac2-580022bc162e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "POST /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.181417 May 23 13:37:09.801528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 327/661] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 13:37:08 2022] POST /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments => generated 194 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:37:10.098188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-53add9a6-d7ac-445f-bd3d-68b6b0d99366 req-354593a8-e788-40fa-924c-b72c0d53e8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011172-f0cf-4b8a-9791-2535bb8bcaa4", "name": "network-vif-plugged", "status": "completed", "tag": "8fcc06ea-c028-490c-8ab1-e434a5b0c699"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:37:10.107360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-53add9a6-d7ac-445f-bd3d-68b6b0d99366 req-354593a8-e788-40fa-924c-b72c0d53e8ff service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:10.109433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-53add9a6-d7ac-445f-bd3d-68b6b0d99366 req-354593a8-e788-40fa-924c-b72c0d53e8ff service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:10.119947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-53add9a6-d7ac-445f-bd3d-68b6b0d99366 req-354593a8-e788-40fa-924c-b72c0d53e8ff service nova] Creating event network-vif-plugged:8fcc06ea-c028-490c-8ab1-e434a5b0c699 for instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 on hv-cinder-82549 May 23 13:37:10.125211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-53add9a6-d7ac-445f-bd3d-68b6b0d99366 req-354593a8-e788-40fa-924c-b72c0d53e8ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030388 May 23 13:37:10.126141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 335/662] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:37:10.435019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:10.435692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:10.443532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:10.443981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:10.444813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:10.445215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:10.578719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:10.587294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:10.588831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:10.589997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e36512e1-7676-47e1-8733-083bf5eb90c0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.159338 May 23 13:37:10.590556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 328/663] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:10 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:11.610063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:11.611548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:11.613820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=54 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:37:11.619274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:11.619723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:11.620545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:11.621020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:11.759690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:11.768414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:11.769934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:11.771085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e5af33e1-758b-4b38-9829-8162d4b7171d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.166185 May 23 13:37:11.771640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 336/664] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:12.790078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:12.790605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:12.797956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:12.798431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:12.799241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:12.799622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:12.935853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:12.946677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:12.948246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:12.949671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-05958c7e-0e9c-49ad-877d-f43bfb79adfc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.163438 May 23 13:37:12.950228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 329/665] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:13.968434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:13.969135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:13.975643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:13.976098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:13.976894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:13.977340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:14.115885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:14.125241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:14.126780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:14.127944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e64a0646-6b9c-4b6e-bcfd-9edff1f5236c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.163627 May 23 13:37:14.128504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 337/666] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:13 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:15.146264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:15.146867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:15.153328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:15.153772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:15.154522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:15.154951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:15.288095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:15.296934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:15.298580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:15.299731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-53eb903a-8d94-4abf-a5e6-1e50e452d1f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.157284 May 23 13:37:15.300278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 330/667] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:15 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:16.318446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:16.319063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:16.325192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:16.325648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:16.326416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:16.326857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:16.464683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:16.478453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:16.479990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:16.481297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d6df67e0-b5a0-4e14-b849-251208a78bc6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.166853 May 23 13:37:16.481755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 338/668] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:17.500087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:17.508432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:17.508432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=50 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:37:17.508432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:17.508432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:17.509190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:17.509627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:17.644409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:17.653332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:17.654967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:17.656733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eedf7051-d7db-484a-966e-b6117f822d43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.161159 May 23 13:37:17.657300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 331/669] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:18.676464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:18.677268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:18.683744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:18.684204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:18.685017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:18.685459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:18.820112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:18.829120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:18.830642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:18.831806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7398ae4e-2141-4f9d-9d4f-1a15a1104042 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1809 microversion: 2.20 time: 0.160555 May 23 13:37:18.835015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 339/670] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:18 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:19.850007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:37:19.850701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:19.857272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:19.862354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:19.862354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:19.862354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:19.993276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:20.002159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:20.003663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:37:20.004853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2f052d1-aadf-4fab-8959-8dabb5cf356a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1796 microversion: 2.20 time: 0.158764 May 23 13:37:20.005408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 332/671] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:37:19 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:37:23.870459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-930e462b-4bfe-478c-8d1d-386c71fc1a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e1f9d6a-4778-4fc3-9ac2-4bc492d50148"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:37:23.871594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-930e462b-4bfe-478c-8d1d-386c71fc1a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:37:23.878688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-930e462b-4bfe-478c-8d1d-386c71fc1a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:23.879153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-930e462b-4bfe-478c-8d1d-386c71fc1a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:23.879965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-930e462b-4bfe-478c-8d1d-386c71fc1a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:37:23.880406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-930e462b-4bfe-478c-8d1d-386c71fc1a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:37:28.272462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-930e462b-4bfe-478c-8d1d-386c71fc1a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.510393 May 23 13:37:28.273181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 340/672] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 13:37:23 2022] POST /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 194 bytes in 4512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:38:09.798548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:09.799319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:09.915631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99104c49-7fca-40c4-b352-d4d0d504405d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:09.916116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99104c49-7fca-40c4-b352-d4d0d504405d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:09.922592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99104c49-7fca-40c4-b352-d4d0d504405d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:09.923030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99104c49-7fca-40c4-b352-d4d0d504405d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:09.923820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99104c49-7fca-40c4-b352-d4d0d504405d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:09.924220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99104c49-7fca-40c4-b352-d4d0d504405d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:10.053469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-99104c49-7fca-40c4-b352-d4d0d504405d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lazy-loading 'services' on Instance uuid 2618bd92-79d0-43b5-8067-c26548f759c3 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:38:10.331946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99104c49-7fca-40c4-b352-d4d0d504405d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments/cc469050-86ae-4326-b727-a7d9c246d6b9" status: 202 len: 0 microversion: 2.1 time: 0.538308 May 23 13:38:10.332529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 333/673] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:38:09 2022] DELETE /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments/cc469050-86ae-4326-b727-a7d9c246d6b9 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:38:12.310596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=9 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:12.311812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:12.315842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9928275c-77af-4628-bd22-1a272f558d3a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:38:12.317005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9928275c-77af-4628-bd22-1a272f558d3a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:12.324782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9928275c-77af-4628-bd22-1a272f558d3a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:12.325239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9928275c-77af-4628-bd22-1a272f558d3a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:12.326330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9928275c-77af-4628-bd22-1a272f558d3a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:12.326638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9928275c-77af-4628-bd22-1a272f558d3a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:12.587921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9928275c-77af-4628-bd22-1a272f558d3a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "POST /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/action" status: 202 len: 0 microversion: 2.1 time: 0.279163 May 23 13:38:12.588591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 341/674] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:38:12 2022] POST /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 13:38:12.598424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ae7e05d-f670-47e4-9173-14878fe6e470 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:12.608206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ae7e05d-f670-47e4-9173-14878fe6e470 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:12.608206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ae7e05d-f670-47e4-9173-14878fe6e470 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:12.608206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ae7e05d-f670-47e4-9173-14878fe6e470 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:12.608206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ae7e05d-f670-47e4-9173-14878fe6e470 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:12.608625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ae7e05d-f670-47e4-9173-14878fe6e470 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:12.761054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ae7e05d-f670-47e4-9173-14878fe6e470 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:12.770437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ae7e05d-f670-47e4-9173-14878fe6e470 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.176665 May 23 13:38:12.771011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 334/675] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:12 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:13.789927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d323deaf-b309-4917-8851-6553da0f5379 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:13.790572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d323deaf-b309-4917-8851-6553da0f5379 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:13.797607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d323deaf-b309-4917-8851-6553da0f5379 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:13.798055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d323deaf-b309-4917-8851-6553da0f5379 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:13.798816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d323deaf-b309-4917-8851-6553da0f5379 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:13.799255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d323deaf-b309-4917-8851-6553da0f5379 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:13.947222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d323deaf-b309-4917-8851-6553da0f5379 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:13.956634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d323deaf-b309-4917-8851-6553da0f5379 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.171324 May 23 13:38:13.957222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 342/676] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:13 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:14.973472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5131e7c7-6838-42c3-bbf0-071932725b1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:14.974079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5131e7c7-6838-42c3-bbf0-071932725b1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:14.980603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5131e7c7-6838-42c3-bbf0-071932725b1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:14.980937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5131e7c7-6838-42c3-bbf0-071932725b1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:14.981730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5131e7c7-6838-42c3-bbf0-071932725b1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:14.982155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5131e7c7-6838-42c3-bbf0-071932725b1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:15.126777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5131e7c7-6838-42c3-bbf0-071932725b1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:15.136640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5131e7c7-6838-42c3-bbf0-071932725b1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.166848 May 23 13:38:15.137231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 335/677] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:14 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:16.156133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f9f13c71-a44b-4d1c-a771-b0da9820b23f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:16.156747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f9f13c71-a44b-4d1c-a771-b0da9820b23f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:16.163315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9f13c71-a44b-4d1c-a771-b0da9820b23f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:16.163766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9f13c71-a44b-4d1c-a771-b0da9820b23f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:16.164549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9f13c71-a44b-4d1c-a771-b0da9820b23f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:16.165020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9f13c71-a44b-4d1c-a771-b0da9820b23f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:16.339326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f9f13c71-a44b-4d1c-a771-b0da9820b23f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:16.348657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f9f13c71-a44b-4d1c-a771-b0da9820b23f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.197009 May 23 13:38:16.349253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 343/678] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:16 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:17.366248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-50ecc2a0-142b-4503-98d4-c8f2d4990d57 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:17.367114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-50ecc2a0-142b-4503-98d4-c8f2d4990d57 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:17.374036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50ecc2a0-142b-4503-98d4-c8f2d4990d57 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:17.374489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50ecc2a0-142b-4503-98d4-c8f2d4990d57 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:17.375268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50ecc2a0-142b-4503-98d4-c8f2d4990d57 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:17.375706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50ecc2a0-142b-4503-98d4-c8f2d4990d57 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:17.535204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-50ecc2a0-142b-4503-98d4-c8f2d4990d57 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:17.545031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-50ecc2a0-142b-4503-98d4-c8f2d4990d57 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.182142 May 23 13:38:17.546159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 336/679] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:17 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:18.563820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33341c84-3cf6-4d72-aec5-fc3bd88efa2d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:18.564450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33341c84-3cf6-4d72-aec5-fc3bd88efa2d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:18.572071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33341c84-3cf6-4d72-aec5-fc3bd88efa2d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:18.572638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33341c84-3cf6-4d72-aec5-fc3bd88efa2d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:18.573506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33341c84-3cf6-4d72-aec5-fc3bd88efa2d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:18.574190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33341c84-3cf6-4d72-aec5-fc3bd88efa2d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:18.770267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33341c84-3cf6-4d72-aec5-fc3bd88efa2d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:18.780458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33341c84-3cf6-4d72-aec5-fc3bd88efa2d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.220529 May 23 13:38:18.781170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 344/680] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:18 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:19.798470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cd569655-8aef-493f-afa1-dacebdfafbbc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:19.799202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cd569655-8aef-493f-afa1-dacebdfafbbc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:19.805777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd569655-8aef-493f-afa1-dacebdfafbbc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:19.806228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd569655-8aef-493f-afa1-dacebdfafbbc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:19.806987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd569655-8aef-493f-afa1-dacebdfafbbc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:19.807419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd569655-8aef-493f-afa1-dacebdfafbbc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:20.122757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd569655-8aef-493f-afa1-dacebdfafbbc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:20.131708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cd569655-8aef-493f-afa1-dacebdfafbbc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.337009 May 23 13:38:20.132281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 337/681] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:19 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:21.150803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce265b01-d910-4329-8e98-e48e823742dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:21.151459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ce265b01-d910-4329-8e98-e48e823742dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:21.158389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce265b01-d910-4329-8e98-e48e823742dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:21.158843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce265b01-d910-4329-8e98-e48e823742dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:21.159620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce265b01-d910-4329-8e98-e48e823742dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:21.160060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce265b01-d910-4329-8e98-e48e823742dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:21.334877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ce265b01-d910-4329-8e98-e48e823742dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:21.347433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce265b01-d910-4329-8e98-e48e823742dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.200429 May 23 13:38:21.348037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 345/682] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:21 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:22.367796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b224d06-692d-4b79-bb46-7cb2cdf9e307 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:22.368687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b224d06-692d-4b79-bb46-7cb2cdf9e307 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:22.378155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b224d06-692d-4b79-bb46-7cb2cdf9e307 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:22.378739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b224d06-692d-4b79-bb46-7cb2cdf9e307 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:22.379617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b224d06-692d-4b79-bb46-7cb2cdf9e307 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:22.380122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b224d06-692d-4b79-bb46-7cb2cdf9e307 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:22.542901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4b224d06-692d-4b79-bb46-7cb2cdf9e307 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:22.551607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b224d06-692d-4b79-bb46-7cb2cdf9e307 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.189078 May 23 13:38:22.552180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 338/683] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:22 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:23.570016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6dc36d97-5800-49bf-9d85-b5ad1d890c77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:23.570591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6dc36d97-5800-49bf-9d85-b5ad1d890c77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:23.578479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dc36d97-5800-49bf-9d85-b5ad1d890c77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:23.578935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dc36d97-5800-49bf-9d85-b5ad1d890c77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:23.579728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dc36d97-5800-49bf-9d85-b5ad1d890c77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:23.580309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dc36d97-5800-49bf-9d85-b5ad1d890c77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:23.763092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6dc36d97-5800-49bf-9d85-b5ad1d890c77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:23.772270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6dc36d97-5800-49bf-9d85-b5ad1d890c77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.206519 May 23 13:38:23.773009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 346/684] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:23 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:24.791409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b459975b-137c-4b16-9634-56a32a552056 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:24.792193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b459975b-137c-4b16-9634-56a32a552056 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:24.800270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b459975b-137c-4b16-9634-56a32a552056 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:24.800760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b459975b-137c-4b16-9634-56a32a552056 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:24.801661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b459975b-137c-4b16-9634-56a32a552056 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:24.802115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b459975b-137c-4b16-9634-56a32a552056 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:24.977815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b459975b-137c-4b16-9634-56a32a552056 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:24.986752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b459975b-137c-4b16-9634-56a32a552056 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.199299 May 23 13:38:24.987323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 339/685] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:24 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:26.009444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eedef8d9-3971-4b53-a1b6-de7b1b78a5a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:26.012592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eedef8d9-3971-4b53-a1b6-de7b1b78a5a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:26.024397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eedef8d9-3971-4b53-a1b6-de7b1b78a5a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:26.025239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eedef8d9-3971-4b53-a1b6-de7b1b78a5a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:26.026682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eedef8d9-3971-4b53-a1b6-de7b1b78a5a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:26.027453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eedef8d9-3971-4b53-a1b6-de7b1b78a5a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:26.232218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eedef8d9-3971-4b53-a1b6-de7b1b78a5a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:26.248559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eedef8d9-3971-4b53-a1b6-de7b1b78a5a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.246693 May 23 13:38:26.252416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 347/686] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:25 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:27.268702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-33c3246f-db1b-4401-a4a3-999818f09063 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:27.269689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-33c3246f-db1b-4401-a4a3-999818f09063 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:27.278173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33c3246f-db1b-4401-a4a3-999818f09063 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:27.278647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33c3246f-db1b-4401-a4a3-999818f09063 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:27.279463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33c3246f-db1b-4401-a4a3-999818f09063 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:27.279909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33c3246f-db1b-4401-a4a3-999818f09063 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:27.447466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-33c3246f-db1b-4401-a4a3-999818f09063 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:27.471117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-33c3246f-db1b-4401-a4a3-999818f09063 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.193387 May 23 13:38:27.471117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 340/687] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:27 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:28.480448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7d19fba-971a-48ce-96ba-653566759a9c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:28.482971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7d19fba-971a-48ce-96ba-653566759a9c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:28.495711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7d19fba-971a-48ce-96ba-653566759a9c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:28.498516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7d19fba-971a-48ce-96ba-653566759a9c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:28.500741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7d19fba-971a-48ce-96ba-653566759a9c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:28.501511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7d19fba-971a-48ce-96ba-653566759a9c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:28.752006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7d19fba-971a-48ce-96ba-653566759a9c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:28.761098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7d19fba-971a-48ce-96ba-653566759a9c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1751 microversion: 2.1 time: 0.288220 May 23 13:38:28.761954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 348/688] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:28 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1751 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:28.958808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e1d5516b-6618-44c2-ad25-490bc59bf726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:38:28.959840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e1d5516b-6618-44c2-ad25-490bc59bf726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:28.968092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1d5516b-6618-44c2-ad25-490bc59bf726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:28.968545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1d5516b-6618-44c2-ad25-490bc59bf726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:28.969375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1d5516b-6618-44c2-ad25-490bc59bf726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:28.969816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1d5516b-6618-44c2-ad25-490bc59bf726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:28.996166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-e1d5516b-6618-44c2-ad25-490bc59bf726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'flavor' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:38:29.416371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e1d5516b-6618-44c2-ad25-490bc59bf726 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/action" status: 200 len: 32 microversion: 2.1 time: 0.461063 May 23 13:38:29.417456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 341/689] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:38:28 2022] POST /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 13:38:29.426999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dce21a4b-7b4b-4881-b705-0cc346429198 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:29.431022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dce21a4b-7b4b-4881-b705-0cc346429198 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:29.440052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dce21a4b-7b4b-4881-b705-0cc346429198 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:29.440848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dce21a4b-7b4b-4881-b705-0cc346429198 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:29.441721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dce21a4b-7b4b-4881-b705-0cc346429198 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:29.442181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dce21a4b-7b4b-4881-b705-0cc346429198 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:29.648487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dce21a4b-7b4b-4881-b705-0cc346429198 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:29.664070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dce21a4b-7b4b-4881-b705-0cc346429198 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.240934 May 23 13:38:29.664660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 349/690] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:29.783317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d65c933-f7b1-4513-9e65-280b6f05b183 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:29.784127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d65c933-f7b1-4513-9e65-280b6f05b183 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:29.793008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d65c933-f7b1-4513-9e65-280b6f05b183 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:29.793889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d65c933-f7b1-4513-9e65-280b6f05b183 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:29.795709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d65c933-f7b1-4513-9e65-280b6f05b183 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:29.796498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d65c933-f7b1-4513-9e65-280b6f05b183 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:30.063944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d65c933-f7b1-4513-9e65-280b6f05b183 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:30.073495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d65c933-f7b1-4513-9e65-280b6f05b183 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.295624 May 23 13:38:30.074364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 342/691] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:29 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:30.683594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d1324aa6-b341-40d4-9bab-3bd63580545d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:30.685161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d1324aa6-b341-40d4-9bab-3bd63580545d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:30.694615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1324aa6-b341-40d4-9bab-3bd63580545d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:30.695135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1324aa6-b341-40d4-9bab-3bd63580545d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:30.696062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1324aa6-b341-40d4-9bab-3bd63580545d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:30.696686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1324aa6-b341-40d4-9bab-3bd63580545d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:30.870896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d1324aa6-b341-40d4-9bab-3bd63580545d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:30.880164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d1324aa6-b341-40d4-9bab-3bd63580545d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.200832 May 23 13:38:30.880782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 350/692] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:31.093056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ae59a3a-b172-47f0-b463-e02123ace571 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:31.093666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0ae59a3a-b172-47f0-b463-e02123ace571 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:31.101309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ae59a3a-b172-47f0-b463-e02123ace571 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:31.101779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ae59a3a-b172-47f0-b463-e02123ace571 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:31.102612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ae59a3a-b172-47f0-b463-e02123ace571 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:31.103055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ae59a3a-b172-47f0-b463-e02123ace571 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:31.290418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0ae59a3a-b172-47f0-b463-e02123ace571 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:31.299809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0ae59a3a-b172-47f0-b463-e02123ace571 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.212151 May 23 13:38:31.300389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 343/693] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:31 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:31.898452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f2353d2-85fb-4451-9b51-472db52cbbfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:31.899461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f2353d2-85fb-4451-9b51-472db52cbbfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:31.907666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f2353d2-85fb-4451-9b51-472db52cbbfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:31.908121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f2353d2-85fb-4451-9b51-472db52cbbfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:31.908949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f2353d2-85fb-4451-9b51-472db52cbbfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:31.909401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f2353d2-85fb-4451-9b51-472db52cbbfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:32.070959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f2353d2-85fb-4451-9b51-472db52cbbfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:32.085991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f2353d2-85fb-4451-9b51-472db52cbbfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.191096 May 23 13:38:32.087033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 351/694] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:32.318632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8d316cb-98d4-4378-b37e-2274168dc29b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:32.319369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8d316cb-98d4-4378-b37e-2274168dc29b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:32.327096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d316cb-98d4-4378-b37e-2274168dc29b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:32.327555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d316cb-98d4-4378-b37e-2274168dc29b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:32.328356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d316cb-98d4-4378-b37e-2274168dc29b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:32.328884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d316cb-98d4-4378-b37e-2274168dc29b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:32.498294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a8d316cb-98d4-4378-b37e-2274168dc29b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:32.508116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8d316cb-98d4-4378-b37e-2274168dc29b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.194140 May 23 13:38:32.512519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 344/695] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:32 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:33.105490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ea36714d-7869-4556-9bd4-cac63aa0ed66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:33.107460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ea36714d-7869-4556-9bd4-cac63aa0ed66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:33.114793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea36714d-7869-4556-9bd4-cac63aa0ed66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:33.115574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea36714d-7869-4556-9bd4-cac63aa0ed66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:33.116498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea36714d-7869-4556-9bd4-cac63aa0ed66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:33.117080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea36714d-7869-4556-9bd4-cac63aa0ed66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:33.280153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ea36714d-7869-4556-9bd4-cac63aa0ed66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:33.288940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ea36714d-7869-4556-9bd4-cac63aa0ed66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.187470 May 23 13:38:33.289547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 352/696] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:33.527764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5cf7b376-0488-42a3-a5e1-ed18c6ad1797 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:33.530110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5cf7b376-0488-42a3-a5e1-ed18c6ad1797 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:33.541251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cf7b376-0488-42a3-a5e1-ed18c6ad1797 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:33.542438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cf7b376-0488-42a3-a5e1-ed18c6ad1797 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:33.544897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cf7b376-0488-42a3-a5e1-ed18c6ad1797 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:33.545981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cf7b376-0488-42a3-a5e1-ed18c6ad1797 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:33.842006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5cf7b376-0488-42a3-a5e1-ed18c6ad1797 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:33.850896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5cf7b376-0488-42a3-a5e1-ed18c6ad1797 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.327845 May 23 13:38:33.851486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 345/697] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:33 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:34.308603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aa503e89-dcac-443b-9bfd-e144d1152f57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:34.309926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aa503e89-dcac-443b-9bfd-e144d1152f57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:34.320420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa503e89-dcac-443b-9bfd-e144d1152f57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:34.320919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa503e89-dcac-443b-9bfd-e144d1152f57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:34.321742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa503e89-dcac-443b-9bfd-e144d1152f57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:34.322188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa503e89-dcac-443b-9bfd-e144d1152f57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:34.536448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa503e89-dcac-443b-9bfd-e144d1152f57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:34.546437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aa503e89-dcac-443b-9bfd-e144d1152f57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.242568 May 23 13:38:34.547100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 353/698] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:34.871185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94cd5235-77f9-4b21-8076-c04cd4ef204a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:34.872006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94cd5235-77f9-4b21-8076-c04cd4ef204a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:34.888100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94cd5235-77f9-4b21-8076-c04cd4ef204a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:34.890476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94cd5235-77f9-4b21-8076-c04cd4ef204a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:34.892146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94cd5235-77f9-4b21-8076-c04cd4ef204a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:34.893508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94cd5235-77f9-4b21-8076-c04cd4ef204a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:35.116475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94cd5235-77f9-4b21-8076-c04cd4ef204a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:35.142475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:35.142475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94cd5235-77f9-4b21-8076-c04cd4ef204a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.259324 May 23 13:38:35.142475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 346/699] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:34 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:35.568426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d57c548-dc57-4455-8adf-742c60f31945 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:35.569331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6d57c548-dc57-4455-8adf-742c60f31945 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:35.577376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d57c548-dc57-4455-8adf-742c60f31945 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:35.577950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d57c548-dc57-4455-8adf-742c60f31945 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:35.578892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d57c548-dc57-4455-8adf-742c60f31945 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:35.579401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d57c548-dc57-4455-8adf-742c60f31945 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:35.751443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d57c548-dc57-4455-8adf-742c60f31945 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:35.760024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6d57c548-dc57-4455-8adf-742c60f31945 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.195708 May 23 13:38:35.760677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 354/700] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:36.145736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a90a2ad8-7aae-4bb1-acbe-46ea6c59af7c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:36.146424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a90a2ad8-7aae-4bb1-acbe-46ea6c59af7c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:36.154660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a90a2ad8-7aae-4bb1-acbe-46ea6c59af7c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:36.155113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a90a2ad8-7aae-4bb1-acbe-46ea6c59af7c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:36.155932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a90a2ad8-7aae-4bb1-acbe-46ea6c59af7c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:36.156379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a90a2ad8-7aae-4bb1-acbe-46ea6c59af7c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:36.326638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a90a2ad8-7aae-4bb1-acbe-46ea6c59af7c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:36.335655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a90a2ad8-7aae-4bb1-acbe-46ea6c59af7c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.194824 May 23 13:38:36.336395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 347/701] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:36 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:36.786176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02472ba7-d417-4259-8f02-f8fd197dc793 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:36.786810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02472ba7-d417-4259-8f02-f8fd197dc793 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:36.794349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02472ba7-d417-4259-8f02-f8fd197dc793 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:36.794806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02472ba7-d417-4259-8f02-f8fd197dc793 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:36.795609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02472ba7-d417-4259-8f02-f8fd197dc793 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:36.796052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02472ba7-d417-4259-8f02-f8fd197dc793 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:36.957283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02472ba7-d417-4259-8f02-f8fd197dc793 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:36.970614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02472ba7-d417-4259-8f02-f8fd197dc793 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.188462 May 23 13:38:36.971450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 355/702] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:37.354432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90cc9057-6fc4-4f27-9ac0-cf6c6232ea2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:37.355156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90cc9057-6fc4-4f27-9ac0-cf6c6232ea2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:37.362556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90cc9057-6fc4-4f27-9ac0-cf6c6232ea2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:37.363013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90cc9057-6fc4-4f27-9ac0-cf6c6232ea2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:37.363820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90cc9057-6fc4-4f27-9ac0-cf6c6232ea2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:37.364266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90cc9057-6fc4-4f27-9ac0-cf6c6232ea2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:37.537038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90cc9057-6fc4-4f27-9ac0-cf6c6232ea2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:37.546822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90cc9057-6fc4-4f27-9ac0-cf6c6232ea2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.196421 May 23 13:38:37.547423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 348/703] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:37 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:37.990587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0eeb18a9-6ee4-473a-9cff-c21bd7ba2ca8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:37.991251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0eeb18a9-6ee4-473a-9cff-c21bd7ba2ca8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:38.001771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0eeb18a9-6ee4-473a-9cff-c21bd7ba2ca8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:38.002592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0eeb18a9-6ee4-473a-9cff-c21bd7ba2ca8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:38.004072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0eeb18a9-6ee4-473a-9cff-c21bd7ba2ca8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:38.004893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0eeb18a9-6ee4-473a-9cff-c21bd7ba2ca8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:38.041394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:38.208815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0eeb18a9-6ee4-473a-9cff-c21bd7ba2ca8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:38.220880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0eeb18a9-6ee4-473a-9cff-c21bd7ba2ca8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.234409 May 23 13:38:38.221638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 356/704] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:38.571635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3aea5b0-dc16-48d1-8278-31698a6dc371 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:38.572260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3aea5b0-dc16-48d1-8278-31698a6dc371 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:38.579821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3aea5b0-dc16-48d1-8278-31698a6dc371 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:38.580276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3aea5b0-dc16-48d1-8278-31698a6dc371 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:38.581115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3aea5b0-dc16-48d1-8278-31698a6dc371 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:38.581556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3aea5b0-dc16-48d1-8278-31698a6dc371 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:38.785491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3aea5b0-dc16-48d1-8278-31698a6dc371 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:38.795533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3aea5b0-dc16-48d1-8278-31698a6dc371 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.227772 May 23 13:38:38.796131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 349/705] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:38 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:39.241092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-59281f37-c568-42c1-9042-d2803bcb317b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:39.241825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-59281f37-c568-42c1-9042-d2803bcb317b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:39.250025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59281f37-c568-42c1-9042-d2803bcb317b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:39.250491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59281f37-c568-42c1-9042-d2803bcb317b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:39.251317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59281f37-c568-42c1-9042-d2803bcb317b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:39.251768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59281f37-c568-42c1-9042-d2803bcb317b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:39.416872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-59281f37-c568-42c1-9042-d2803bcb317b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:39.427151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-59281f37-c568-42c1-9042-d2803bcb317b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.190237 May 23 13:38:39.427759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 357/706] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:39.815430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3f67f688-4bc4-4f6a-b3f1-ca2a7194c50f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:39.816247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3f67f688-4bc4-4f6a-b3f1-ca2a7194c50f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:39.823980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f67f688-4bc4-4f6a-b3f1-ca2a7194c50f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:39.824521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f67f688-4bc4-4f6a-b3f1-ca2a7194c50f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:39.825855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f67f688-4bc4-4f6a-b3f1-ca2a7194c50f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:39.826426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f67f688-4bc4-4f6a-b3f1-ca2a7194c50f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:40.047565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f67f688-4bc4-4f6a-b3f1-ca2a7194c50f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:40.056151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3f67f688-4bc4-4f6a-b3f1-ca2a7194c50f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.244774 May 23 13:38:40.056795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 350/707] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:39 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:40.446187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5608089e-9147-44ff-a17a-d21d71d81aa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:40.447010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5608089e-9147-44ff-a17a-d21d71d81aa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:40.455154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5608089e-9147-44ff-a17a-d21d71d81aa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:40.455617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5608089e-9147-44ff-a17a-d21d71d81aa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:40.456437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5608089e-9147-44ff-a17a-d21d71d81aa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:40.456951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5608089e-9147-44ff-a17a-d21d71d81aa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:40.630824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5608089e-9147-44ff-a17a-d21d71d81aa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:40.642186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5608089e-9147-44ff-a17a-d21d71d81aa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.199897 May 23 13:38:40.643214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 358/708] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:41.076209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-14c3d82d-c740-477f-a088-9f8fb6948a31 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:41.076874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-14c3d82d-c740-477f-a088-9f8fb6948a31 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:41.079357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=37 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:41.084597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14c3d82d-c740-477f-a088-9f8fb6948a31 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:41.085072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14c3d82d-c740-477f-a088-9f8fb6948a31 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:41.085865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14c3d82d-c740-477f-a088-9f8fb6948a31 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:41.086364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14c3d82d-c740-477f-a088-9f8fb6948a31 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:41.256131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-14c3d82d-c740-477f-a088-9f8fb6948a31 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:41.265013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-14c3d82d-c740-477f-a088-9f8fb6948a31 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.194101 May 23 13:38:41.265614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 351/709] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:41 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:41.661547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-90149199-14d0-462f-ba6f-a24511e4537b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:41.662093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-90149199-14d0-462f-ba6f-a24511e4537b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:41.669288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90149199-14d0-462f-ba6f-a24511e4537b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:41.669745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90149199-14d0-462f-ba6f-a24511e4537b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:41.671005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90149199-14d0-462f-ba6f-a24511e4537b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:41.671579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90149199-14d0-462f-ba6f-a24511e4537b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:41.821922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-90149199-14d0-462f-ba6f-a24511e4537b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:41.830938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-90149199-14d0-462f-ba6f-a24511e4537b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.173395 May 23 13:38:41.831520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 359/710] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:42.285300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8b562ad1-5cb2-4dd7-8185-d6660ce1b7e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:42.286311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8b562ad1-5cb2-4dd7-8185-d6660ce1b7e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:42.297555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b562ad1-5cb2-4dd7-8185-d6660ce1b7e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:42.298190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b562ad1-5cb2-4dd7-8185-d6660ce1b7e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:42.299296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b562ad1-5cb2-4dd7-8185-d6660ce1b7e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:42.299897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b562ad1-5cb2-4dd7-8185-d6660ce1b7e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:42.476489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8b562ad1-5cb2-4dd7-8185-d6660ce1b7e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:42.485622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8b562ad1-5cb2-4dd7-8185-d6660ce1b7e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.205775 May 23 13:38:42.486320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 352/711] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:42 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:42.849270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9081cd33-31e7-4afa-bd0f-935c18840eeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:42.849879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9081cd33-31e7-4afa-bd0f-935c18840eeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:42.852353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=39 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:42.858954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9081cd33-31e7-4afa-bd0f-935c18840eeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:42.859402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9081cd33-31e7-4afa-bd0f-935c18840eeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:42.860196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9081cd33-31e7-4afa-bd0f-935c18840eeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:42.860684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9081cd33-31e7-4afa-bd0f-935c18840eeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:43.066893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9081cd33-31e7-4afa-bd0f-935c18840eeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:43.076347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9081cd33-31e7-4afa-bd0f-935c18840eeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.231041 May 23 13:38:43.077155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 360/712] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:43.510509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-abd42a0e-e46d-4cd4-87dc-26806f66542f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:43.511302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-abd42a0e-e46d-4cd4-87dc-26806f66542f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:43.518853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abd42a0e-e46d-4cd4-87dc-26806f66542f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:43.519316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abd42a0e-e46d-4cd4-87dc-26806f66542f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:43.520110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abd42a0e-e46d-4cd4-87dc-26806f66542f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:43.520550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abd42a0e-e46d-4cd4-87dc-26806f66542f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:43.692211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-abd42a0e-e46d-4cd4-87dc-26806f66542f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:43.702312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-abd42a0e-e46d-4cd4-87dc-26806f66542f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.195730 May 23 13:38:43.702915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 353/713] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:43 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:44.094413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c5ad0d48-11e2-415d-99e3-f057de4ea104 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:44.095100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c5ad0d48-11e2-415d-99e3-f057de4ea104 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:44.102515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5ad0d48-11e2-415d-99e3-f057de4ea104 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:44.103164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5ad0d48-11e2-415d-99e3-f057de4ea104 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:44.104039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5ad0d48-11e2-415d-99e3-f057de4ea104 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:44.104539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5ad0d48-11e2-415d-99e3-f057de4ea104 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:44.267131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c5ad0d48-11e2-415d-99e3-f057de4ea104 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:44.281378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c5ad0d48-11e2-415d-99e3-f057de4ea104 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.191253 May 23 13:38:44.282327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 361/714] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:44.719900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7b284675-49ef-4ec7-9b40-2e4198ad3000 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:44.720454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7b284675-49ef-4ec7-9b40-2e4198ad3000 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:44.727454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b284675-49ef-4ec7-9b40-2e4198ad3000 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:44.727908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b284675-49ef-4ec7-9b40-2e4198ad3000 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:44.728739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b284675-49ef-4ec7-9b40-2e4198ad3000 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:44.729189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b284675-49ef-4ec7-9b40-2e4198ad3000 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:44.899295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7b284675-49ef-4ec7-9b40-2e4198ad3000 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:44.914570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7b284675-49ef-4ec7-9b40-2e4198ad3000 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.198498 May 23 13:38:44.915633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 354/715] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:44 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:45.305924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e625f7de-3eda-4908-b87c-4e4e569af5f1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:45.306545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e625f7de-3eda-4908-b87c-4e4e569af5f1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:45.314107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e625f7de-3eda-4908-b87c-4e4e569af5f1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:45.314564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e625f7de-3eda-4908-b87c-4e4e569af5f1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:45.315360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e625f7de-3eda-4908-b87c-4e4e569af5f1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:45.315805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e625f7de-3eda-4908-b87c-4e4e569af5f1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:45.484292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e625f7de-3eda-4908-b87c-4e4e569af5f1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:45.494249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e625f7de-3eda-4908-b87c-4e4e569af5f1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.192404 May 23 13:38:45.494846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 362/716] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:45.941204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0987570c-50f1-4bc4-b017-d7a39318b321 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:45.941821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0987570c-50f1-4bc4-b017-d7a39318b321 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:45.949643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0987570c-50f1-4bc4-b017-d7a39318b321 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:45.950381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0987570c-50f1-4bc4-b017-d7a39318b321 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:45.951361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0987570c-50f1-4bc4-b017-d7a39318b321 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:45.951809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0987570c-50f1-4bc4-b017-d7a39318b321 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:46.171668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0987570c-50f1-4bc4-b017-d7a39318b321 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:46.185315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0987570c-50f1-4bc4-b017-d7a39318b321 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1756 microversion: 2.1 time: 0.246516 May 23 13:38:46.186642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 355/717] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:45 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1756 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:46.512260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5231a23f-2343-4796-83d0-bd8ae90cfde2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:46.513124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5231a23f-2343-4796-83d0-bd8ae90cfde2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:46.523855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5231a23f-2343-4796-83d0-bd8ae90cfde2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:46.524355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5231a23f-2343-4796-83d0-bd8ae90cfde2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:46.525239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5231a23f-2343-4796-83d0-bd8ae90cfde2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:46.525694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5231a23f-2343-4796-83d0-bd8ae90cfde2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:46.714801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5231a23f-2343-4796-83d0-bd8ae90cfde2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:46.727905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5231a23f-2343-4796-83d0-bd8ae90cfde2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.219315 May 23 13:38:46.731448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 363/718] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:47.207028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-47a7af51-8db4-4dc5-bcad-8b929b28a8a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:47.207724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-47a7af51-8db4-4dc5-bcad-8b929b28a8a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:47.215530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47a7af51-8db4-4dc5-bcad-8b929b28a8a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:47.216090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47a7af51-8db4-4dc5-bcad-8b929b28a8a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:47.217000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47a7af51-8db4-4dc5-bcad-8b929b28a8a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:47.217618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47a7af51-8db4-4dc5-bcad-8b929b28a8a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:47.413104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-47a7af51-8db4-4dc5-bcad-8b929b28a8a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:47.423064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-47a7af51-8db4-4dc5-bcad-8b929b28a8a1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1759 microversion: 2.1 time: 0.220034 May 23 13:38:47.423807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 356/719] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:47 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1759 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:47.755966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-38023156-ca8c-40ca-a846-1995c8b9f34f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:47.756613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-38023156-ca8c-40ca-a846-1995c8b9f34f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:47.765158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38023156-ca8c-40ca-a846-1995c8b9f34f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:47.765629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38023156-ca8c-40ca-a846-1995c8b9f34f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:47.766447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38023156-ca8c-40ca-a846-1995c8b9f34f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:47.766884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38023156-ca8c-40ca-a846-1995c8b9f34f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:47.919936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38023156-ca8c-40ca-a846-1995c8b9f34f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:47.929267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-38023156-ca8c-40ca-a846-1995c8b9f34f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.177217 May 23 13:38:47.929876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 364/720] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:48.224793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-32787bcf-46b5-4762-89b0-055a488306d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:48.225416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-32787bcf-46b5-4762-89b0-055a488306d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:48.232895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32787bcf-46b5-4762-89b0-055a488306d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:48.233348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32787bcf-46b5-4762-89b0-055a488306d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:48.234137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32787bcf-46b5-4762-89b0-055a488306d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:48.234583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32787bcf-46b5-4762-89b0-055a488306d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:48.268583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-32787bcf-46b5-4762-89b0-055a488306d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments/583986c3-e30b-4c13-8331-a2f233c845c6" status: 200 len: 194 microversion: 2.20 time: 0.047827 May 23 13:38:48.269222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 357/721] 10.222.0.70 () {60 vars in 1453 bytes} [Mon May 23 13:38:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments/583986c3-e30b-4c13-8331-a2f233c845c6 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:38:48.360374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d463d7bf-1167-492b-aa99-7212fedfed6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:48.360928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d463d7bf-1167-492b-aa99-7212fedfed6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:48.367468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d463d7bf-1167-492b-aa99-7212fedfed6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:48.367923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d463d7bf-1167-492b-aa99-7212fedfed6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:48.368754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d463d7bf-1167-492b-aa99-7212fedfed6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:48.369195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d463d7bf-1167-492b-aa99-7212fedfed6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:48.458015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-d463d7bf-1167-492b-aa99-7212fedfed6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lazy-loading 'services' on Instance uuid 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:38:48.817086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d463d7bf-1167-492b-aa99-7212fedfed6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments/583986c3-e30b-4c13-8331-a2f233c845c6" status: 202 len: 0 microversion: 2.20 time: 0.461168 May 23 13:38:48.818138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 365/722] 10.222.0.70 () {60 vars in 1456 bytes} [Mon May 23 13:38:48 2022] DELETE /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments/583986c3-e30b-4c13-8331-a2f233c845c6 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 13:38:48.828996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b12a36f6-8dee-4cc7-a39a-26f8e49d0cf0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:48.830109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b12a36f6-8dee-4cc7-a39a-26f8e49d0cf0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:48.836465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b12a36f6-8dee-4cc7-a39a-26f8e49d0cf0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:48.837020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b12a36f6-8dee-4cc7-a39a-26f8e49d0cf0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:48.837812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b12a36f6-8dee-4cc7-a39a-26f8e49d0cf0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:48.838254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b12a36f6-8dee-4cc7-a39a-26f8e49d0cf0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:48.877301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b12a36f6-8dee-4cc7-a39a-26f8e49d0cf0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053938 May 23 13:38:48.877886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 358/723] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:38:48.947748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2aa12070-1530-4415-aeea-75da4f3a6cac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:48.948605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2aa12070-1530-4415-aeea-75da4f3a6cac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:48.958688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2aa12070-1530-4415-aeea-75da4f3a6cac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:48.959190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2aa12070-1530-4415-aeea-75da4f3a6cac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:48.960514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2aa12070-1530-4415-aeea-75da4f3a6cac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:48.960994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2aa12070-1530-4415-aeea-75da4f3a6cac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:49.142528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2aa12070-1530-4415-aeea-75da4f3a6cac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:49.151124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2aa12070-1530-4415-aeea-75da4f3a6cac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.207678 May 23 13:38:49.151722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 366/724] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:49.723470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:38:49.723836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:38:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:38:49.893625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fc1d140c-638e-4d57-808a-a00ec7b9a5ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:49.895153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fc1d140c-638e-4d57-808a-a00ec7b9a5ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:49.907799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc1d140c-638e-4d57-808a-a00ec7b9a5ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:49.908611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc1d140c-638e-4d57-808a-a00ec7b9a5ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:49.909968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc1d140c-638e-4d57-808a-a00ec7b9a5ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:49.910686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc1d140c-638e-4d57-808a-a00ec7b9a5ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:49.963844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fc1d140c-638e-4d57-808a-a00ec7b9a5ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077242 May 23 13:38:49.965073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 359/725] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:49 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:38:50.171493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d7417b77-5f79-45f6-9ad0-ced604792639 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:50.172277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d7417b77-5f79-45f6-9ad0-ced604792639 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:50.179095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7417b77-5f79-45f6-9ad0-ced604792639 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:50.179548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7417b77-5f79-45f6-9ad0-ced604792639 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:50.180342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7417b77-5f79-45f6-9ad0-ced604792639 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:50.180897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7417b77-5f79-45f6-9ad0-ced604792639 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:50.360175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7417b77-5f79-45f6-9ad0-ced604792639 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:50.375719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d7417b77-5f79-45f6-9ad0-ced604792639 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.210409 May 23 13:38:50.377385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 367/726] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:50.978258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d94ff0a-aa5b-452e-be24-31d4edc8b64e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:50.979429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d94ff0a-aa5b-452e-be24-31d4edc8b64e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:50.993737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d94ff0a-aa5b-452e-be24-31d4edc8b64e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:50.994557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d94ff0a-aa5b-452e-be24-31d4edc8b64e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:50.996181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d94ff0a-aa5b-452e-be24-31d4edc8b64e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:50.997042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d94ff0a-aa5b-452e-be24-31d4edc8b64e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:51.045376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d94ff0a-aa5b-452e-be24-31d4edc8b64e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071823 May 23 13:38:51.046063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 360/727] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:50 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:38:51.394122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9464115d-8dd2-404c-bce6-25c1e95716ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:51.394795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9464115d-8dd2-404c-bce6-25c1e95716ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:51.403484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9464115d-8dd2-404c-bce6-25c1e95716ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:51.404011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9464115d-8dd2-404c-bce6-25c1e95716ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:51.404873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9464115d-8dd2-404c-bce6-25c1e95716ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:51.405324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9464115d-8dd2-404c-bce6-25c1e95716ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:51.564034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9464115d-8dd2-404c-bce6-25c1e95716ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:51.572762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9464115d-8dd2-404c-bce6-25c1e95716ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.182483 May 23 13:38:51.573531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 368/728] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:52.059517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-724fef1f-43e1-4840-8b2e-f42136a2ccf7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:52.060682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-724fef1f-43e1-4840-8b2e-f42136a2ccf7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:52.067571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-724fef1f-43e1-4840-8b2e-f42136a2ccf7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:52.068016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-724fef1f-43e1-4840-8b2e-f42136a2ccf7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:52.068837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-724fef1f-43e1-4840-8b2e-f42136a2ccf7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:52.069270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-724fef1f-43e1-4840-8b2e-f42136a2ccf7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:52.103851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-724fef1f-43e1-4840-8b2e-f42136a2ccf7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049034 May 23 13:38:52.104440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 361/729] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:52 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:38:52.592780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50bbb062-46ec-4b7b-9a5f-58627f4fa046 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:52.593430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50bbb062-46ec-4b7b-9a5f-58627f4fa046 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:52.600730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50bbb062-46ec-4b7b-9a5f-58627f4fa046 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:52.601309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50bbb062-46ec-4b7b-9a5f-58627f4fa046 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:52.602225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50bbb062-46ec-4b7b-9a5f-58627f4fa046 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:52.602758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50bbb062-46ec-4b7b-9a5f-58627f4fa046 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:52.800185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-50bbb062-46ec-4b7b-9a5f-58627f4fa046 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:52.814631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50bbb062-46ec-4b7b-9a5f-58627f4fa046 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.226698 May 23 13:38:52.815695 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 369/730] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:53.116308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c79b8552-5594-4849-ba5c-1386f62a392f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:53.117292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c79b8552-5594-4849-ba5c-1386f62a392f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:53.126706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c79b8552-5594-4849-ba5c-1386f62a392f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.127201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c79b8552-5594-4849-ba5c-1386f62a392f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:53.128057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c79b8552-5594-4849-ba5c-1386f62a392f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.128507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c79b8552-5594-4849-ba5c-1386f62a392f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:53.163329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c79b8552-5594-4849-ba5c-1386f62a392f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051406 May 23 13:38:53.163929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 362/731] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:53 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:38:53.761596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d91b3d32-6bfc-432c-8f5e-2745672770b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:53.762539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d91b3d32-6bfc-432c-8f5e-2745672770b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:53.769975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d91b3d32-6bfc-432c-8f5e-2745672770b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.770580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d91b3d32-6bfc-432c-8f5e-2745672770b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:53.771490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d91b3d32-6bfc-432c-8f5e-2745672770b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.772054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d91b3d32-6bfc-432c-8f5e-2745672770b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:53.800633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d91b3d32-6bfc-432c-8f5e-2745672770b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6/ips" status: 200 len: 149 microversion: 2.1 time: 0.165334 May 23 13:38:53.801232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 370/732] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 13:38:53 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6/ips => generated 149 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:38:53.816714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf81cf5e-ffe3-45f5-b600-511e8e1948b8"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:38:53.818668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:53.829849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.830676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:53.832118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.832927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:53.841832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3baaa207-0f3d-42ad-b43e-3a46b6e53fad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:53.842471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3baaa207-0f3d-42ad-b43e-3a46b6e53fad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:53.849328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3baaa207-0f3d-42ad-b43e-3a46b6e53fad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.849856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3baaa207-0f3d-42ad-b43e-3a46b6e53fad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:53.850673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3baaa207-0f3d-42ad-b43e-3a46b6e53fad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.851119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3baaa207-0f3d-42ad-b43e-3a46b6e53fad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:53.872071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:53.962576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Invalid volume: volume cf81cf5e-ffe3-45f5-b600-511e8e1948b8 is already attached to instances: 81f051b3-679a-43af-909b-a4edda1984fa May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6/os-volume_attachments HTTP/1.1 May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 74 May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:38:53.964405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {"volumeAttachment": {"volumeId": "cf81cf5e-ffe3-45f5-b600-511e8e1948b8"}} May 23 13:38:53.967291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: volume cf81cf5e-ffe3-45f5-b600-511e8e1948b8 is already attached to instances: 81f051b3-679a-43af-909b-a4edda1984fa May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': 'fb5275ae-cf1f-40bb-8971-dc5c99868bc6', 'body': {'volumeAttachment': {'volumeId': 'cf81cf5e-ffe3-45f5-b600-511e8e1948b8'}}} May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cf81cf5e-ffe3-45f5-b600-511e8e1948b8 is already attached to instances: 81f051b3-679a-43af-909b-a4edda1984fa May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:38:53.976904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cf81cf5e-ffe3-45f5-b600-511e8e1948b8 is already attached to instances: 81f051b3-679a-43af-909b-a4edda1984fa May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:38:53.979570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:38:53.983444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:38:53.983444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:38:53.983444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:38:53.983444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cf81cf5e-ffe3-45f5-b600-511e8e1948b8 is already attached to instances: 81f051b3-679a-43af-909b-a4edda1984fa May 23 13:38:53.983444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:38:53.983444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 400 to user: Invalid volume: volume cf81cf5e-ffe3-45f5-b600-511e8e1948b8 is already attached to instances: 81f051b3-679a-43af-909b-a4edda1984fa {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:38:53.983444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-74564a7e-4ce1-445b-b0c8-409b92348eb3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.158562 May 23 13:38:53.983444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 363/733] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 13:38:53 2022] POST /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6/os-volume_attachments => generated 174 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:38:53.984509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-baf258b2-d855-416b-9e75-6a4a5f83063c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:53.984509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-baf258b2-d855-416b-9e75-6a4a5f83063c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:53.986726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baf258b2-d855-416b-9e75-6a4a5f83063c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.987255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baf258b2-d855-416b-9e75-6a4a5f83063c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:53.988056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baf258b2-d855-416b-9e75-6a4a5f83063c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:53.988497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baf258b2-d855-416b-9e75-6a4a5f83063c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:54.026527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-baf258b2-d855-416b-9e75-6a4a5f83063c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:38:54.054763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3baaa207-0f3d-42ad-b43e-3a46b6e53fad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:54.071114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3baaa207-0f3d-42ad-b43e-3a46b6e53fad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.233692 May 23 13:38:54.072102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 371/734] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:54.180329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e77dea6a-45d1-4d01-ad74-4e85d3ac1da9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:54.188207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e77dea6a-45d1-4d01-ad74-4e85d3ac1da9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:54.192769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e77dea6a-45d1-4d01-ad74-4e85d3ac1da9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:54.193551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e77dea6a-45d1-4d01-ad74-4e85d3ac1da9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:54.195091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e77dea6a-45d1-4d01-ad74-4e85d3ac1da9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:54.195588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e77dea6a-45d1-4d01-ad74-4e85d3ac1da9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:54.252852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:38:54.262973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e77dea6a-45d1-4d01-ad74-4e85d3ac1da9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090553 May 23 13:38:54.264030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 372/735] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:54 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:38:54.423850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-baf258b2-d855-416b-9e75-6a4a5f83063c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 204 len: 0 microversion: 2.1 time: 0.449734 May 23 13:38:54.424854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 364/736] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:38:53 2022] DELETE /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 13:38:54.435172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a044b93-1a68-4f5b-8150-69f021e1d6f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:54.435803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a044b93-1a68-4f5b-8150-69f021e1d6f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:54.443650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a044b93-1a68-4f5b-8150-69f021e1d6f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:54.444109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a044b93-1a68-4f5b-8150-69f021e1d6f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:54.450743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a044b93-1a68-4f5b-8150-69f021e1d6f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:54.450743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a044b93-1a68-4f5b-8150-69f021e1d6f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:54.605202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a044b93-1a68-4f5b-8150-69f021e1d6f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:54.618953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a044b93-1a68-4f5b-8150-69f021e1d6f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1680 microversion: 2.1 time: 0.189048 May 23 13:38:54.619987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 373/737] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:54 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:55.102191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-96c00d64-bd6f-4719-b27b-8fc3a9ffd2b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:55.103437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-96c00d64-bd6f-4719-b27b-8fc3a9ffd2b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:55.115296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96c00d64-bd6f-4719-b27b-8fc3a9ffd2b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:55.116086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96c00d64-bd6f-4719-b27b-8fc3a9ffd2b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:55.117516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96c00d64-bd6f-4719-b27b-8fc3a9ffd2b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:55.118347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96c00d64-bd6f-4719-b27b-8fc3a9ffd2b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:55.277890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf80d57c-f63f-4d5e-8b72-9b8444da9ea2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:55.279165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf80d57c-f63f-4d5e-8b72-9b8444da9ea2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:55.286537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf80d57c-f63f-4d5e-8b72-9b8444da9ea2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:55.287022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf80d57c-f63f-4d5e-8b72-9b8444da9ea2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:55.287813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf80d57c-f63f-4d5e-8b72-9b8444da9ea2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:55.288303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf80d57c-f63f-4d5e-8b72-9b8444da9ea2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:55.324347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf80d57c-f63f-4d5e-8b72-9b8444da9ea2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051048 May 23 13:38:55.324347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 374/738] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:55 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:38:55.335413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-96c00d64-bd6f-4719-b27b-8fc3a9ffd2b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:55.344178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-96c00d64-bd6f-4719-b27b-8fc3a9ffd2b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.249540 May 23 13:38:55.345190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 365/739] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:55.645642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d3442bbf-eb53-42b0-b30d-f356396e0c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:55.646446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d3442bbf-eb53-42b0-b30d-f356396e0c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:55.654064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3442bbf-eb53-42b0-b30d-f356396e0c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:55.654529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3442bbf-eb53-42b0-b30d-f356396e0c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:55.655334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3442bbf-eb53-42b0-b30d-f356396e0c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:55.655780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3442bbf-eb53-42b0-b30d-f356396e0c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:55.805967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d3442bbf-eb53-42b0-b30d-f356396e0c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:55.814877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d3442bbf-eb53-42b0-b30d-f356396e0c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1680 microversion: 2.1 time: 0.173095 May 23 13:38:55.815471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 375/740] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:55 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:56.335668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b1dbb44-a235-452e-b276-48618ae1102d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:56.336719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b1dbb44-a235-452e-b276-48618ae1102d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:56.344701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b1dbb44-a235-452e-b276-48618ae1102d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:56.345159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b1dbb44-a235-452e-b276-48618ae1102d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:56.345944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b1dbb44-a235-452e-b276-48618ae1102d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:56.346380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b1dbb44-a235-452e-b276-48618ae1102d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:56.366026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d60eefa7-e59c-4200-84f9-d29e353a69b3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:56.368052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d60eefa7-e59c-4200-84f9-d29e353a69b3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:56.378971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d60eefa7-e59c-4200-84f9-d29e353a69b3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:56.380036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d60eefa7-e59c-4200-84f9-d29e353a69b3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:56.381380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d60eefa7-e59c-4200-84f9-d29e353a69b3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:56.381966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d60eefa7-e59c-4200-84f9-d29e353a69b3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:56.383369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b1dbb44-a235-452e-b276-48618ae1102d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051979 May 23 13:38:56.384277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 366/741] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:56 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:38:56.566057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d60eefa7-e59c-4200-84f9-d29e353a69b3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:56.575418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d60eefa7-e59c-4200-84f9-d29e353a69b3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.215392 May 23 13:38:56.582435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 376/742] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:56.840168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6bc8e1b-8d08-4a35-a862-f20cf9a6e272 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:56.840492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6bc8e1b-8d08-4a35-a862-f20cf9a6e272 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:56.851599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6bc8e1b-8d08-4a35-a862-f20cf9a6e272 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:56.852294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6bc8e1b-8d08-4a35-a862-f20cf9a6e272 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:56.853740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6bc8e1b-8d08-4a35-a862-f20cf9a6e272 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:56.854532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6bc8e1b-8d08-4a35-a862-f20cf9a6e272 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:57.161548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6bc8e1b-8d08-4a35-a862-f20cf9a6e272 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:57.170428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6bc8e1b-8d08-4a35-a862-f20cf9a6e272 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1680 microversion: 2.1 time: 0.338831 May 23 13:38:57.171028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 367/743] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:56 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1680 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:57.400168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0d0d3af0-1bca-45c5-a075-984f9ef647cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:57.401896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0d0d3af0-1bca-45c5-a075-984f9ef647cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:57.413004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d0d3af0-1bca-45c5-a075-984f9ef647cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:57.413660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d0d3af0-1bca-45c5-a075-984f9ef647cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:57.415039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d0d3af0-1bca-45c5-a075-984f9ef647cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:57.415823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d0d3af0-1bca-45c5-a075-984f9ef647cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:57.478738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0d0d3af0-1bca-45c5-a075-984f9ef647cd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086099 May 23 13:38:57.479793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 377/744] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:57 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:38:57.594670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fc27f829-4c9f-47fb-907c-5d91f806602b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:57.595394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fc27f829-4c9f-47fb-907c-5d91f806602b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:57.602621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc27f829-4c9f-47fb-907c-5d91f806602b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:57.603080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc27f829-4c9f-47fb-907c-5d91f806602b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:57.604847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc27f829-4c9f-47fb-907c-5d91f806602b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:57.604847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc27f829-4c9f-47fb-907c-5d91f806602b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:58.117705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc27f829-4c9f-47fb-907c-5d91f806602b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:58.127174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fc27f829-4c9f-47fb-907c-5d91f806602b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.536770 May 23 13:38:58.128062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 368/745] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:58.193277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d617dd2b-afd3-48c4-a83b-58f515ec3ef5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:58.193609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d617dd2b-afd3-48c4-a83b-58f515ec3ef5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:58.205461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d617dd2b-afd3-48c4-a83b-58f515ec3ef5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:58.206284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d617dd2b-afd3-48c4-a83b-58f515ec3ef5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:58.207959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d617dd2b-afd3-48c4-a83b-58f515ec3ef5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:58.208781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d617dd2b-afd3-48c4-a83b-58f515ec3ef5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:58.333703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d617dd2b-afd3-48c4-a83b-58f515ec3ef5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:58.346344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d617dd2b-afd3-48c4-a83b-58f515ec3ef5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1612 microversion: 2.1 time: 0.161044 May 23 13:38:58.346964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 378/746] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:58 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1612 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:58.491678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-4a388192-2301-4109-8232-1e37936cc1a3 req-569ba67c-fd37-4749-904b-96e3efca9057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5275ae-cf1f-40bb-8971-dc5c99868bc6", "name": "network-vif-deleted", "tag": "863a3713-4b07-46b6-b471-63faa10fd123"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:38:58.500050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e21e088-38c0-465f-9942-309eba96033f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:58.501970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e21e088-38c0-465f-9942-309eba96033f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:58.502838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4a388192-2301-4109-8232-1e37936cc1a3 req-569ba67c-fd37-4749-904b-96e3efca9057 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:58.503477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4a388192-2301-4109-8232-1e37936cc1a3 req-569ba67c-fd37-4749-904b-96e3efca9057 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:58.515749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e21e088-38c0-465f-9942-309eba96033f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:58.516736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e21e088-38c0-465f-9942-309eba96033f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:58.518608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e21e088-38c0-465f-9942-309eba96033f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:58.519753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e21e088-38c0-465f-9942-309eba96033f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:58.519934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-4a388192-2301-4109-8232-1e37936cc1a3 req-569ba67c-fd37-4749-904b-96e3efca9057 service nova] Creating event network-vif-deleted:863a3713-4b07-46b6-b471-63faa10fd123 for instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 on hv-cinder-82549 May 23 13:38:58.527444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-4a388192-2301-4109-8232-1e37936cc1a3 req-569ba67c-fd37-4749-904b-96e3efca9057 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135553 May 23 13:38:58.529086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 369/747] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:38:58.579664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e21e088-38c0-465f-9942-309eba96033f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088825 May 23 13:38:58.580301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 379/748] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:38:59.151402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3217356e-cd88-4694-9723-7488cd6f1aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:59.154641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3217356e-cd88-4694-9723-7488cd6f1aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:59.166833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3217356e-cd88-4694-9723-7488cd6f1aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:59.168037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3217356e-cd88-4694-9723-7488cd6f1aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:59.169521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3217356e-cd88-4694-9723-7488cd6f1aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:59.170318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3217356e-cd88-4694-9723-7488cd6f1aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:59.365939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:59.366887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:59.375276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:59.376932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:59.380533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:59.381593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:59.438447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3217356e-cd88-4694-9723-7488cd6f1aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:59.447502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:59.451113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:59.453746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lazy-loading 'fault' on Instance uuid fb5275ae-cf1f-40bb-8971-dc5c99868bc6 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:38:59.460126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3217356e-cd88-4694-9723-7488cd6f1aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.317461 May 23 13:38:59.464847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 370/749] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:38:59.537874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:38:59.561106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc75a43f-00e1-41b9-a061-4a82524817e0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 200 len: 1330 microversion: 2.1 time: 0.188898 May 23 13:38:59.561106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 380/750] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:38:59 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 1330 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:38:59.595084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f4160535-9545-4b28-b839-2b3456da1def tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:38:59.596395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f4160535-9545-4b28-b839-2b3456da1def tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:38:59.614814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4160535-9545-4b28-b839-2b3456da1def tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:59.614814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4160535-9545-4b28-b839-2b3456da1def tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:59.614814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4160535-9545-4b28-b839-2b3456da1def tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:38:59.614814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4160535-9545-4b28-b839-2b3456da1def tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:38:59.651101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f4160535-9545-4b28-b839-2b3456da1def tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059404 May 23 13:38:59.660753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 371/751] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:38:59 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:00.492740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b091112b-f140-4f70-bdad-492dea7308fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:00.493817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b091112b-f140-4f70-bdad-492dea7308fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:00.507816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b091112b-f140-4f70-bdad-492dea7308fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:00.512481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b091112b-f140-4f70-bdad-492dea7308fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:00.512481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b091112b-f140-4f70-bdad-492dea7308fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:00.512481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b091112b-f140-4f70-bdad-492dea7308fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:00.571395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:00.590275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:00.602478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:00.603601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:00.605446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:00.606357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:00.628621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 HTTP/1.1 May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:39:00.631051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 13:39:00.633235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'fb5275ae-cf1f-40bb-8971-dc5c99868bc6'} May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:39:00.635079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 13:39:00.637635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:00.646884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:39:00.646884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a22d1fb4-1e54-41d2-b870-d2323e6d2eee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 404 len: 111 microversion: 2.1 time: 0.075161 May 23 13:39:00.646884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 372/752] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:00 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 13:39:00.653865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c914e94d-adf2-43f1-a436-642ad2ed81e3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '.version_select at 0x7effb25968b0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:00.701147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b091112b-f140-4f70-bdad-492dea7308fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:00.711496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b091112b-f140-4f70-bdad-492dea7308fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.225610 May 23 13:39:00.712207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 381/753] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:00.717421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb0bc0e0-49e0-49db-9624-c843893f0e01 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:00.718376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb0bc0e0-49e0-49db-9624-c843893f0e01 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:00.725590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb0bc0e0-49e0-49db-9624-c843893f0e01 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:00.726042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb0bc0e0-49e0-49db-9624-c843893f0e01 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:00.726859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb0bc0e0-49e0-49db-9624-c843893f0e01 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:00.727303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb0bc0e0-49e0-49db-9624-c843893f0e01 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:00.765387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb0bc0e0-49e0-49db-9624-c843893f0e01 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051984 May 23 13:39:00.766132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 382/754] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:00.801442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c914e94d-adf2-43f1-a436-642ad2ed81e3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835842796" status: 202 len: 0 microversion: 2.1 time: 0.155612 May 23 13:39:00.802296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 373/755] 10.222.0.70 () {58 vars in 1217 bytes} [Mon May 23 13:39:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835842796 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:39:01.733763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ac6d0a8-c733-44de-98e5-e8cff8386b66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:01.734481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3ac6d0a8-c733-44de-98e5-e8cff8386b66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:01.747267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ac6d0a8-c733-44de-98e5-e8cff8386b66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:01.747751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ac6d0a8-c733-44de-98e5-e8cff8386b66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:01.748612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ac6d0a8-c733-44de-98e5-e8cff8386b66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:01.749075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ac6d0a8-c733-44de-98e5-e8cff8386b66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:01.783310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ffd40230-e0da-4243-b485-53159c059210 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:01.786715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ffd40230-e0da-4243-b485-53159c059210 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:01.803397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffd40230-e0da-4243-b485-53159c059210 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:01.809074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffd40230-e0da-4243-b485-53159c059210 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:01.809074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffd40230-e0da-4243-b485-53159c059210 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:01.809074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffd40230-e0da-4243-b485-53159c059210 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:01.878138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ffd40230-e0da-4243-b485-53159c059210 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102923 May 23 13:39:01.878837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 374/756] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:01 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:01.961669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bada6c0c-ed77-43e2-9418-e410be92e512 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:01.962619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bada6c0c-ed77-43e2-9418-e410be92e512 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:01.971286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bada6c0c-ed77-43e2-9418-e410be92e512 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:01.971569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ac6d0a8-c733-44de-98e5-e8cff8386b66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:01.971806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bada6c0c-ed77-43e2-9418-e410be92e512 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:01.973067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bada6c0c-ed77-43e2-9418-e410be92e512 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:01.973520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bada6c0c-ed77-43e2-9418-e410be92e512 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:01.987818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ac6d0a8-c733-44de-98e5-e8cff8386b66 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.258842 May 23 13:39:01.997824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 383/757] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:02.087561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-bada6c0c-ed77-43e2-9418-e410be92e512 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lazy-loading 'services' on Instance uuid 81f051b3-679a-43af-909b-a4edda1984fa {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:39:02.423725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bada6c0c-ed77-43e2-9418-e410be92e512 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments/cf81cf5e-ffe3-45f5-b600-511e8e1948b8" status: 202 len: 0 microversion: 2.1 time: 0.467454 May 23 13:39:02.424256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 375/758] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:39:01 2022] DELETE /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments/cf81cf5e-ffe3-45f5-b600-511e8e1948b8 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 13:39:02.437492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f9f8e6c-cfdb-48a4-ad13-d441addd9a31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:02.439178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f9f8e6c-cfdb-48a4-ad13-d441addd9a31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:02.451248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f9f8e6c-cfdb-48a4-ad13-d441addd9a31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:02.452125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f9f8e6c-cfdb-48a4-ad13-d441addd9a31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:02.453585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f9f8e6c-cfdb-48a4-ad13-d441addd9a31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:02.454634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f9f8e6c-cfdb-48a4-ad13-d441addd9a31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:02.509410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f9f8e6c-cfdb-48a4-ad13-d441addd9a31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079278 May 23 13:39:02.510432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 384/759] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:02 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:02.894993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bdbddeaf-39db-4ae9-ab96-ed6e3a7d4d8e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:02.896082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bdbddeaf-39db-4ae9-ab96-ed6e3a7d4d8e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:02.902884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bdbddeaf-39db-4ae9-ab96-ed6e3a7d4d8e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:02.903327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bdbddeaf-39db-4ae9-ab96-ed6e3a7d4d8e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:02.904102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bdbddeaf-39db-4ae9-ab96-ed6e3a7d4d8e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:02.904531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bdbddeaf-39db-4ae9-ab96-ed6e3a7d4d8e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:02.939712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bdbddeaf-39db-4ae9-ab96-ed6e3a7d4d8e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050299 May 23 13:39:02.940355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 376/760] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:02 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:03.015391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-550b0b14-2081-400e-bb19-3538f8454315 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:03.015977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-550b0b14-2081-400e-bb19-3538f8454315 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:03.023387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-550b0b14-2081-400e-bb19-3538f8454315 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:03.023899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-550b0b14-2081-400e-bb19-3538f8454315 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:03.024797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-550b0b14-2081-400e-bb19-3538f8454315 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:03.025274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-550b0b14-2081-400e-bb19-3538f8454315 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:03.291861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-550b0b14-2081-400e-bb19-3538f8454315 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:03.304271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-550b0b14-2081-400e-bb19-3538f8454315 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.293305 May 23 13:39:03.305152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 385/761] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:03.524344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b6e3864-401c-4ed0-a971-2250a7760eea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:03.525263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b6e3864-401c-4ed0-a971-2250a7760eea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:03.532161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b6e3864-401c-4ed0-a971-2250a7760eea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:03.532643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b6e3864-401c-4ed0-a971-2250a7760eea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:03.533452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b6e3864-401c-4ed0-a971-2250a7760eea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:03.533894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b6e3864-401c-4ed0-a971-2250a7760eea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:03.579352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b6e3864-401c-4ed0-a971-2250a7760eea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059279 May 23 13:39:03.579951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 377/762] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:03 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:03.954292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02fde03e-f976-4e0d-8ac0-ed5469a0941e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:03.955655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02fde03e-f976-4e0d-8ac0-ed5469a0941e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:03.963205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fde03e-f976-4e0d-8ac0-ed5469a0941e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:03.963670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fde03e-f976-4e0d-8ac0-ed5469a0941e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:03.965277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fde03e-f976-4e0d-8ac0-ed5469a0941e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:03.965738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fde03e-f976-4e0d-8ac0-ed5469a0941e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:04.002950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02fde03e-f976-4e0d-8ac0-ed5469a0941e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053822 May 23 13:39:04.003550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 386/763] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:03 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:04.329036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-057c5716-18b2-4fd1-82db-991af39253c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:04.330201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-057c5716-18b2-4fd1-82db-991af39253c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:04.341870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-057c5716-18b2-4fd1-82db-991af39253c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:04.343017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-057c5716-18b2-4fd1-82db-991af39253c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:04.344062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-057c5716-18b2-4fd1-82db-991af39253c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:04.344781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-057c5716-18b2-4fd1-82db-991af39253c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:04.525057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-057c5716-18b2-4fd1-82db-991af39253c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:04.534833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-057c5716-18b2-4fd1-82db-991af39253c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.213516 May 23 13:39:04.535552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 378/764] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:04.594669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-82aca375-b728-4955-99ec-363040b9bb6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:04.595649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-82aca375-b728-4955-99ec-363040b9bb6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:04.602737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82aca375-b728-4955-99ec-363040b9bb6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:04.603199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82aca375-b728-4955-99ec-363040b9bb6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:04.603996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82aca375-b728-4955-99ec-363040b9bb6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:04.604455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82aca375-b728-4955-99ec-363040b9bb6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:04.641148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-82aca375-b728-4955-99ec-363040b9bb6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050662 May 23 13:39:04.641752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 387/765] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:04 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:05.017360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-853ebd1b-2a12-4c33-a0c8-6da764158f00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:05.018302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-853ebd1b-2a12-4c33-a0c8-6da764158f00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:05.025078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-853ebd1b-2a12-4c33-a0c8-6da764158f00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:05.025527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-853ebd1b-2a12-4c33-a0c8-6da764158f00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:05.026303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-853ebd1b-2a12-4c33-a0c8-6da764158f00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:05.027301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-853ebd1b-2a12-4c33-a0c8-6da764158f00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:05.092920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-853ebd1b-2a12-4c33-a0c8-6da764158f00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073448 May 23 13:39:05.092920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 379/766] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:05 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:05.553106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b959b23b-d9e0-4912-bd49-9f9b4dd2ed95 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:05.553814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b959b23b-d9e0-4912-bd49-9f9b4dd2ed95 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:05.563645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b959b23b-d9e0-4912-bd49-9f9b4dd2ed95 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:05.564483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b959b23b-d9e0-4912-bd49-9f9b4dd2ed95 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:05.565968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b959b23b-d9e0-4912-bd49-9f9b4dd2ed95 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:05.566814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b959b23b-d9e0-4912-bd49-9f9b4dd2ed95 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:05.657274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-478704cc-4145-465c-8662-e2752ad63f8a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:05.659335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-478704cc-4145-465c-8662-e2752ad63f8a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:05.671149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-478704cc-4145-465c-8662-e2752ad63f8a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:05.672089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-478704cc-4145-465c-8662-e2752ad63f8a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:05.673750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-478704cc-4145-465c-8662-e2752ad63f8a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:05.674682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-478704cc-4145-465c-8662-e2752ad63f8a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:05.682603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:05.732922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-478704cc-4145-465c-8662-e2752ad63f8a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083186 May 23 13:39:05.733715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 380/767] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:05 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:05.774335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b959b23b-d9e0-4912-bd49-9f9b4dd2ed95 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:05.785135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b959b23b-d9e0-4912-bd49-9f9b4dd2ed95 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1717 microversion: 2.1 time: 0.236003 May 23 13:39:05.785788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 388/768] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1717 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:05.862238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:05.862772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:05.870717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:05.871258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:05.872078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:05.872551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:06.027330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Cannot 'detach_volume' instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 while it is in vm_state rescued May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:39:06.037841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:39:06.039547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Cannot 'detach_volume' instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 while it is in vm_state rescued May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:39:06.040325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 while it is in vm_state rescued May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 while it is in vm_state rescued May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:39:06.041727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 409 to user: Cannot 'detach_volume' instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 while it is in vm_state rescued {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:39:06.043339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-10ab2938-b13b-4b69-8cf0-b55e8d2e0eed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 409 len: 152 microversion: 2.1 time: 0.173731 May 23 13:39:06.043339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 381/769] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:39:05 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 152 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 13:39:06.049881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a1641d1-19a1-4503-8dad-737c692ea8c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:39:06.050429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a1641d1-19a1-4503-8dad-737c692ea8c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:06.058690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a1641d1-19a1-4503-8dad-737c692ea8c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:06.059159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a1641d1-19a1-4503-8dad-737c692ea8c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:06.059989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a1641d1-19a1-4503-8dad-737c692ea8c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:06.060435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a1641d1-19a1-4503-8dad-737c692ea8c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:06.065259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:06.112055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e73545df-092e-4a38-ae1c-63ebb6e6388f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:06.113192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e73545df-092e-4a38-ae1c-63ebb6e6388f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:06.122169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e73545df-092e-4a38-ae1c-63ebb6e6388f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:06.122762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e73545df-092e-4a38-ae1c-63ebb6e6388f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:06.123589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e73545df-092e-4a38-ae1c-63ebb6e6388f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:06.124037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e73545df-092e-4a38-ae1c-63ebb6e6388f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:06.159401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e73545df-092e-4a38-ae1c-63ebb6e6388f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051288 May 23 13:39:06.159984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 382/770] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:06 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:06.317840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a1641d1-19a1-4503-8dad-737c692ea8c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/action" status: 202 len: 0 microversion: 2.1 time: 0.273344 May 23 13:39:06.318519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 389/771] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:39:06 2022] POST /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:39:06.331523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e16a8a0-8da7-449f-8fdb-bffc2d857abd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:06.332258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e16a8a0-8da7-449f-8fdb-bffc2d857abd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:06.340258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e16a8a0-8da7-449f-8fdb-bffc2d857abd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:06.340883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e16a8a0-8da7-449f-8fdb-bffc2d857abd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:06.341795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e16a8a0-8da7-449f-8fdb-bffc2d857abd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:06.342367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e16a8a0-8da7-449f-8fdb-bffc2d857abd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:06.550205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0e16a8a0-8da7-449f-8fdb-bffc2d857abd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:06.567201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e16a8a0-8da7-449f-8fdb-bffc2d857abd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1725 microversion: 2.1 time: 0.240567 May 23 13:39:06.575331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 383/772] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:06.748864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1130de54-4d89-4dea-bb7d-5acdee9d518c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:06.749908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1130de54-4d89-4dea-bb7d-5acdee9d518c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:06.757126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1130de54-4d89-4dea-bb7d-5acdee9d518c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:06.757595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1130de54-4d89-4dea-bb7d-5acdee9d518c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:06.758408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1130de54-4d89-4dea-bb7d-5acdee9d518c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:06.769033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1130de54-4d89-4dea-bb7d-5acdee9d518c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:06.796103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1130de54-4d89-4dea-bb7d-5acdee9d518c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053234 May 23 13:39:06.797188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 390/773] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:06 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:07.180501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-187113e4-a6a8-4374-8f78-b80abab144d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:07.181542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-187113e4-a6a8-4374-8f78-b80abab144d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:07.193541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-187113e4-a6a8-4374-8f78-b80abab144d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:07.197145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-187113e4-a6a8-4374-8f78-b80abab144d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:07.203676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-187113e4-a6a8-4374-8f78-b80abab144d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:07.204460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-187113e4-a6a8-4374-8f78-b80abab144d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:07.247910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-187113e4-a6a8-4374-8f78-b80abab144d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074878 May 23 13:39:07.248813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 384/774] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:07 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:07.590161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-334033a2-9f42-47aa-96c5-fa14050d74ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:07.590799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-334033a2-9f42-47aa-96c5-fa14050d74ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:07.597988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-334033a2-9f42-47aa-96c5-fa14050d74ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:07.598496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-334033a2-9f42-47aa-96c5-fa14050d74ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:07.599341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-334033a2-9f42-47aa-96c5-fa14050d74ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:07.599825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-334033a2-9f42-47aa-96c5-fa14050d74ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:07.755332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-334033a2-9f42-47aa-96c5-fa14050d74ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:07.765409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-334033a2-9f42-47aa-96c5-fa14050d74ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1725 microversion: 2.1 time: 0.179672 May 23 13:39:07.766033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 391/775] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:07.808560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-675f2b15-3839-4c3c-b3e6-73e9abc6a789 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:07.809800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-675f2b15-3839-4c3c-b3e6-73e9abc6a789 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:07.816763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-675f2b15-3839-4c3c-b3e6-73e9abc6a789 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:07.826908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-675f2b15-3839-4c3c-b3e6-73e9abc6a789 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:07.826908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-675f2b15-3839-4c3c-b3e6-73e9abc6a789 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:07.826908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-675f2b15-3839-4c3c-b3e6-73e9abc6a789 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:07.853782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-675f2b15-3839-4c3c-b3e6-73e9abc6a789 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049853 May 23 13:39:07.854627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 385/776] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:07 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:08.263406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d5a61d33-bd97-4fb2-94f5-6080a4748e08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:08.264367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d5a61d33-bd97-4fb2-94f5-6080a4748e08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:08.271196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5a61d33-bd97-4fb2-94f5-6080a4748e08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:08.271651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5a61d33-bd97-4fb2-94f5-6080a4748e08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:08.272477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5a61d33-bd97-4fb2-94f5-6080a4748e08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:08.272950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5a61d33-bd97-4fb2-94f5-6080a4748e08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:08.309211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d5a61d33-bd97-4fb2-94f5-6080a4748e08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050845 May 23 13:39:08.309824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 392/777] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:08 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:08.784500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cbe04a69-5ff8-4378-b3ca-f8bbec16304a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:08.785418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cbe04a69-5ff8-4378-b3ca-f8bbec16304a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:08.792824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cbe04a69-5ff8-4378-b3ca-f8bbec16304a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:08.793355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cbe04a69-5ff8-4378-b3ca-f8bbec16304a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:08.794210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cbe04a69-5ff8-4378-b3ca-f8bbec16304a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:08.794685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cbe04a69-5ff8-4378-b3ca-f8bbec16304a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:08.866845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f674d6e3-c3ce-4a5b-a998-5598bf0cb22e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:08.867803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f674d6e3-c3ce-4a5b-a998-5598bf0cb22e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:08.875714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f674d6e3-c3ce-4a5b-a998-5598bf0cb22e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:08.876181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f674d6e3-c3ce-4a5b-a998-5598bf0cb22e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:08.877034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f674d6e3-c3ce-4a5b-a998-5598bf0cb22e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:08.877477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f674d6e3-c3ce-4a5b-a998-5598bf0cb22e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:08.914549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f674d6e3-c3ce-4a5b-a998-5598bf0cb22e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052236 May 23 13:39:08.915157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 393/778] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:08 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:08.959726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cbe04a69-5ff8-4378-b3ca-f8bbec16304a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:08.969185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cbe04a69-5ff8-4378-b3ca-f8bbec16304a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1725 microversion: 2.1 time: 0.189301 May 23 13:39:08.969779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 386/779] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:09.326071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bdf91eea-dbf1-42fa-b5a8-e87538ac50a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:09.327797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bdf91eea-dbf1-42fa-b5a8-e87538ac50a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:09.339353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdf91eea-dbf1-42fa-b5a8-e87538ac50a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:09.340359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdf91eea-dbf1-42fa-b5a8-e87538ac50a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:09.341622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdf91eea-dbf1-42fa-b5a8-e87538ac50a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:09.342383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdf91eea-dbf1-42fa-b5a8-e87538ac50a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:09.399246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bdf91eea-dbf1-42fa-b5a8-e87538ac50a5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080560 May 23 13:39:09.400301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 394/780] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:09 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:09.927160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b9dc2e7c-9b42-4c65-b48a-8fb910e43cdc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:09.928135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b9dc2e7c-9b42-4c65-b48a-8fb910e43cdc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:09.935882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9dc2e7c-9b42-4c65-b48a-8fb910e43cdc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:09.936342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9dc2e7c-9b42-4c65-b48a-8fb910e43cdc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:09.937189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9dc2e7c-9b42-4c65-b48a-8fb910e43cdc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:09.937631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9dc2e7c-9b42-4c65-b48a-8fb910e43cdc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:09.973138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b9dc2e7c-9b42-4c65-b48a-8fb910e43cdc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049914 May 23 13:39:09.973740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 387/781] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:09 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:09.995841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-793f5bf0-4e0f-4bf0-b36c-dd1089570cee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:09.996472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-793f5bf0-4e0f-4bf0-b36c-dd1089570cee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:10.004451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-793f5bf0-4e0f-4bf0-b36c-dd1089570cee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:10.004953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-793f5bf0-4e0f-4bf0-b36c-dd1089570cee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:10.005761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-793f5bf0-4e0f-4bf0-b36c-dd1089570cee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:10.006208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-793f5bf0-4e0f-4bf0-b36c-dd1089570cee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:10.227090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-793f5bf0-4e0f-4bf0-b36c-dd1089570cee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:10.240745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-793f5bf0-4e0f-4bf0-b36c-dd1089570cee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1725 microversion: 2.1 time: 0.248752 May 23 13:39:10.241372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 395/782] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:10.414829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce1f3b15-9a55-4ac3-ae3f-b6be4322d8dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:10.415819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce1f3b15-9a55-4ac3-ae3f-b6be4322d8dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:10.422899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce1f3b15-9a55-4ac3-ae3f-b6be4322d8dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:10.423351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce1f3b15-9a55-4ac3-ae3f-b6be4322d8dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:10.424150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce1f3b15-9a55-4ac3-ae3f-b6be4322d8dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:10.424626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce1f3b15-9a55-4ac3-ae3f-b6be4322d8dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:10.459900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce1f3b15-9a55-4ac3-ae3f-b6be4322d8dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049104 May 23 13:39:10.460413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 388/783] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:10 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:10.988842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9591a1c-681d-4399-8c02-a3b357af54a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:10.990226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9591a1c-681d-4399-8c02-a3b357af54a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:10.998401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9591a1c-681d-4399-8c02-a3b357af54a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:10.998866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9591a1c-681d-4399-8c02-a3b357af54a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:11.002187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9591a1c-681d-4399-8c02-a3b357af54a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:11.002187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9591a1c-681d-4399-8c02-a3b357af54a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:11.036431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9591a1c-681d-4399-8c02-a3b357af54a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051920 May 23 13:39:11.037155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 396/784] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:10 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:11.262354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99a2e60c-cc0e-4743-a307-7fe05a3ae620 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:11.263128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99a2e60c-cc0e-4743-a307-7fe05a3ae620 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:11.265700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:11.272055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99a2e60c-cc0e-4743-a307-7fe05a3ae620 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:11.272711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99a2e60c-cc0e-4743-a307-7fe05a3ae620 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:11.273675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99a2e60c-cc0e-4743-a307-7fe05a3ae620 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:11.274293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99a2e60c-cc0e-4743-a307-7fe05a3ae620 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:11.477181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e634f29-3b8e-4698-839a-e90b6d0376f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:11.478364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e634f29-3b8e-4698-839a-e90b6d0376f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:11.479155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99a2e60c-cc0e-4743-a307-7fe05a3ae620 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:11.486670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e634f29-3b8e-4698-839a-e90b6d0376f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:11.487193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e634f29-3b8e-4698-839a-e90b6d0376f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:11.488073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e634f29-3b8e-4698-839a-e90b6d0376f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:11.488526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e634f29-3b8e-4698-839a-e90b6d0376f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:11.498236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99a2e60c-cc0e-4743-a307-7fe05a3ae620 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1731 microversion: 2.1 time: 0.238509 May 23 13:39:11.499522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 389/785] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:11.525999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e634f29-3b8e-4698-839a-e90b6d0376f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057004 May 23 13:39:11.527619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 397/786] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:11.534441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2cb6b6aa-76fb-46e8-acdc-48c6b2fcb4fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:11.535293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2cb6b6aa-76fb-46e8-acdc-48c6b2fcb4fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:11.550992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cb6b6aa-76fb-46e8-acdc-48c6b2fcb4fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:11.551761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cb6b6aa-76fb-46e8-acdc-48c6b2fcb4fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:11.553174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cb6b6aa-76fb-46e8-acdc-48c6b2fcb4fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:11.553968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cb6b6aa-76fb-46e8-acdc-48c6b2fcb4fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:11.668652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2cb6b6aa-76fb-46e8-acdc-48c6b2fcb4fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145995 May 23 13:39:11.669276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 390/787] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 23 13:39:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:12.051186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf227710-3c5f-401f-b12b-54fc272ed654 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:12.052599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf227710-3c5f-401f-b12b-54fc272ed654 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:12.061743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf227710-3c5f-401f-b12b-54fc272ed654 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:12.062394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf227710-3c5f-401f-b12b-54fc272ed654 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:12.063393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf227710-3c5f-401f-b12b-54fc272ed654 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:12.063956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf227710-3c5f-401f-b12b-54fc272ed654 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:12.103178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf227710-3c5f-401f-b12b-54fc272ed654 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057110 May 23 13:39:12.104007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 398/788] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:12 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:12.545144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92261f83-2b21-43e8-8f9d-0b5a73cc46e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:12.548646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-92261f83-2b21-43e8-8f9d-0b5a73cc46e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:12.559887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92261f83-2b21-43e8-8f9d-0b5a73cc46e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:12.560709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92261f83-2b21-43e8-8f9d-0b5a73cc46e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:12.562143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92261f83-2b21-43e8-8f9d-0b5a73cc46e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:12.562962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92261f83-2b21-43e8-8f9d-0b5a73cc46e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:12.618667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-92261f83-2b21-43e8-8f9d-0b5a73cc46e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082310 May 23 13:39:12.619247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 391/789] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:12.945543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-f7f8db8f-22cd-46bd-833b-0104c59a1b68 req-4b186fca-ece5-4f5a-b6c0-f970cb6a1366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea1331e-b180-41c8-910a-04b7cff4a9f7", "tag": "b04be98e-e124-43f9-b990-a67a4ab0ea9f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:39:12.951945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=80 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:12.957390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f7f8db8f-22cd-46bd-833b-0104c59a1b68 req-4b186fca-ece5-4f5a-b6c0-f970cb6a1366 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:12.958018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-f7f8db8f-22cd-46bd-833b-0104c59a1b68 req-4b186fca-ece5-4f5a-b6c0-f970cb6a1366 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:12.970073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-f7f8db8f-22cd-46bd-833b-0104c59a1b68 req-4b186fca-ece5-4f5a-b6c0-f970cb6a1366 service nova] Creating event network-changed:b04be98e-e124-43f9-b990-a67a4ab0ea9f for instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 on hv-cinder-82549 May 23 13:39:12.977929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-f7f8db8f-22cd-46bd-833b-0104c59a1b68 req-4b186fca-ece5-4f5a-b6c0-f970cb6a1366 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036576 May 23 13:39:12.978553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 399/790] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:13.118676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f13343d3-fb62-4183-b2b8-65d114d26016 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:13.119867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f13343d3-fb62-4183-b2b8-65d114d26016 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:13.126919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f13343d3-fb62-4183-b2b8-65d114d26016 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:13.127489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f13343d3-fb62-4183-b2b8-65d114d26016 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:13.128455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f13343d3-fb62-4183-b2b8-65d114d26016 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:13.129024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f13343d3-fb62-4183-b2b8-65d114d26016 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:13.164387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f13343d3-fb62-4183-b2b8-65d114d26016 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050116 May 23 13:39:13.169102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 392/791] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:13 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:13.638075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8878efc-a87c-4475-a2e6-a60fcd96dbf4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:13.640886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8878efc-a87c-4475-a2e6-a60fcd96dbf4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:13.657732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8878efc-a87c-4475-a2e6-a60fcd96dbf4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:13.658960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8878efc-a87c-4475-a2e6-a60fcd96dbf4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:13.669912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8878efc-a87c-4475-a2e6-a60fcd96dbf4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:13.669912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8878efc-a87c-4475-a2e6-a60fcd96dbf4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:13.714755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8878efc-a87c-4475-a2e6-a60fcd96dbf4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085335 May 23 13:39:13.716793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 400/792] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:13 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:14.176697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5ee24b4-382f-407c-b421-e84ee7022e5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:14.177664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5ee24b4-382f-407c-b421-e84ee7022e5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:14.185024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5ee24b4-382f-407c-b421-e84ee7022e5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:14.185484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5ee24b4-382f-407c-b421-e84ee7022e5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:14.186274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5ee24b4-382f-407c-b421-e84ee7022e5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:14.186715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5ee24b4-382f-407c-b421-e84ee7022e5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:14.220500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5ee24b4-382f-407c-b421-e84ee7022e5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047856 May 23 13:39:14.221113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 393/793] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:14 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:14.733426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9cb63aa3-f9c9-4f96-8aa5-43e91a03ba39 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:14.733426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9cb63aa3-f9c9-4f96-8aa5-43e91a03ba39 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:14.738167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cb63aa3-f9c9-4f96-8aa5-43e91a03ba39 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:14.738611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cb63aa3-f9c9-4f96-8aa5-43e91a03ba39 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:14.739652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cb63aa3-f9c9-4f96-8aa5-43e91a03ba39 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:14.740084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cb63aa3-f9c9-4f96-8aa5-43e91a03ba39 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:14.777374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9cb63aa3-f9c9-4f96-8aa5-43e91a03ba39 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051525 May 23 13:39:14.778077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 401/794] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:14 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:14.994525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-2ac116e0-5d44-40b0-867c-bb1830bb9d73 req-62005627-44ed-40ed-a61b-0e600b2a1d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea1331e-b180-41c8-910a-04b7cff4a9f7", "tag": "b04be98e-e124-43f9-b990-a67a4ab0ea9f"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:39:15.004115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2ac116e0-5d44-40b0-867c-bb1830bb9d73 req-62005627-44ed-40ed-a61b-0e600b2a1d54 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:15.004579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2ac116e0-5d44-40b0-867c-bb1830bb9d73 req-62005627-44ed-40ed-a61b-0e600b2a1d54 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:15.017712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-2ac116e0-5d44-40b0-867c-bb1830bb9d73 req-62005627-44ed-40ed-a61b-0e600b2a1d54 service nova] Creating event network-changed:b04be98e-e124-43f9-b990-a67a4ab0ea9f for instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 on hv-cinder-82549 May 23 13:39:15.023107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-2ac116e0-5d44-40b0-867c-bb1830bb9d73 req-62005627-44ed-40ed-a61b-0e600b2a1d54 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032766 May 23 13:39:15.023739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 394/795] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:15.234034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65e91732-1137-4107-a0b8-d47454d44415 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:15.235070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-65e91732-1137-4107-a0b8-d47454d44415 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:15.242293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65e91732-1137-4107-a0b8-d47454d44415 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:15.242741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65e91732-1137-4107-a0b8-d47454d44415 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:15.243640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65e91732-1137-4107-a0b8-d47454d44415 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:15.245115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65e91732-1137-4107-a0b8-d47454d44415 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:15.287236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65e91732-1137-4107-a0b8-d47454d44415 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058238 May 23 13:39:15.288293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 402/796] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:15 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:15.790913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f25db77f-ebf8-48c5-8fe5-4badbb1b025e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:15.792209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f25db77f-ebf8-48c5-8fe5-4badbb1b025e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:15.799152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f25db77f-ebf8-48c5-8fe5-4badbb1b025e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:15.799594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f25db77f-ebf8-48c5-8fe5-4badbb1b025e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:15.800369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f25db77f-ebf8-48c5-8fe5-4badbb1b025e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:15.800849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f25db77f-ebf8-48c5-8fe5-4badbb1b025e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:15.832868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f25db77f-ebf8-48c5-8fe5-4badbb1b025e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046811 May 23 13:39:15.833466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 395/797] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:15 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:16.298765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97eddb25-8b9d-4256-a2dc-deb285f89820 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:16.299726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97eddb25-8b9d-4256-a2dc-deb285f89820 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:16.306803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97eddb25-8b9d-4256-a2dc-deb285f89820 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:16.307757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97eddb25-8b9d-4256-a2dc-deb285f89820 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:16.308552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97eddb25-8b9d-4256-a2dc-deb285f89820 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:16.309018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97eddb25-8b9d-4256-a2dc-deb285f89820 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:16.341799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97eddb25-8b9d-4256-a2dc-deb285f89820 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046990 May 23 13:39:16.342377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 403/798] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:16 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:16.845273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-88234c00-ed90-4a65-8bfa-5357c6d29394 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:16.846519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-88234c00-ed90-4a65-8bfa-5357c6d29394 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:16.853530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88234c00-ed90-4a65-8bfa-5357c6d29394 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:16.854151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88234c00-ed90-4a65-8bfa-5357c6d29394 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:16.855532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88234c00-ed90-4a65-8bfa-5357c6d29394 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:16.856052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88234c00-ed90-4a65-8bfa-5357c6d29394 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:16.893908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-88234c00-ed90-4a65-8bfa-5357c6d29394 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052810 May 23 13:39:16.894590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 396/799] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:17.352950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5890a604-0f7a-480b-81af-cc07fcc7fee4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:17.353896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5890a604-0f7a-480b-81af-cc07fcc7fee4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:17.361178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5890a604-0f7a-480b-81af-cc07fcc7fee4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:17.369774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5890a604-0f7a-480b-81af-cc07fcc7fee4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:17.369774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5890a604-0f7a-480b-81af-cc07fcc7fee4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:17.369774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5890a604-0f7a-480b-81af-cc07fcc7fee4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:17.396165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5890a604-0f7a-480b-81af-cc07fcc7fee4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047275 May 23 13:39:17.396772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 404/800] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:17 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:17.906332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-21b778c2-149e-4e15-855a-20f7911f66a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:17.907371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-21b778c2-149e-4e15-855a-20f7911f66a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:17.915123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21b778c2-149e-4e15-855a-20f7911f66a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:17.915572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21b778c2-149e-4e15-855a-20f7911f66a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:17.916364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21b778c2-149e-4e15-855a-20f7911f66a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:17.917570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21b778c2-149e-4e15-855a-20f7911f66a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:17.947495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:17.952494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-21b778c2-149e-4e15-855a-20f7911f66a6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050512 May 23 13:39:17.953166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 397/801] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:18.410222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a5e04574-5c49-42b6-a525-cef930d8213b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:18.411407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a5e04574-5c49-42b6-a525-cef930d8213b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:18.419276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5e04574-5c49-42b6-a525-cef930d8213b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:18.419728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5e04574-5c49-42b6-a525-cef930d8213b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:18.420521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5e04574-5c49-42b6-a525-cef930d8213b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:18.421015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5e04574-5c49-42b6-a525-cef930d8213b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:18.441459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:18.455907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a5e04574-5c49-42b6-a525-cef930d8213b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049653 May 23 13:39:18.456523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 405/802] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:18 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:18.967106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bdd87244-a18c-4634-803c-901a22de71ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:18.968038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bdd87244-a18c-4634-803c-901a22de71ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:18.975301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bdd87244-a18c-4634-803c-901a22de71ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:18.975748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bdd87244-a18c-4634-803c-901a22de71ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:18.976531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bdd87244-a18c-4634-803c-901a22de71ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:18.977007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bdd87244-a18c-4634-803c-901a22de71ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:19.011395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bdd87244-a18c-4634-803c-901a22de71ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049203 May 23 13:39:19.011993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 398/803] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:18 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:19.468964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ae5aca8-9f7b-4850-b6d1-a11fabb1a1dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:19.469833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ae5aca8-9f7b-4850-b6d1-a11fabb1a1dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:19.477677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ae5aca8-9f7b-4850-b6d1-a11fabb1a1dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:19.478164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ae5aca8-9f7b-4850-b6d1-a11fabb1a1dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:19.478999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ae5aca8-9f7b-4850-b6d1-a11fabb1a1dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:19.479609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ae5aca8-9f7b-4850-b6d1-a11fabb1a1dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:19.516653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ae5aca8-9f7b-4850-b6d1-a11fabb1a1dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052660 May 23 13:39:19.517668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 406/804] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:19 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:20.024058 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bd50fe83-3400-4ca9-944a-85f3660beb74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:20.025041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd50fe83-3400-4ca9-944a-85f3660beb74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:20.032993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd50fe83-3400-4ca9-944a-85f3660beb74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:20.033444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd50fe83-3400-4ca9-944a-85f3660beb74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:20.034239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd50fe83-3400-4ca9-944a-85f3660beb74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:20.034678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd50fe83-3400-4ca9-944a-85f3660beb74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:20.070166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bd50fe83-3400-4ca9-944a-85f3660beb74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049882 May 23 13:39:20.075974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 399/805] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:20.530075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6ab254a-de3d-4c39-9b1c-50e72795a732 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:20.530895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d6ab254a-de3d-4c39-9b1c-50e72795a732 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:20.538581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ab254a-de3d-4c39-9b1c-50e72795a732 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:20.539041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ab254a-de3d-4c39-9b1c-50e72795a732 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:20.539828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ab254a-de3d-4c39-9b1c-50e72795a732 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:20.540273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ab254a-de3d-4c39-9b1c-50e72795a732 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:20.575536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d6ab254a-de3d-4c39-9b1c-50e72795a732 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050124 May 23 13:39:20.576114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 407/806] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:20 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:21.084684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7795e53-fdec-4d5d-a751-ae17adadbd30 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:21.085626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7795e53-fdec-4d5d-a751-ae17adadbd30 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:21.092818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7795e53-fdec-4d5d-a751-ae17adadbd30 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:21.093264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7795e53-fdec-4d5d-a751-ae17adadbd30 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:21.094056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7795e53-fdec-4d5d-a751-ae17adadbd30 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:21.094489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7795e53-fdec-4d5d-a751-ae17adadbd30 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:21.129624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7795e53-fdec-4d5d-a751-ae17adadbd30 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049573 May 23 13:39:21.130210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 400/807] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:21 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:21.590590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ddc9301b-5c06-46a0-904b-feba6a48e8ad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:21.591429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ddc9301b-5c06-46a0-904b-feba6a48e8ad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:21.598818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddc9301b-5c06-46a0-904b-feba6a48e8ad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:21.599268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddc9301b-5c06-46a0-904b-feba6a48e8ad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:21.600052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddc9301b-5c06-46a0-904b-feba6a48e8ad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:21.600527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddc9301b-5c06-46a0-904b-feba6a48e8ad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:21.634629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ddc9301b-5c06-46a0-904b-feba6a48e8ad tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049069 May 23 13:39:21.637043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 408/808] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:21 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:22.142490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-594d4d8e-df09-4645-ab76-0c69ab19ab33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:22.143439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-594d4d8e-df09-4645-ab76-0c69ab19ab33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:22.150634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-594d4d8e-df09-4645-ab76-0c69ab19ab33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:22.151166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-594d4d8e-df09-4645-ab76-0c69ab19ab33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:22.152108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-594d4d8e-df09-4645-ab76-0c69ab19ab33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:22.152595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-594d4d8e-df09-4645-ab76-0c69ab19ab33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:22.192426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-594d4d8e-df09-4645-ab76-0c69ab19ab33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053635 May 23 13:39:22.193555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 401/809] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:22 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:22.648553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a945a5b9-29bc-44fe-87d9-ee5aac70b6cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:22.649615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a945a5b9-29bc-44fe-87d9-ee5aac70b6cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:22.657603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a945a5b9-29bc-44fe-87d9-ee5aac70b6cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:22.658052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a945a5b9-29bc-44fe-87d9-ee5aac70b6cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:22.658837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a945a5b9-29bc-44fe-87d9-ee5aac70b6cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:22.659273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a945a5b9-29bc-44fe-87d9-ee5aac70b6cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:22.694071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a945a5b9-29bc-44fe-87d9-ee5aac70b6cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050511 May 23 13:39:22.694662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 409/810] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:22 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:23.210368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1a2183b8-ec47-493b-9271-8e91e17e0a97 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:23.212010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1a2183b8-ec47-493b-9271-8e91e17e0a97 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:23.223154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a2183b8-ec47-493b-9271-8e91e17e0a97 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:23.223630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a2183b8-ec47-493b-9271-8e91e17e0a97 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:23.224445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a2183b8-ec47-493b-9271-8e91e17e0a97 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:23.225391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a2183b8-ec47-493b-9271-8e91e17e0a97 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:23.266454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1a2183b8-ec47-493b-9271-8e91e17e0a97 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063639 May 23 13:39:23.267043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 402/811] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:23.710389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b5fcf14c-22cb-4526-a25f-8065e44bdd29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:23.711671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b5fcf14c-22cb-4526-a25f-8065e44bdd29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:23.719305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5fcf14c-22cb-4526-a25f-8065e44bdd29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:23.722949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5fcf14c-22cb-4526-a25f-8065e44bdd29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:23.722949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5fcf14c-22cb-4526-a25f-8065e44bdd29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:23.722949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5fcf14c-22cb-4526-a25f-8065e44bdd29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:23.763908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b5fcf14c-22cb-4526-a25f-8065e44bdd29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058601 May 23 13:39:23.765082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 410/812] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:23 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:24.281381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0b93d8c-aaca-4a35-a94b-056cee1dfef0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:24.282349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0b93d8c-aaca-4a35-a94b-056cee1dfef0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:24.289427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0b93d8c-aaca-4a35-a94b-056cee1dfef0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:24.289881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0b93d8c-aaca-4a35-a94b-056cee1dfef0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:24.290680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0b93d8c-aaca-4a35-a94b-056cee1dfef0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:24.291121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0b93d8c-aaca-4a35-a94b-056cee1dfef0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:24.325471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0b93d8c-aaca-4a35-a94b-056cee1dfef0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050630 May 23 13:39:24.326057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 403/813] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:24 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:24.776045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1758f760-b5d7-4e73-a8f6-d576b892cde8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:24.777281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1758f760-b5d7-4e73-a8f6-d576b892cde8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:24.784529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1758f760-b5d7-4e73-a8f6-d576b892cde8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:24.785129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1758f760-b5d7-4e73-a8f6-d576b892cde8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:24.786118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1758f760-b5d7-4e73-a8f6-d576b892cde8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:24.786696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1758f760-b5d7-4e73-a8f6-d576b892cde8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:24.823070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1758f760-b5d7-4e73-a8f6-d576b892cde8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051477 May 23 13:39:24.823958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 411/814] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:24 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:25.337953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d7ed4b0b-166f-4bb0-acea-c4150f298400 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:25.339689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d7ed4b0b-166f-4bb0-acea-c4150f298400 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:25.346646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7ed4b0b-166f-4bb0-acea-c4150f298400 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:25.347115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7ed4b0b-166f-4bb0-acea-c4150f298400 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:25.347907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7ed4b0b-166f-4bb0-acea-c4150f298400 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:25.348357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7ed4b0b-166f-4bb0-acea-c4150f298400 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:25.382703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d7ed4b0b-166f-4bb0-acea-c4150f298400 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048816 May 23 13:39:25.383290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 404/815] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:25.835637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97528be5-7758-46cd-9c6e-8ee0674e1c51 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:25.836641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97528be5-7758-46cd-9c6e-8ee0674e1c51 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:25.844705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97528be5-7758-46cd-9c6e-8ee0674e1c51 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:25.845168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97528be5-7758-46cd-9c6e-8ee0674e1c51 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:25.846001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97528be5-7758-46cd-9c6e-8ee0674e1c51 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:25.846451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97528be5-7758-46cd-9c6e-8ee0674e1c51 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:25.883417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97528be5-7758-46cd-9c6e-8ee0674e1c51 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052082 May 23 13:39:25.884007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 412/816] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:25 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:26.397361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-44e3ef0f-8390-4943-adcc-b51a5bdd0165 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:26.398322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-44e3ef0f-8390-4943-adcc-b51a5bdd0165 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:26.405374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44e3ef0f-8390-4943-adcc-b51a5bdd0165 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:26.405831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44e3ef0f-8390-4943-adcc-b51a5bdd0165 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:26.406617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44e3ef0f-8390-4943-adcc-b51a5bdd0165 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:26.407062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44e3ef0f-8390-4943-adcc-b51a5bdd0165 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:26.443162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-44e3ef0f-8390-4943-adcc-b51a5bdd0165 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049870 May 23 13:39:26.443774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 405/817] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:26.897055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a2d4c89c-8214-4e48-b96d-9fc1ae2e0f96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:26.898041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a2d4c89c-8214-4e48-b96d-9fc1ae2e0f96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:26.905254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2d4c89c-8214-4e48-b96d-9fc1ae2e0f96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:26.905697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2d4c89c-8214-4e48-b96d-9fc1ae2e0f96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:26.906477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2d4c89c-8214-4e48-b96d-9fc1ae2e0f96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:26.906911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2d4c89c-8214-4e48-b96d-9fc1ae2e0f96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:26.941040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a2d4c89c-8214-4e48-b96d-9fc1ae2e0f96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047946 May 23 13:39:26.941629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 413/818] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:26 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:27.456521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db18c7db-7162-4d86-9a0f-eea8fe23e235 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:27.457614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db18c7db-7162-4d86-9a0f-eea8fe23e235 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:27.466138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db18c7db-7162-4d86-9a0f-eea8fe23e235 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:27.466584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db18c7db-7162-4d86-9a0f-eea8fe23e235 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:27.467377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db18c7db-7162-4d86-9a0f-eea8fe23e235 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:27.467810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db18c7db-7162-4d86-9a0f-eea8fe23e235 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:27.503212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db18c7db-7162-4d86-9a0f-eea8fe23e235 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051134 May 23 13:39:27.503799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 406/819] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:27.953305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ee60d1b-ce6a-4328-b0f1-ff4fd6574f49 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:27.954515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8ee60d1b-ce6a-4328-b0f1-ff4fd6574f49 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:27.962092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ee60d1b-ce6a-4328-b0f1-ff4fd6574f49 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:27.962611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ee60d1b-ce6a-4328-b0f1-ff4fd6574f49 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:27.964606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ee60d1b-ce6a-4328-b0f1-ff4fd6574f49 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:27.965214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ee60d1b-ce6a-4328-b0f1-ff4fd6574f49 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:28.001634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8ee60d1b-ce6a-4328-b0f1-ff4fd6574f49 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052418 May 23 13:39:28.002140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 414/820] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:27 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:28.518684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c19b541e-98d4-4134-b278-bec55a1a2053 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:28.519617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c19b541e-98d4-4134-b278-bec55a1a2053 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:28.526395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c19b541e-98d4-4134-b278-bec55a1a2053 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:28.526843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c19b541e-98d4-4134-b278-bec55a1a2053 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:28.527652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c19b541e-98d4-4134-b278-bec55a1a2053 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:28.528087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c19b541e-98d4-4134-b278-bec55a1a2053 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:28.561185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c19b541e-98d4-4134-b278-bec55a1a2053 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047448 May 23 13:39:28.561774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 407/821] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:28 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:29.014739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7ca9fa84-f930-457d-9227-07cf8582b1e2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:29.015698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7ca9fa84-f930-457d-9227-07cf8582b1e2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:29.022970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ca9fa84-f930-457d-9227-07cf8582b1e2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:29.023461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ca9fa84-f930-457d-9227-07cf8582b1e2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:29.024303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ca9fa84-f930-457d-9227-07cf8582b1e2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:29.024783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ca9fa84-f930-457d-9227-07cf8582b1e2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:29.060336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7ca9fa84-f930-457d-9227-07cf8582b1e2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049785 May 23 13:39:29.061032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 415/822] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:29 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:29.573827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fad2aa5a-3f4d-4963-9af7-0908d326da9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:29.575143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fad2aa5a-3f4d-4963-9af7-0908d326da9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:29.582014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fad2aa5a-3f4d-4963-9af7-0908d326da9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:29.582464 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fad2aa5a-3f4d-4963-9af7-0908d326da9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:29.583254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fad2aa5a-3f4d-4963-9af7-0908d326da9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:29.583706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fad2aa5a-3f4d-4963-9af7-0908d326da9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:29.618947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fad2aa5a-3f4d-4963-9af7-0908d326da9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049809 May 23 13:39:29.619920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 408/823] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:29 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:30.074501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-63ed1f68-a713-4dcc-93dc-378a676541b2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:30.075490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-63ed1f68-a713-4dcc-93dc-378a676541b2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:30.083233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63ed1f68-a713-4dcc-93dc-378a676541b2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:30.083710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63ed1f68-a713-4dcc-93dc-378a676541b2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:30.084528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63ed1f68-a713-4dcc-93dc-378a676541b2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:30.085011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63ed1f68-a713-4dcc-93dc-378a676541b2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:30.126619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-63ed1f68-a713-4dcc-93dc-378a676541b2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056507 May 23 13:39:30.131098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 416/824] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:30 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:30.432557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2ef5eadc-378f-4497-b824-19e4eb91e270 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:39:30.435967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2ef5eadc-378f-4497-b824-19e4eb91e270 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:30.443076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ef5eadc-378f-4497-b824-19e4eb91e270 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:30.443531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ef5eadc-378f-4497-b824-19e4eb91e270 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:30.444321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ef5eadc-378f-4497-b824-19e4eb91e270 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:30.444827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ef5eadc-378f-4497-b824-19e4eb91e270 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:30.472982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-2ef5eadc-378f-4497-b824-19e4eb91e270 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lazy-loading 'flavor' on Instance uuid f83ea9db-9db3-48c0-83a5-c423a1151195 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:39:30.631565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ffcf24f-cbec-490b-ac42-fe1bc4bfee74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:30.632529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ffcf24f-cbec-490b-ac42-fe1bc4bfee74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:30.639551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ffcf24f-cbec-490b-ac42-fe1bc4bfee74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:30.640008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ffcf24f-cbec-490b-ac42-fe1bc4bfee74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:30.640838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ffcf24f-cbec-490b-ac42-fe1bc4bfee74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:30.641276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ffcf24f-cbec-490b-ac42-fe1bc4bfee74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:30.675598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ffcf24f-cbec-490b-ac42-fe1bc4bfee74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048115 May 23 13:39:30.676301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 417/825] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:30.863866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2ef5eadc-378f-4497-b824-19e4eb91e270 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "POST /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195/action" status: 202 len: 0 microversion: 2.1 time: 0.435519 May 23 13:39:30.864992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 409/826] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:39:30 2022] POST /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:39:30.878148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2d930ae-dd64-42c6-9bd5-3865866bc9dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:30.879294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f2d930ae-dd64-42c6-9bd5-3865866bc9dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:30.888512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d930ae-dd64-42c6-9bd5-3865866bc9dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:30.889019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d930ae-dd64-42c6-9bd5-3865866bc9dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:30.889843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d930ae-dd64-42c6-9bd5-3865866bc9dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:30.890289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d930ae-dd64-42c6-9bd5-3865866bc9dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:31.063418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f2d930ae-dd64-42c6-9bd5-3865866bc9dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:31.071994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2d930ae-dd64-42c6-9bd5-3865866bc9dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.201644 May 23 13:39:31.074314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 418/827] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:30 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:31.140093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e58d8331-903f-4ec4-a848-d9475d928ee8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:31.141099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e58d8331-903f-4ec4-a848-d9475d928ee8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:31.147761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e58d8331-903f-4ec4-a848-d9475d928ee8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:31.148206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e58d8331-903f-4ec4-a848-d9475d928ee8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:31.149010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e58d8331-903f-4ec4-a848-d9475d928ee8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:31.149444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e58d8331-903f-4ec4-a848-d9475d928ee8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:31.183450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e58d8331-903f-4ec4-a848-d9475d928ee8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047764 May 23 13:39:31.184396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 410/828] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:31 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:31.688990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-96dda98f-b181-4026-98cb-36762fe7f41f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:31.690010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-96dda98f-b181-4026-98cb-36762fe7f41f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:31.696976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96dda98f-b181-4026-98cb-36762fe7f41f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:31.697462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96dda98f-b181-4026-98cb-36762fe7f41f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:31.698960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96dda98f-b181-4026-98cb-36762fe7f41f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:31.699414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96dda98f-b181-4026-98cb-36762fe7f41f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:31.752127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-96dda98f-b181-4026-98cb-36762fe7f41f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067230 May 23 13:39:31.752770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 419/829] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:31 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:32.092463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ebe69d2c-e26f-4f63-9184-6063e0fa6c90 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:32.093397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ebe69d2c-e26f-4f63-9184-6063e0fa6c90 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:32.101709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebe69d2c-e26f-4f63-9184-6063e0fa6c90 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:32.102258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebe69d2c-e26f-4f63-9184-6063e0fa6c90 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:32.103149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebe69d2c-e26f-4f63-9184-6063e0fa6c90 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:32.103916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebe69d2c-e26f-4f63-9184-6063e0fa6c90 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:32.201422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab5bf344-fac6-4620-89c0-3ab660fb929f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:32.203401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab5bf344-fac6-4620-89c0-3ab660fb929f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:32.215572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab5bf344-fac6-4620-89c0-3ab660fb929f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:32.216495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab5bf344-fac6-4620-89c0-3ab660fb929f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:32.218071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab5bf344-fac6-4620-89c0-3ab660fb929f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:32.218871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab5bf344-fac6-4620-89c0-3ab660fb929f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:32.256476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab5bf344-fac6-4620-89c0-3ab660fb929f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063531 May 23 13:39:32.257352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 420/830] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:32 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:32.409375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebe69d2c-e26f-4f63-9184-6063e0fa6c90 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:32.419217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ebe69d2c-e26f-4f63-9184-6063e0fa6c90 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.331805 May 23 13:39:32.432408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 411/831] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:32 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:32.764643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cac23685-47f2-4b78-8374-237ab7723b00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:32.765613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cac23685-47f2-4b78-8374-237ab7723b00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:32.772595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cac23685-47f2-4b78-8374-237ab7723b00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:32.773109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cac23685-47f2-4b78-8374-237ab7723b00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:32.773908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cac23685-47f2-4b78-8374-237ab7723b00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:32.774349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cac23685-47f2-4b78-8374-237ab7723b00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:32.808583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cac23685-47f2-4b78-8374-237ab7723b00 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048442 May 23 13:39:32.809513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 421/832] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:32 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:33.271789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-753834e3-aa94-42c6-a52a-f30bb6bc2a46 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:33.272828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-753834e3-aa94-42c6-a52a-f30bb6bc2a46 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:33.280440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-753834e3-aa94-42c6-a52a-f30bb6bc2a46 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:33.280927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-753834e3-aa94-42c6-a52a-f30bb6bc2a46 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:33.281754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-753834e3-aa94-42c6-a52a-f30bb6bc2a46 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:33.282195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-753834e3-aa94-42c6-a52a-f30bb6bc2a46 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:33.301153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:33.316104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-753834e3-aa94-42c6-a52a-f30bb6bc2a46 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048505 May 23 13:39:33.316762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 412/833] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:33 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:33.439679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-948a0331-ca8c-4485-b51a-23cc2157dd4b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:33.440188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-948a0331-ca8c-4485-b51a-23cc2157dd4b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:33.446816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-948a0331-ca8c-4485-b51a-23cc2157dd4b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:33.447452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-948a0331-ca8c-4485-b51a-23cc2157dd4b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:33.448708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-948a0331-ca8c-4485-b51a-23cc2157dd4b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:33.449160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-948a0331-ca8c-4485-b51a-23cc2157dd4b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:33.453916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:33.608363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-948a0331-ca8c-4485-b51a-23cc2157dd4b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:33.616716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-948a0331-ca8c-4485-b51a-23cc2157dd4b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.181104 May 23 13:39:33.617456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 422/834] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:33 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:33.820971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fbdf6be1-e918-4377-be5f-17bf6589fff2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:33.821943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fbdf6be1-e918-4377-be5f-17bf6589fff2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:33.829518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbdf6be1-e918-4377-be5f-17bf6589fff2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:33.830023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbdf6be1-e918-4377-be5f-17bf6589fff2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:33.830847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbdf6be1-e918-4377-be5f-17bf6589fff2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:33.831326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbdf6be1-e918-4377-be5f-17bf6589fff2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:33.865787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fbdf6be1-e918-4377-be5f-17bf6589fff2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048795 May 23 13:39:33.866378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 413/835] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:34.329134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-582a698a-0564-45b7-8dc3-fbdbd6a61a12 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:34.330155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-582a698a-0564-45b7-8dc3-fbdbd6a61a12 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:34.337382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582a698a-0564-45b7-8dc3-fbdbd6a61a12 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:34.337862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582a698a-0564-45b7-8dc3-fbdbd6a61a12 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:34.338713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582a698a-0564-45b7-8dc3-fbdbd6a61a12 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:34.339116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582a698a-0564-45b7-8dc3-fbdbd6a61a12 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:34.373579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-582a698a-0564-45b7-8dc3-fbdbd6a61a12 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048609 May 23 13:39:34.374170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 423/836] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:34 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:34.635568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-16899a4e-bcfa-42bc-8b44-e036b1d572e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:34.636324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-16899a4e-bcfa-42bc-8b44-e036b1d572e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:34.644249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16899a4e-bcfa-42bc-8b44-e036b1d572e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:34.644818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16899a4e-bcfa-42bc-8b44-e036b1d572e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:34.645659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16899a4e-bcfa-42bc-8b44-e036b1d572e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:34.646241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16899a4e-bcfa-42bc-8b44-e036b1d572e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:34.886830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-977a5d9b-e59e-4aaf-9abf-f440db3764b9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:34.889636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-977a5d9b-e59e-4aaf-9abf-f440db3764b9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:34.898093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-16899a4e-bcfa-42bc-8b44-e036b1d572e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:34.911249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977a5d9b-e59e-4aaf-9abf-f440db3764b9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:34.916794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977a5d9b-e59e-4aaf-9abf-f440db3764b9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:34.916794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977a5d9b-e59e-4aaf-9abf-f440db3764b9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:34.917244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-16899a4e-bcfa-42bc-8b44-e036b1d572e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.281961 May 23 13:39:34.917348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-977a5d9b-e59e-4aaf-9abf-f440db3764b9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:34.917444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 414/837] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:34 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:34.951780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-977a5d9b-e59e-4aaf-9abf-f440db3764b9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077912 May 23 13:39:34.952647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 424/838] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:34 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:35.387145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3464c5d-03af-4c35-b142-a4dc61212b97 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:35.388084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3464c5d-03af-4c35-b142-a4dc61212b97 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:35.394850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3464c5d-03af-4c35-b142-a4dc61212b97 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:35.395297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3464c5d-03af-4c35-b142-a4dc61212b97 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:35.396080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3464c5d-03af-4c35-b142-a4dc61212b97 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:35.396514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3464c5d-03af-4c35-b142-a4dc61212b97 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:35.432089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3464c5d-03af-4c35-b142-a4dc61212b97 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049368 May 23 13:39:35.433100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 415/839] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:35 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:35.942255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-abfc2a80-7991-4930-acc4-b3e214ffb0b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:35.943393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-abfc2a80-7991-4930-acc4-b3e214ffb0b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:35.957527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abfc2a80-7991-4930-acc4-b3e214ffb0b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:35.958348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abfc2a80-7991-4930-acc4-b3e214ffb0b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:35.960129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abfc2a80-7991-4930-acc4-b3e214ffb0b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:35.960947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abfc2a80-7991-4930-acc4-b3e214ffb0b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:35.967407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f68879dc-57cb-4466-b63a-9a4803829954 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:35.968553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f68879dc-57cb-4466-b63a-9a4803829954 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:35.977321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f68879dc-57cb-4466-b63a-9a4803829954 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:35.977779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f68879dc-57cb-4466-b63a-9a4803829954 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:35.979091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f68879dc-57cb-4466-b63a-9a4803829954 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:35.979886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f68879dc-57cb-4466-b63a-9a4803829954 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:36.021335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f68879dc-57cb-4466-b63a-9a4803829954 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059321 May 23 13:39:36.021927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 416/840] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:35 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:36.147412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-abfc2a80-7991-4930-acc4-b3e214ffb0b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:36.156091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-abfc2a80-7991-4930-acc4-b3e214ffb0b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.221734 May 23 13:39:36.156729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 425/841] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:35 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:36.449250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0e65858-def0-45a8-9b99-25bf1927b538 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:36.450920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0e65858-def0-45a8-9b99-25bf1927b538 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:36.461393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0e65858-def0-45a8-9b99-25bf1927b538 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:36.461971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0e65858-def0-45a8-9b99-25bf1927b538 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:36.463431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0e65858-def0-45a8-9b99-25bf1927b538 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:36.464056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0e65858-def0-45a8-9b99-25bf1927b538 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:36.498973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0e65858-def0-45a8-9b99-25bf1927b538 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057529 May 23 13:39:36.499563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 417/842] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:36 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:37.033814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7aded0ca-29c3-4893-9030-5d1461318859 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:37.035060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7aded0ca-29c3-4893-9030-5d1461318859 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:37.043549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aded0ca-29c3-4893-9030-5d1461318859 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:37.043992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aded0ca-29c3-4893-9030-5d1461318859 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:37.044824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aded0ca-29c3-4893-9030-5d1461318859 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:37.045269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aded0ca-29c3-4893-9030-5d1461318859 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:37.078785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7aded0ca-29c3-4893-9030-5d1461318859 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049217 May 23 13:39:37.079544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 426/843] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:37 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:37.183902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1723c6c1-9492-470f-8c4d-1fcbaa152272 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:37.185564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1723c6c1-9492-470f-8c4d-1fcbaa152272 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:37.195251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1723c6c1-9492-470f-8c4d-1fcbaa152272 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:37.195740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1723c6c1-9492-470f-8c4d-1fcbaa152272 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:37.196610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1723c6c1-9492-470f-8c4d-1fcbaa152272 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:37.197156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1723c6c1-9492-470f-8c4d-1fcbaa152272 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:37.364770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1723c6c1-9492-470f-8c4d-1fcbaa152272 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:37.373782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1723c6c1-9492-470f-8c4d-1fcbaa152272 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.194930 May 23 13:39:37.374575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 418/844] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:37 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:37.512468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6330f454-6e3b-4d4e-b138-9414eb4bf139 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:37.513386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6330f454-6e3b-4d4e-b138-9414eb4bf139 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:37.521459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6330f454-6e3b-4d4e-b138-9414eb4bf139 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:37.521996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6330f454-6e3b-4d4e-b138-9414eb4bf139 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:37.522795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6330f454-6e3b-4d4e-b138-9414eb4bf139 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:37.523240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6330f454-6e3b-4d4e-b138-9414eb4bf139 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:37.558557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6330f454-6e3b-4d4e-b138-9414eb4bf139 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051064 May 23 13:39:37.559161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 427/845] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:37 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:38.092949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3233dfbd-9e4c-4648-a3ca-e2d8f129fe28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:38.094054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3233dfbd-9e4c-4648-a3ca-e2d8f129fe28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:38.100986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3233dfbd-9e4c-4648-a3ca-e2d8f129fe28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:38.101441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3233dfbd-9e4c-4648-a3ca-e2d8f129fe28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:38.102244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3233dfbd-9e4c-4648-a3ca-e2d8f129fe28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:38.102687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3233dfbd-9e4c-4648-a3ca-e2d8f129fe28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:38.138066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3233dfbd-9e4c-4648-a3ca-e2d8f129fe28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050833 May 23 13:39:38.138663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 419/846] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:38 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:38.392974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b685c26a-855f-455f-a8b7-3fa79c2bc620 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:38.393708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b685c26a-855f-455f-a8b7-3fa79c2bc620 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:38.401902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b685c26a-855f-455f-a8b7-3fa79c2bc620 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:38.402435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b685c26a-855f-455f-a8b7-3fa79c2bc620 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:38.403289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b685c26a-855f-455f-a8b7-3fa79c2bc620 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:38.403867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b685c26a-855f-455f-a8b7-3fa79c2bc620 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:38.557802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b685c26a-855f-455f-a8b7-3fa79c2bc620 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:38.565697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b685c26a-855f-455f-a8b7-3fa79c2bc620 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.176673 May 23 13:39:38.566370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 428/847] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:38 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:38.575562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d864c452-2f70-43e6-9376-05bebcdc4a67 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:38.577287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d864c452-2f70-43e6-9376-05bebcdc4a67 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:38.588712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d864c452-2f70-43e6-9376-05bebcdc4a67 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:38.589878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d864c452-2f70-43e6-9376-05bebcdc4a67 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:38.591482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d864c452-2f70-43e6-9376-05bebcdc4a67 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:38.592560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d864c452-2f70-43e6-9376-05bebcdc4a67 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:38.633311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d864c452-2f70-43e6-9376-05bebcdc4a67 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066263 May 23 13:39:38.633906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 420/848] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:38 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:39.155630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9053c993-1131-42c7-867b-3566670b029d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:39.157262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9053c993-1131-42c7-867b-3566670b029d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:39.168528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9053c993-1131-42c7-867b-3566670b029d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:39.169365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9053c993-1131-42c7-867b-3566670b029d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:39.170689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9053c993-1131-42c7-867b-3566670b029d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:39.171496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9053c993-1131-42c7-867b-3566670b029d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:39.212162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9053c993-1131-42c7-867b-3566670b029d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065328 May 23 13:39:39.213475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 429/849] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:39 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:39.592852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1045fe08-9fb0-4ae6-8b11-fc52e4e2a03e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:39.593457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1045fe08-9fb0-4ae6-8b11-fc52e4e2a03e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:39.600296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1045fe08-9fb0-4ae6-8b11-fc52e4e2a03e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:39.600788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1045fe08-9fb0-4ae6-8b11-fc52e4e2a03e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:39.601573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1045fe08-9fb0-4ae6-8b11-fc52e4e2a03e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:39.602013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1045fe08-9fb0-4ae6-8b11-fc52e4e2a03e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:39.650219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f67d0992-a44e-46cd-84b5-c05208339013 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:39.651993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f67d0992-a44e-46cd-84b5-c05208339013 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:39.663969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f67d0992-a44e-46cd-84b5-c05208339013 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:39.665024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f67d0992-a44e-46cd-84b5-c05208339013 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:39.667068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f67d0992-a44e-46cd-84b5-c05208339013 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:39.667910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f67d0992-a44e-46cd-84b5-c05208339013 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:39.737839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f67d0992-a44e-46cd-84b5-c05208339013 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094993 May 23 13:39:39.739552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 430/850] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:39 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:39.777495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1045fe08-9fb0-4ae6-8b11-fc52e4e2a03e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:39.786409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1045fe08-9fb0-4ae6-8b11-fc52e4e2a03e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.198410 May 23 13:39:39.787002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 421/851] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:39 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:40.227877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-def706ef-4bd7-4a5e-b93f-9cc5923d0f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:40.229553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-def706ef-4bd7-4a5e-b93f-9cc5923d0f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:40.238602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-def706ef-4bd7-4a5e-b93f-9cc5923d0f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:40.239063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-def706ef-4bd7-4a5e-b93f-9cc5923d0f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:40.239859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-def706ef-4bd7-4a5e-b93f-9cc5923d0f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:40.240301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-def706ef-4bd7-4a5e-b93f-9cc5923d0f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:40.274502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-def706ef-4bd7-4a5e-b93f-9cc5923d0f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051422 May 23 13:39:40.275696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 431/852] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:40.753438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4f75b0de-0985-460c-ac95-8904e273bca8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:40.754377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4f75b0de-0985-460c-ac95-8904e273bca8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:40.762107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f75b0de-0985-460c-ac95-8904e273bca8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:40.762642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f75b0de-0985-460c-ac95-8904e273bca8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:40.763636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f75b0de-0985-460c-ac95-8904e273bca8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:40.764726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f75b0de-0985-460c-ac95-8904e273bca8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:40.799278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4f75b0de-0985-460c-ac95-8904e273bca8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049785 May 23 13:39:40.799739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 422/853] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:40 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:40.810242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b0e6a72-2873-435b-8ad5-c61be20237ef tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:40.811396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b0e6a72-2873-435b-8ad5-c61be20237ef tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:40.823861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0e6a72-2873-435b-8ad5-c61be20237ef tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:40.824757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0e6a72-2873-435b-8ad5-c61be20237ef tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:40.826169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0e6a72-2873-435b-8ad5-c61be20237ef tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:40.826971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0e6a72-2873-435b-8ad5-c61be20237ef tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:41.031319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b0e6a72-2873-435b-8ad5-c61be20237ef tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:41.039653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b0e6a72-2873-435b-8ad5-c61be20237ef tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.237893 May 23 13:39:41.040246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 432/854] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:40 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:41.290958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c6be32c-3d46-4333-b490-cdee10ca90d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:41.292709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c6be32c-3d46-4333-b490-cdee10ca90d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:41.302742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c6be32c-3d46-4333-b490-cdee10ca90d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:41.303473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c6be32c-3d46-4333-b490-cdee10ca90d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:41.304823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c6be32c-3d46-4333-b490-cdee10ca90d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:41.305569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c6be32c-3d46-4333-b490-cdee10ca90d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:41.349653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c6be32c-3d46-4333-b490-cdee10ca90d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065634 May 23 13:39:41.350261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 423/855] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:41 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:41.812745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-820b1a9d-e28f-4e1f-885e-631da0832e74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:41.813793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-820b1a9d-e28f-4e1f-885e-631da0832e74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:41.825384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-820b1a9d-e28f-4e1f-885e-631da0832e74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:41.826202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-820b1a9d-e28f-4e1f-885e-631da0832e74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:41.827664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-820b1a9d-e28f-4e1f-885e-631da0832e74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:41.828467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-820b1a9d-e28f-4e1f-885e-631da0832e74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:41.898916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-820b1a9d-e28f-4e1f-885e-631da0832e74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090368 May 23 13:39:41.900504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 433/856] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:41 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:42.059378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ee2223e6-c2ec-48d8-bb68-eb6fa7e9f316 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:42.060304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ee2223e6-c2ec-48d8-bb68-eb6fa7e9f316 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:42.063221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=70 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:42.068466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee2223e6-c2ec-48d8-bb68-eb6fa7e9f316 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:42.068970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee2223e6-c2ec-48d8-bb68-eb6fa7e9f316 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:42.069802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee2223e6-c2ec-48d8-bb68-eb6fa7e9f316 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:42.070484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee2223e6-c2ec-48d8-bb68-eb6fa7e9f316 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:42.254626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ee2223e6-c2ec-48d8-bb68-eb6fa7e9f316 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:42.269808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ee2223e6-c2ec-48d8-bb68-eb6fa7e9f316 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.215018 May 23 13:39:42.271009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 424/857] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:42 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:42.365205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c9892bd6-d472-41b5-ad39-eec564c47436 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:42.366610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c9892bd6-d472-41b5-ad39-eec564c47436 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:42.376926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9892bd6-d472-41b5-ad39-eec564c47436 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:42.377715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9892bd6-d472-41b5-ad39-eec564c47436 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:42.378614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9892bd6-d472-41b5-ad39-eec564c47436 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:42.379101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9892bd6-d472-41b5-ad39-eec564c47436 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:42.425666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c9892bd6-d472-41b5-ad39-eec564c47436 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067638 May 23 13:39:42.426270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 434/858] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:42 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:42.911581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-86dfc83a-09a5-4919-a882-b8357cc38039 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:42.912624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-86dfc83a-09a5-4919-a882-b8357cc38039 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:42.919466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86dfc83a-09a5-4919-a882-b8357cc38039 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:42.919918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86dfc83a-09a5-4919-a882-b8357cc38039 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:42.920856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86dfc83a-09a5-4919-a882-b8357cc38039 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:42.921312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86dfc83a-09a5-4919-a882-b8357cc38039 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:42.954768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-86dfc83a-09a5-4919-a882-b8357cc38039 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047327 May 23 13:39:42.955466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 425/859] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:42 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:43.290399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f677655-9a32-465d-8f2b-0ed8a347828f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:43.292359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f677655-9a32-465d-8f2b-0ed8a347828f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:43.299320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f677655-9a32-465d-8f2b-0ed8a347828f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:43.299766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f677655-9a32-465d-8f2b-0ed8a347828f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:43.300552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f677655-9a32-465d-8f2b-0ed8a347828f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:43.301011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f677655-9a32-465d-8f2b-0ed8a347828f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:43.440383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d26b7744-8cb9-44a1-817c-8b90bbdd12d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:43.441277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d26b7744-8cb9-44a1-817c-8b90bbdd12d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:43.449777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d26b7744-8cb9-44a1-817c-8b90bbdd12d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:43.450761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d26b7744-8cb9-44a1-817c-8b90bbdd12d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:43.451857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d26b7744-8cb9-44a1-817c-8b90bbdd12d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:43.453427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d26b7744-8cb9-44a1-817c-8b90bbdd12d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:43.480748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f677655-9a32-465d-8f2b-0ed8a347828f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:43.484813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d26b7744-8cb9-44a1-817c-8b90bbdd12d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049113 May 23 13:39:43.485945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 426/860] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:43 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:43.488975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f677655-9a32-465d-8f2b-0ed8a347828f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.202464 May 23 13:39:43.489534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 435/861] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:43 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:43.975156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b3e7e699-ec40-4aaf-879b-74ddc5351cce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:43.976101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b3e7e699-ec40-4aaf-879b-74ddc5351cce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:43.983618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3e7e699-ec40-4aaf-879b-74ddc5351cce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:43.989124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3e7e699-ec40-4aaf-879b-74ddc5351cce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:43.989124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3e7e699-ec40-4aaf-879b-74ddc5351cce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:43.989124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3e7e699-ec40-4aaf-879b-74ddc5351cce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:44.019089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b3e7e699-ec40-4aaf-879b-74ddc5351cce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047829 May 23 13:39:44.023545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 427/862] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:43 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:44.498100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-34970617-52b1-4a93-810e-2644a3ad96ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:44.498976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-34970617-52b1-4a93-810e-2644a3ad96ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:44.501469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=74 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:44.506642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34970617-52b1-4a93-810e-2644a3ad96ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:44.507100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34970617-52b1-4a93-810e-2644a3ad96ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:44.507205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e6ee6761-0b42-4592-b942-4dc586f940ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:44.507790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e6ee6761-0b42-4592-b942-4dc586f940ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:44.507901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34970617-52b1-4a93-810e-2644a3ad96ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:44.508316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34970617-52b1-4a93-810e-2644a3ad96ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:44.515402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6ee6761-0b42-4592-b942-4dc586f940ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:44.515988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6ee6761-0b42-4592-b942-4dc586f940ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:44.516933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6ee6761-0b42-4592-b942-4dc586f940ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:44.517463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6ee6761-0b42-4592-b942-4dc586f940ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:44.549754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-34970617-52b1-4a93-810e-2644a3ad96ea tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056331 May 23 13:39:44.550771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 436/863] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:44 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:44.676395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6ee6761-0b42-4592-b942-4dc586f940ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:44.685515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e6ee6761-0b42-4592-b942-4dc586f940ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.182093 May 23 13:39:44.686116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 428/864] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:44 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:45.032484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4a2260f6-59a9-4fa8-bc44-4932ce35374d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:45.033476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4a2260f6-59a9-4fa8-bc44-4932ce35374d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:45.040094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a2260f6-59a9-4fa8-bc44-4932ce35374d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:45.041073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a2260f6-59a9-4fa8-bc44-4932ce35374d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:45.041932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a2260f6-59a9-4fa8-bc44-4932ce35374d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:45.042291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a2260f6-59a9-4fa8-bc44-4932ce35374d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:45.075014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4a2260f6-59a9-4fa8-bc44-4932ce35374d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046693 May 23 13:39:45.075606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 437/865] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:45 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:45.565221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90813642-22a0-428e-8104-7417ada75901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:45.566146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90813642-22a0-428e-8104-7417ada75901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:45.573221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90813642-22a0-428e-8104-7417ada75901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:45.573686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90813642-22a0-428e-8104-7417ada75901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:45.574467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90813642-22a0-428e-8104-7417ada75901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:45.574904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90813642-22a0-428e-8104-7417ada75901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:45.585541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:45.621172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90813642-22a0-428e-8104-7417ada75901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059558 May 23 13:39:45.622241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 429/866] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:45.704250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c6341bad-6f2e-4b7e-b90b-56b0294f5e57 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:45.705071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c6341bad-6f2e-4b7e-b90b-56b0294f5e57 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:45.711681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6341bad-6f2e-4b7e-b90b-56b0294f5e57 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:45.712133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6341bad-6f2e-4b7e-b90b-56b0294f5e57 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:45.713616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6341bad-6f2e-4b7e-b90b-56b0294f5e57 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:45.713970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6341bad-6f2e-4b7e-b90b-56b0294f5e57 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:45.872649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c6341bad-6f2e-4b7e-b90b-56b0294f5e57 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:45.876859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:45.886305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c6341bad-6f2e-4b7e-b90b-56b0294f5e57 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.183297 May 23 13:39:45.887023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 438/867] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:45 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:46.087933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ac1be99-8835-48fa-b429-80c68af7cadf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:46.088968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ac1be99-8835-48fa-b429-80c68af7cadf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:46.095386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ac1be99-8835-48fa-b429-80c68af7cadf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:46.095836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ac1be99-8835-48fa-b429-80c68af7cadf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:46.096648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ac1be99-8835-48fa-b429-80c68af7cadf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:46.097094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ac1be99-8835-48fa-b429-80c68af7cadf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:46.135726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ac1be99-8835-48fa-b429-80c68af7cadf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052592 May 23 13:39:46.136224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 430/868] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:46 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:46.635348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17963a30-0fd4-46a2-8cb6-686d2d364bcf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:46.636529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17963a30-0fd4-46a2-8cb6-686d2d364bcf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:46.644164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17963a30-0fd4-46a2-8cb6-686d2d364bcf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:46.644650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17963a30-0fd4-46a2-8cb6-686d2d364bcf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:46.645454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17963a30-0fd4-46a2-8cb6-686d2d364bcf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:46.645915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17963a30-0fd4-46a2-8cb6-686d2d364bcf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:46.681014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17963a30-0fd4-46a2-8cb6-686d2d364bcf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050454 May 23 13:39:46.682234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 439/869] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:46.966550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-3c13497d-9f31-47fd-92a6-468000794fc4 req-01cdc2ef-8f4c-4fc6-a680-db080935790d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83ea9db-9db3-48c0-83a5-c423a1151195", "name": "network-vif-unplugged", "status": "completed", "tag": "fcdea6af-6005-431d-b6d7-10f18e37002a"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:39:46.984887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3c13497d-9f31-47fd-92a6-468000794fc4 req-01cdc2ef-8f4c-4fc6-a680-db080935790d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:46.990409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3c13497d-9f31-47fd-92a6-468000794fc4 req-01cdc2ef-8f4c-4fc6-a680-db080935790d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:47.007680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-3c13497d-9f31-47fd-92a6-468000794fc4 req-01cdc2ef-8f4c-4fc6-a680-db080935790d service nova] Creating event network-vif-unplugged:fcdea6af-6005-431d-b6d7-10f18e37002a for instance f83ea9db-9db3-48c0-83a5-c423a1151195 on hv-cinder-82549 May 23 13:39:47.017873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-3c13497d-9f31-47fd-92a6-468000794fc4 req-01cdc2ef-8f4c-4fc6-a680-db080935790d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141907 May 23 13:39:47.019460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 431/870] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:47.092467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4c5e5387-4a56-49c8-87e9-9f1f1fb9bf13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:47.093275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4c5e5387-4a56-49c8-87e9-9f1f1fb9bf13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:47.100172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c5e5387-4a56-49c8-87e9-9f1f1fb9bf13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:47.100661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c5e5387-4a56-49c8-87e9-9f1f1fb9bf13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:47.101464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c5e5387-4a56-49c8-87e9-9f1f1fb9bf13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:47.101914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c5e5387-4a56-49c8-87e9-9f1f1fb9bf13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:47.148430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75a3171c-4a92-4b51-96b8-ca16111bcb18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:47.149519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75a3171c-4a92-4b51-96b8-ca16111bcb18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:47.157471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75a3171c-4a92-4b51-96b8-ca16111bcb18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:47.157471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75a3171c-4a92-4b51-96b8-ca16111bcb18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:47.160122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75a3171c-4a92-4b51-96b8-ca16111bcb18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:47.160122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75a3171c-4a92-4b51-96b8-ca16111bcb18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:47.205451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75a3171c-4a92-4b51-96b8-ca16111bcb18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061023 May 23 13:39:47.206326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 432/871] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:47 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:47.313835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4c5e5387-4a56-49c8-87e9-9f1f1fb9bf13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:47.324520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4c5e5387-4a56-49c8-87e9-9f1f1fb9bf13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.416347 May 23 13:39:47.325755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 440/872] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:46 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:47.694018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-930f52c9-2107-4a6c-ad4e-e10abda393ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:47.699022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-930f52c9-2107-4a6c-ad4e-e10abda393ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:47.702067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-930f52c9-2107-4a6c-ad4e-e10abda393ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:47.702632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-930f52c9-2107-4a6c-ad4e-e10abda393ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:47.703427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-930f52c9-2107-4a6c-ad4e-e10abda393ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:47.703873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-930f52c9-2107-4a6c-ad4e-e10abda393ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:47.741064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-930f52c9-2107-4a6c-ad4e-e10abda393ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051052 May 23 13:39:47.741871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 433/873] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:47 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:48.217506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e79af644-2d01-4379-bbec-a8de113f76e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:48.218504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e79af644-2d01-4379-bbec-a8de113f76e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:48.225789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e79af644-2d01-4379-bbec-a8de113f76e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:48.226242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e79af644-2d01-4379-bbec-a8de113f76e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:48.227037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e79af644-2d01-4379-bbec-a8de113f76e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:48.227503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e79af644-2d01-4379-bbec-a8de113f76e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:48.261694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e79af644-2d01-4379-bbec-a8de113f76e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048224 May 23 13:39:48.262293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 441/874] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:48 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:48.343043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-32e65b1a-522e-4bf3-85ec-7bb991b7b264 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:48.343573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-32e65b1a-522e-4bf3-85ec-7bb991b7b264 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:48.350991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32e65b1a-522e-4bf3-85ec-7bb991b7b264 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:48.351447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32e65b1a-522e-4bf3-85ec-7bb991b7b264 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:48.352236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32e65b1a-522e-4bf3-85ec-7bb991b7b264 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:48.352775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32e65b1a-522e-4bf3-85ec-7bb991b7b264 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:48.506824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-32e65b1a-522e-4bf3-85ec-7bb991b7b264 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:48.515742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-32e65b1a-522e-4bf3-85ec-7bb991b7b264 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.176749 May 23 13:39:48.516335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 434/875] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:48 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:48.753383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-482ab53c-4079-46af-b64b-f8a99d9150fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:48.754324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-482ab53c-4079-46af-b64b-f8a99d9150fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:48.762402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482ab53c-4079-46af-b64b-f8a99d9150fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:48.762856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482ab53c-4079-46af-b64b-f8a99d9150fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:48.763662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482ab53c-4079-46af-b64b-f8a99d9150fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:48.764102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482ab53c-4079-46af-b64b-f8a99d9150fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:48.800112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-482ab53c-4079-46af-b64b-f8a99d9150fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050716 May 23 13:39:48.800723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 442/876] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:49.273827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57e2ffde-fe01-4a01-96b7-814072ffd712 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:49.274985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57e2ffde-fe01-4a01-96b7-814072ffd712 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:49.281493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57e2ffde-fe01-4a01-96b7-814072ffd712 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:49.281949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57e2ffde-fe01-4a01-96b7-814072ffd712 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:49.282722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57e2ffde-fe01-4a01-96b7-814072ffd712 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:49.283158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57e2ffde-fe01-4a01-96b7-814072ffd712 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:49.315780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57e2ffde-fe01-4a01-96b7-814072ffd712 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045873 May 23 13:39:49.316371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 435/877] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:49 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:49.534862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2aa8ace-94da-46e7-a117-9c1f259ba4bb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:49.535483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c2aa8ace-94da-46e7-a117-9c1f259ba4bb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:49.543730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2aa8ace-94da-46e7-a117-9c1f259ba4bb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:49.544221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2aa8ace-94da-46e7-a117-9c1f259ba4bb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:49.545092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2aa8ace-94da-46e7-a117-9c1f259ba4bb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:49.545768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2aa8ace-94da-46e7-a117-9c1f259ba4bb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:49.699580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c2aa8ace-94da-46e7-a117-9c1f259ba4bb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:49.707839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2aa8ace-94da-46e7-a117-9c1f259ba4bb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.176991 May 23 13:39:49.713769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 443/878] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:49 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:49.812348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b532a52d-e44d-485f-851d-70a8dab862bb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:49.813217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b532a52d-e44d-485f-851d-70a8dab862bb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:49.819934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b532a52d-e44d-485f-851d-70a8dab862bb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:49.820384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b532a52d-e44d-485f-851d-70a8dab862bb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:49.821203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b532a52d-e44d-485f-851d-70a8dab862bb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:49.822337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b532a52d-e44d-485f-851d-70a8dab862bb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:49.854634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b532a52d-e44d-485f-851d-70a8dab862bb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046252 May 23 13:39:49.855224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 436/879] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:49 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:50.329175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17819380-5e55-4652-953a-0c23b80b128d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:50.330171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17819380-5e55-4652-953a-0c23b80b128d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:50.336812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17819380-5e55-4652-953a-0c23b80b128d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:50.337923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17819380-5e55-4652-953a-0c23b80b128d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:50.339063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17819380-5e55-4652-953a-0c23b80b128d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:50.339509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17819380-5e55-4652-953a-0c23b80b128d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:50.374077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17819380-5e55-4652-953a-0c23b80b128d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049260 May 23 13:39:50.374678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 444/880] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:50 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:50.726731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-534ff3c9-a568-4754-beee-1831c1a5be00 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:50.726955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-534ff3c9-a568-4754-beee-1831c1a5be00 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:50.734071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-534ff3c9-a568-4754-beee-1831c1a5be00 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:50.734530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-534ff3c9-a568-4754-beee-1831c1a5be00 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:50.735319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-534ff3c9-a568-4754-beee-1831c1a5be00 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:50.735758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-534ff3c9-a568-4754-beee-1831c1a5be00 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:50.870367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f31a5654-5781-4ea6-b165-df41b6dcc8c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:50.871945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f31a5654-5781-4ea6-b165-df41b6dcc8c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:50.881886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f31a5654-5781-4ea6-b165-df41b6dcc8c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:50.882712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f31a5654-5781-4ea6-b165-df41b6dcc8c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:50.884218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f31a5654-5781-4ea6-b165-df41b6dcc8c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:50.885031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f31a5654-5781-4ea6-b165-df41b6dcc8c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:50.919532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-534ff3c9-a568-4754-beee-1831c1a5be00 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:50.928312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f31a5654-5781-4ea6-b165-df41b6dcc8c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063299 May 23 13:39:50.929123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 445/881] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:50 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:50.929409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-534ff3c9-a568-4754-beee-1831c1a5be00 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.206705 May 23 13:39:50.930856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 437/882] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:50 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:51.386790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97400841-04cb-43d9-90a9-461d70146200 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:51.387775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97400841-04cb-43d9-90a9-461d70146200 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:51.394422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97400841-04cb-43d9-90a9-461d70146200 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:51.394872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97400841-04cb-43d9-90a9-461d70146200 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:51.395663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97400841-04cb-43d9-90a9-461d70146200 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:51.396097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97400841-04cb-43d9-90a9-461d70146200 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:51.429346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97400841-04cb-43d9-90a9-461d70146200 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047083 May 23 13:39:51.429931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 446/883] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:51 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:51.942301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65d3b18e-f577-4b65-93c3-79302dd28a61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:51.943453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65d3b18e-f577-4b65-93c3-79302dd28a61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:51.953208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-582ad23b-564e-4f1a-bf0c-ef1f3360d3b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:51.954317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-582ad23b-564e-4f1a-bf0c-ef1f3360d3b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:51.956131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65d3b18e-f577-4b65-93c3-79302dd28a61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:51.956904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65d3b18e-f577-4b65-93c3-79302dd28a61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:51.958210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65d3b18e-f577-4b65-93c3-79302dd28a61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:51.958924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65d3b18e-f577-4b65-93c3-79302dd28a61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:51.966424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582ad23b-564e-4f1a-bf0c-ef1f3360d3b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:51.967040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582ad23b-564e-4f1a-bf0c-ef1f3360d3b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:51.968026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582ad23b-564e-4f1a-bf0c-ef1f3360d3b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:51.968623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-582ad23b-564e-4f1a-bf0c-ef1f3360d3b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:52.008469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65d3b18e-f577-4b65-93c3-79302dd28a61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070148 May 23 13:39:52.010260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 438/884] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:51 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:52.145587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-582ad23b-564e-4f1a-bf0c-ef1f3360d3b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:52.154588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-582ad23b-564e-4f1a-bf0c-ef1f3360d3b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.208788 May 23 13:39:52.155202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 447/885] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:51 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:52.441879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e373a9b1-142d-468e-b9be-7ca772e529b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:52.442857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e373a9b1-142d-468e-b9be-7ca772e529b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:52.450462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e373a9b1-142d-468e-b9be-7ca772e529b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:52.450909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e373a9b1-142d-468e-b9be-7ca772e529b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:52.451697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e373a9b1-142d-468e-b9be-7ca772e529b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:52.452134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e373a9b1-142d-468e-b9be-7ca772e529b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:52.486540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e373a9b1-142d-468e-b9be-7ca772e529b6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048944 May 23 13:39:52.487207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 439/886] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:52 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:53.023961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-040f95a8-3ba0-4917-bab5-fb4d2a703df6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:53.025560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-040f95a8-3ba0-4917-bab5-fb4d2a703df6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:53.035629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-040f95a8-3ba0-4917-bab5-fb4d2a703df6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:53.036260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-040f95a8-3ba0-4917-bab5-fb4d2a703df6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:53.037177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-040f95a8-3ba0-4917-bab5-fb4d2a703df6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:53.037873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-040f95a8-3ba0-4917-bab5-fb4d2a703df6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:53.084755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-040f95a8-3ba0-4917-bab5-fb4d2a703df6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065019 May 23 13:39:53.085352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 448/887] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:53 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:53.176777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-afc1c3e1-f349-4073-80eb-c8af92796d4e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:53.177758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-afc1c3e1-f349-4073-80eb-c8af92796d4e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:53.186815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afc1c3e1-f349-4073-80eb-c8af92796d4e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:53.187624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afc1c3e1-f349-4073-80eb-c8af92796d4e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:53.188493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afc1c3e1-f349-4073-80eb-c8af92796d4e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:53.189290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afc1c3e1-f349-4073-80eb-c8af92796d4e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:53.356786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-afc1c3e1-f349-4073-80eb-c8af92796d4e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:53.365862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-afc1c3e1-f349-4073-80eb-c8af92796d4e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.196358 May 23 13:39:53.366519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 440/888] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:53 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:53.498998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c70ed088-9e6d-441e-b2b7-6875549abc20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:53.500085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c70ed088-9e6d-441e-b2b7-6875549abc20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:53.507405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c70ed088-9e6d-441e-b2b7-6875549abc20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:53.507912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c70ed088-9e6d-441e-b2b7-6875549abc20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:53.509435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c70ed088-9e6d-441e-b2b7-6875549abc20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:53.510049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c70ed088-9e6d-441e-b2b7-6875549abc20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:53.549842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c70ed088-9e6d-441e-b2b7-6875549abc20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054977 May 23 13:39:53.550479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 449/889] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:53 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:54.098164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f3301e0-e7df-45af-9f45-d3e693ad7e2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:54.099750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f3301e0-e7df-45af-9f45-d3e693ad7e2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:54.107247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f3301e0-e7df-45af-9f45-d3e693ad7e2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:54.116538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f3301e0-e7df-45af-9f45-d3e693ad7e2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:54.116538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f3301e0-e7df-45af-9f45-d3e693ad7e2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:54.116538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f3301e0-e7df-45af-9f45-d3e693ad7e2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:54.146095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f3301e0-e7df-45af-9f45-d3e693ad7e2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052328 May 23 13:39:54.146900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 441/890] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:54 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:54.384768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ddb66aa-34bd-449d-8f8c-b6838f315f47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:54.385691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ddb66aa-34bd-449d-8f8c-b6838f315f47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:54.392683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddb66aa-34bd-449d-8f8c-b6838f315f47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:54.393133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddb66aa-34bd-449d-8f8c-b6838f315f47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:54.393914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddb66aa-34bd-449d-8f8c-b6838f315f47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:54.394355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddb66aa-34bd-449d-8f8c-b6838f315f47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:54.552322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ddb66aa-34bd-449d-8f8c-b6838f315f47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:54.563553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ebda70d-a4fe-4076-9211-117bc722ca74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:54.564478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ddb66aa-34bd-449d-8f8c-b6838f315f47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.182748 May 23 13:39:54.564808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ebda70d-a4fe-4076-9211-117bc722ca74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:54.569806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 450/891] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:54 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:54.572451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ebda70d-a4fe-4076-9211-117bc722ca74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:54.572938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ebda70d-a4fe-4076-9211-117bc722ca74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:54.573753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ebda70d-a4fe-4076-9211-117bc722ca74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:54.574198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ebda70d-a4fe-4076-9211-117bc722ca74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:54.611076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ebda70d-a4fe-4076-9211-117bc722ca74 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051538 May 23 13:39:54.611687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 442/892] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:54 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:55.158849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e13704d1-87d1-47c9-8195-61cd7b47f157 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:55.159789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e13704d1-87d1-47c9-8195-61cd7b47f157 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:55.167388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e13704d1-87d1-47c9-8195-61cd7b47f157 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:55.167843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e13704d1-87d1-47c9-8195-61cd7b47f157 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:55.168699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e13704d1-87d1-47c9-8195-61cd7b47f157 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:55.169149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e13704d1-87d1-47c9-8195-61cd7b47f157 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:55.205123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e13704d1-87d1-47c9-8195-61cd7b47f157 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050343 May 23 13:39:55.205732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 451/893] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:55 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:55.592151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b41ee51e-42af-4578-8a4e-9cc13979c43e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:55.593247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b41ee51e-42af-4578-8a4e-9cc13979c43e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:55.600004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b41ee51e-42af-4578-8a4e-9cc13979c43e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:55.600385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b41ee51e-42af-4578-8a4e-9cc13979c43e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:55.601203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b41ee51e-42af-4578-8a4e-9cc13979c43e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:55.601638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b41ee51e-42af-4578-8a4e-9cc13979c43e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:55.734292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9919bc47-4781-4cc1-b838-c99cffb77db4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1036551435"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:39:55.735519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9919bc47-4781-4cc1-b838-c99cffb77db4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:55.747024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9919bc47-4781-4cc1-b838-c99cffb77db4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:55.747882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9919bc47-4781-4cc1-b838-c99cffb77db4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:55.749605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9919bc47-4781-4cc1-b838-c99cffb77db4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:55.750306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9919bc47-4781-4cc1-b838-c99cffb77db4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:55.798113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b41ee51e-42af-4578-8a4e-9cc13979c43e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:55.807238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b41ee51e-42af-4578-8a4e-9cc13979c43e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.219215 May 23 13:39:55.807781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 452/894] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:55 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:55.815114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6eae9f5f-1233-4216-8b26-6a952fdbdb38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:55.816073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6eae9f5f-1233-4216-8b26-6a952fdbdb38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:55.823505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6eae9f5f-1233-4216-8b26-6a952fdbdb38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:55.823964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6eae9f5f-1233-4216-8b26-6a952fdbdb38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:55.825071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6eae9f5f-1233-4216-8b26-6a952fdbdb38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:55.825338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6eae9f5f-1233-4216-8b26-6a952fdbdb38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:55.860557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6eae9f5f-1233-4216-8b26-6a952fdbdb38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050913 May 23 13:39:55.861185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 453/895] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:55 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:55.913403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.network.security_group_api [None req-9919bc47-4781-4cc1-b838-c99cffb77db4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Removing security group 4842aed0-a821-4ba5-b2c6-10304be9d7a3 from port c4681035-db92-4c8b-8c08-d28d81ee09fa May 23 13:39:56.218409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f93fda6f-ed00-4520-b303-1843b5ad462e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:56.219652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f93fda6f-ed00-4520-b303-1843b5ad462e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:56.227967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f93fda6f-ed00-4520-b303-1843b5ad462e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:56.228795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f93fda6f-ed00-4520-b303-1843b5ad462e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:56.234660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f93fda6f-ed00-4520-b303-1843b5ad462e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:56.234660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f93fda6f-ed00-4520-b303-1843b5ad462e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:56.267062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f93fda6f-ed00-4520-b303-1843b5ad462e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053472 May 23 13:39:56.267654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 454/896] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:56 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:56.452361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9919bc47-4781-4cc1-b838-c99cffb77db4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "POST /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/action" status: 202 len: 0 microversion: 2.1 time: 0.876786 May 23 13:39:56.454526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 443/897] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:39:55 2022] POST /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 13:39:56.464524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-9ef4b417-bcd2-483a-9a40-5b3f675cc77f req-c58af20b-aec9-4cd1-bdc6-789a484b6fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ddd2ac-4582-4472-a43f-e3a8b4944ed2", "tag": "c4681035-db92-4c8b-8c08-d28d81ee09fa"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:39:56.487357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9ef4b417-bcd2-483a-9a40-5b3f675cc77f req-c58af20b-aec9-4cd1-bdc6-789a484b6fe3 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:56.487807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9ef4b417-bcd2-483a-9a40-5b3f675cc77f req-c58af20b-aec9-4cd1-bdc6-789a484b6fe3 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:56.503274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-9ef4b417-bcd2-483a-9a40-5b3f675cc77f req-c58af20b-aec9-4cd1-bdc6-789a484b6fe3 service nova] Creating event network-changed:c4681035-db92-4c8b-8c08-d28d81ee09fa for instance 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 on hv-cinder-82549 May 23 13:39:56.525320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-9ef4b417-bcd2-483a-9a40-5b3f675cc77f req-c58af20b-aec9-4cd1-bdc6-789a484b6fe3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070449 May 23 13:39:56.528136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 455/898] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:56.826769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-18b081da-5660-4fb1-bbc2-e903f4df45d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:56.828879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-18b081da-5660-4fb1-bbc2-e903f4df45d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:56.839841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18b081da-5660-4fb1-bbc2-e903f4df45d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:56.840285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18b081da-5660-4fb1-bbc2-e903f4df45d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:56.841125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18b081da-5660-4fb1-bbc2-e903f4df45d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:56.841564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18b081da-5660-4fb1-bbc2-e903f4df45d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:56.877787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-312b4041-90c2-462a-9fb0-952de8129183 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:56.880938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-312b4041-90c2-462a-9fb0-952de8129183 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:56.918409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-312b4041-90c2-462a-9fb0-952de8129183 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:56.919359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-312b4041-90c2-462a-9fb0-952de8129183 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:56.920790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-312b4041-90c2-462a-9fb0-952de8129183 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:56.921532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-312b4041-90c2-462a-9fb0-952de8129183 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:56.962953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:56.982077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-312b4041-90c2-462a-9fb0-952de8129183 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111765 May 23 13:39:56.983036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 456/899] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:56 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:57.199909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-18b081da-5660-4fb1-bbc2-e903f4df45d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:57.214896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-18b081da-5660-4fb1-bbc2-e903f4df45d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.392875 May 23 13:39:57.215605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 444/900] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:56 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:39:57.282522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1b7b92b4-b506-4b77-bd8c-240406006721 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:57.283465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1b7b92b4-b506-4b77-bd8c-240406006721 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:57.304449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b7b92b4-b506-4b77-bd8c-240406006721 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:57.304951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b7b92b4-b506-4b77-bd8c-240406006721 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:57.305967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b7b92b4-b506-4b77-bd8c-240406006721 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:57.306652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b7b92b4-b506-4b77-bd8c-240406006721 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:57.353372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1b7b92b4-b506-4b77-bd8c-240406006721 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076495 May 23 13:39:57.354627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 457/901] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:57 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:58.000660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-307aba0b-2e08-4573-9be2-136af99dfaee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:58.002265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-307aba0b-2e08-4573-9be2-136af99dfaee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:58.013888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-307aba0b-2e08-4573-9be2-136af99dfaee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:58.014603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-307aba0b-2e08-4573-9be2-136af99dfaee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:58.015896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-307aba0b-2e08-4573-9be2-136af99dfaee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:58.016626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-307aba0b-2e08-4573-9be2-136af99dfaee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:58.074495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-307aba0b-2e08-4573-9be2-136af99dfaee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081624 May 23 13:39:58.075518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 445/902] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:57 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:58.234435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7a0080e-2c94-41cd-9962-b1bf1ffe65f7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:58.235181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7a0080e-2c94-41cd-9962-b1bf1ffe65f7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:58.243068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7a0080e-2c94-41cd-9962-b1bf1ffe65f7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:58.243731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7a0080e-2c94-41cd-9962-b1bf1ffe65f7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:58.244589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7a0080e-2c94-41cd-9962-b1bf1ffe65f7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:58.245061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7a0080e-2c94-41cd-9962-b1bf1ffe65f7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:58.373215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-61805ca8-1a45-42ac-b254-93bf6cf03ac3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:58.375959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-61805ca8-1a45-42ac-b254-93bf6cf03ac3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:58.389348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61805ca8-1a45-42ac-b254-93bf6cf03ac3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:58.389995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61805ca8-1a45-42ac-b254-93bf6cf03ac3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:58.391011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61805ca8-1a45-42ac-b254-93bf6cf03ac3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:58.391554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61805ca8-1a45-42ac-b254-93bf6cf03ac3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:58.427511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:39:58.433177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-61805ca8-1a45-42ac-b254-93bf6cf03ac3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069422 May 23 13:39:58.433777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 446/903] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:39:58.439183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0a092fe1-fa91-4a8f-bd45-17ffb8924cfc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:58.440688 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0a092fe1-fa91-4a8f-bd45-17ffb8924cfc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:58.446814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a092fe1-fa91-4a8f-bd45-17ffb8924cfc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:58.447263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a092fe1-fa91-4a8f-bd45-17ffb8924cfc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:58.448056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a092fe1-fa91-4a8f-bd45-17ffb8924cfc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:58.448494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a092fe1-fa91-4a8f-bd45-17ffb8924cfc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:58.482033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7a0080e-2c94-41cd-9962-b1bf1ffe65f7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:58.490773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7a0080e-2c94-41cd-9962-b1bf1ffe65f7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.260945 May 23 13:39:58.491388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 458/904] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:58 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:39:58.558983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-ec59a9d3-d42a-4e7c-ab9f-c432d916e3c7 req-11fc65b4-9e5f-4540-8640-94ff16194336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ddd2ac-4582-4472-a43f-e3a8b4944ed2", "tag": "c4681035-db92-4c8b-8c08-d28d81ee09fa"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:39:58.567491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ec59a9d3-d42a-4e7c-ab9f-c432d916e3c7 req-11fc65b4-9e5f-4540-8640-94ff16194336 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:58.567936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ec59a9d3-d42a-4e7c-ab9f-c432d916e3c7 req-11fc65b4-9e5f-4540-8640-94ff16194336 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:58.580826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-ec59a9d3-d42a-4e7c-ab9f-c432d916e3c7 req-11fc65b4-9e5f-4540-8640-94ff16194336 service nova] Creating event network-changed:c4681035-db92-4c8b-8c08-d28d81ee09fa for instance 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 on hv-cinder-82549 May 23 13:39:58.588997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-ec59a9d3-d42a-4e7c-ab9f-c432d916e3c7 req-11fc65b4-9e5f-4540-8640-94ff16194336 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094290 May 23 13:39:58.588997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 459/905] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:39:59.090407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8932dc75-eb0e-4684-9b9f-347beae43a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:59.091770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8932dc75-eb0e-4684-9b9f-347beae43a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:59.100940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8932dc75-eb0e-4684-9b9f-347beae43a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:59.101518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8932dc75-eb0e-4684-9b9f-347beae43a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:59.102799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8932dc75-eb0e-4684-9b9f-347beae43a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:59.103601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8932dc75-eb0e-4684-9b9f-347beae43a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:59.165472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8932dc75-eb0e-4684-9b9f-347beae43a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080761 May 23 13:39:59.166808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 460/906] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:39:59 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:39:59.454435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-703146ee-9ec4-4e33-bd8f-f3c00d3baa4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:59.455592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-703146ee-9ec4-4e33-bd8f-f3c00d3baa4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:59.466470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-703146ee-9ec4-4e33-bd8f-f3c00d3baa4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:59.467206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-703146ee-9ec4-4e33-bd8f-f3c00d3baa4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:59.468508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-703146ee-9ec4-4e33-bd8f-f3c00d3baa4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:59.469281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-703146ee-9ec4-4e33-bd8f-f3c00d3baa4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:59.516636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-703146ee-9ec4-4e33-bd8f-f3c00d3baa4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068372 May 23 13:39:59.517331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 461/907] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:39:59 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:39:59.523218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca6b07f1-9601-49de-96d0-d76e397941ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:39:59.523855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ca6b07f1-9601-49de-96d0-d76e397941ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:39:59.531936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6b07f1-9601-49de-96d0-d76e397941ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:59.532603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6b07f1-9601-49de-96d0-d76e397941ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:59.533544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6b07f1-9601-49de-96d0-d76e397941ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:39:59.534166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca6b07f1-9601-49de-96d0-d76e397941ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:39:59.724341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ca6b07f1-9601-49de-96d0-d76e397941ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:39:59.733168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ca6b07f1-9601-49de-96d0-d76e397941ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.214494 May 23 13:39:59.733769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 462/908] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:39:59 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:40:00.183157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-042449df-9468-4683-a609-e13ee1639850 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:00.184499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-042449df-9468-4683-a609-e13ee1639850 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:00.193077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-042449df-9468-4683-a609-e13ee1639850 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:00.193537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-042449df-9468-4683-a609-e13ee1639850 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:00.194429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-042449df-9468-4683-a609-e13ee1639850 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:00.194886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-042449df-9468-4683-a609-e13ee1639850 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:00.231362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-042449df-9468-4683-a609-e13ee1639850 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055162 May 23 13:40:00.231954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 463/909] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:00 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:00.532650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c708e602-b03d-4b3b-ac08-0059d62bd1ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:00.533609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c708e602-b03d-4b3b-ac08-0059d62bd1ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:00.543628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c708e602-b03d-4b3b-ac08-0059d62bd1ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:00.544086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c708e602-b03d-4b3b-ac08-0059d62bd1ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:00.544922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c708e602-b03d-4b3b-ac08-0059d62bd1ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:00.545364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c708e602-b03d-4b3b-ac08-0059d62bd1ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:00.578978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c708e602-b03d-4b3b-ac08-0059d62bd1ab tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051209 May 23 13:40:00.579569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 464/910] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:40:00.752423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33776ffe-0859-4715-b6d2-4209b8ccf9e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:00.753252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33776ffe-0859-4715-b6d2-4209b8ccf9e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:00.762398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33776ffe-0859-4715-b6d2-4209b8ccf9e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:00.763210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33776ffe-0859-4715-b6d2-4209b8ccf9e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:00.764719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33776ffe-0859-4715-b6d2-4209b8ccf9e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:00.765542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33776ffe-0859-4715-b6d2-4209b8ccf9e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:00.927807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33776ffe-0859-4715-b6d2-4209b8ccf9e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:00.937095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33776ffe-0859-4715-b6d2-4209b8ccf9e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.189000 May 23 13:40:00.937788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 465/911] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:00 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:01.245406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0af0de1a-33d7-48dd-b27b-8e863126043d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:01.246525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0af0de1a-33d7-48dd-b27b-8e863126043d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:01.253224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0af0de1a-33d7-48dd-b27b-8e863126043d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:01.253724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0af0de1a-33d7-48dd-b27b-8e863126043d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:01.254582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0af0de1a-33d7-48dd-b27b-8e863126043d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:01.255059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0af0de1a-33d7-48dd-b27b-8e863126043d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:01.290738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0af0de1a-33d7-48dd-b27b-8e863126043d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048957 May 23 13:40:01.291356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 466/912] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:01 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:40:01.591453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-30b59d97-16cf-4a2b-a874-606432beeecd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:01.592343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-30b59d97-16cf-4a2b-a874-606432beeecd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:01.599503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30b59d97-16cf-4a2b-a874-606432beeecd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:01.599957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30b59d97-16cf-4a2b-a874-606432beeecd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:01.600794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30b59d97-16cf-4a2b-a874-606432beeecd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:01.601239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30b59d97-16cf-4a2b-a874-606432beeecd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:01.636507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-30b59d97-16cf-4a2b-a874-606432beeecd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049363 May 23 13:40:01.637141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 467/913] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:01 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:40:01.959980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ace79e13-f540-4f29-a50c-4a143efe513e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:01.961245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ace79e13-f540-4f29-a50c-4a143efe513e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:01.972944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ace79e13-f540-4f29-a50c-4a143efe513e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:01.973770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ace79e13-f540-4f29-a50c-4a143efe513e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:01.975197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ace79e13-f540-4f29-a50c-4a143efe513e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:01.975991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ace79e13-f540-4f29-a50c-4a143efe513e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:02.162519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ace79e13-f540-4f29-a50c-4a143efe513e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:02.170996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ace79e13-f540-4f29-a50c-4a143efe513e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.218470 May 23 13:40:02.171597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 468/914] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:01 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:40:02.303016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c71ecd43-d5b3-46ef-ad2f-95826e9d28ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:02.303961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c71ecd43-d5b3-46ef-ad2f-95826e9d28ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:02.311230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c71ecd43-d5b3-46ef-ad2f-95826e9d28ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:02.311820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c71ecd43-d5b3-46ef-ad2f-95826e9d28ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:02.312698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c71ecd43-d5b3-46ef-ad2f-95826e9d28ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:02.313176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c71ecd43-d5b3-46ef-ad2f-95826e9d28ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:02.348517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c71ecd43-d5b3-46ef-ad2f-95826e9d28ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049613 May 23 13:40:02.349243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 469/915] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:02 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:40:02.648764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ccf0bc98-82a7-4ffb-8d16-1e121ffa8487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:02.650293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ccf0bc98-82a7-4ffb-8d16-1e121ffa8487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:02.657442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc98-82a7-4ffb-8d16-1e121ffa8487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:02.657897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc98-82a7-4ffb-8d16-1e121ffa8487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:02.658703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc98-82a7-4ffb-8d16-1e121ffa8487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:02.659148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc98-82a7-4ffb-8d16-1e121ffa8487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:02.716255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ccf0bc98-82a7-4ffb-8d16-1e121ffa8487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071234 May 23 13:40:02.717370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 470/916] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:02 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:40:03.192457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1d7557a0-a6e0-4111-9b2f-384ae8ec8303 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:03.193360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1d7557a0-a6e0-4111-9b2f-384ae8ec8303 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:03.200215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d7557a0-a6e0-4111-9b2f-384ae8ec8303 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:03.200765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d7557a0-a6e0-4111-9b2f-384ae8ec8303 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:03.201604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d7557a0-a6e0-4111-9b2f-384ae8ec8303 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:03.202110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d7557a0-a6e0-4111-9b2f-384ae8ec8303 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:03.357338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d7557a0-a6e0-4111-9b2f-384ae8ec8303 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:03.365767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1d7557a0-a6e0-4111-9b2f-384ae8ec8303 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.179954 May 23 13:40:03.366359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 471/917] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:03 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:03.371663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6908e09e-69fb-439d-a9ff-9346a32df91d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:03.373000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6908e09e-69fb-439d-a9ff-9346a32df91d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:03.379999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6908e09e-69fb-439d-a9ff-9346a32df91d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:03.380460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6908e09e-69fb-439d-a9ff-9346a32df91d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:03.381298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6908e09e-69fb-439d-a9ff-9346a32df91d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:03.381755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6908e09e-69fb-439d-a9ff-9346a32df91d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:03.417603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6908e09e-69fb-439d-a9ff-9346a32df91d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050114 May 23 13:40:03.418202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 472/918] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:03 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:03.731128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5e8e00ea-27df-4ea4-9612-f71a1b6d854a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:03.732215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5e8e00ea-27df-4ea4-9612-f71a1b6d854a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:03.743856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e8e00ea-27df-4ea4-9612-f71a1b6d854a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:03.744672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e8e00ea-27df-4ea4-9612-f71a1b6d854a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:03.746083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e8e00ea-27df-4ea4-9612-f71a1b6d854a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:03.746878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e8e00ea-27df-4ea4-9612-f71a1b6d854a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:03.770241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:03.784339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5e8e00ea-27df-4ea4-9612-f71a1b6d854a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058134 May 23 13:40:03.785437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 473/919] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:03 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:40:04.386074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b19e5e87-99d8-4610-8607-77e1c8f1fe9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:04.386797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b19e5e87-99d8-4610-8607-77e1c8f1fe9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:04.393568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b19e5e87-99d8-4610-8607-77e1c8f1fe9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:04.394027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b19e5e87-99d8-4610-8607-77e1c8f1fe9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:04.394822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b19e5e87-99d8-4610-8607-77e1c8f1fe9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:04.395296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b19e5e87-99d8-4610-8607-77e1c8f1fe9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:04.537987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b19e5e87-99d8-4610-8607-77e1c8f1fe9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:04.546843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b19e5e87-99d8-4610-8607-77e1c8f1fe9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.165846 May 23 13:40:04.547452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 474/920] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:04 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:04.552530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d1aca8ee-03f3-4084-9d0c-e8dd198135e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:04.553543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d1aca8ee-03f3-4084-9d0c-e8dd198135e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:04.561021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1aca8ee-03f3-4084-9d0c-e8dd198135e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:04.561484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1aca8ee-03f3-4084-9d0c-e8dd198135e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:04.562309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1aca8ee-03f3-4084-9d0c-e8dd198135e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:04.562757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1aca8ee-03f3-4084-9d0c-e8dd198135e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:04.596697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d1aca8ee-03f3-4084-9d0c-e8dd198135e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048081 May 23 13:40:04.597313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 475/921] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:04 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:04.799503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-00072f99-4984-4f43-8285-8635fc18f201 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:04.800332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-00072f99-4984-4f43-8285-8635fc18f201 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:04.807998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00072f99-4984-4f43-8285-8635fc18f201 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:04.808453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00072f99-4984-4f43-8285-8635fc18f201 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:04.809301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00072f99-4984-4f43-8285-8635fc18f201 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:04.809738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00072f99-4984-4f43-8285-8635fc18f201 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:04.843175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-00072f99-4984-4f43-8285-8635fc18f201 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047859 May 23 13:40:04.843778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 476/922] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:04 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:40:05.565930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d559954-952d-499f-9efb-dadbc924aa65 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:05.566617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d559954-952d-499f-9efb-dadbc924aa65 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:05.573857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d559954-952d-499f-9efb-dadbc924aa65 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:05.574310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d559954-952d-499f-9efb-dadbc924aa65 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:05.575095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d559954-952d-499f-9efb-dadbc924aa65 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:05.575535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d559954-952d-499f-9efb-dadbc924aa65 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:05.744313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d559954-952d-499f-9efb-dadbc924aa65 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:05.760096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d559954-952d-499f-9efb-dadbc924aa65 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.197880 May 23 13:40:05.761188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 477/923] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:05 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:05.770556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15d8bfc8-e31b-4e20-a076-61e20de2719e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:05.772222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15d8bfc8-e31b-4e20-a076-61e20de2719e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:05.783715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15d8bfc8-e31b-4e20-a076-61e20de2719e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:05.784532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15d8bfc8-e31b-4e20-a076-61e20de2719e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:05.786066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15d8bfc8-e31b-4e20-a076-61e20de2719e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:05.786875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15d8bfc8-e31b-4e20-a076-61e20de2719e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:05.824342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15d8bfc8-e31b-4e20-a076-61e20de2719e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061477 May 23 13:40:05.825281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 478/924] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:05 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:05.856456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-98074629-3624-43a5-9332-1ffe6614f474 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:05.857450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-98074629-3624-43a5-9332-1ffe6614f474 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:05.864257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98074629-3624-43a5-9332-1ffe6614f474 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:05.864836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98074629-3624-43a5-9332-1ffe6614f474 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:05.865689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98074629-3624-43a5-9332-1ffe6614f474 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:05.866188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98074629-3624-43a5-9332-1ffe6614f474 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:05.902788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-98074629-3624-43a5-9332-1ffe6614f474 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051218 May 23 13:40:05.903327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 479/925] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:05 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:40:06.786718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-24737492-7fcf-4dc4-b9a0-71add12d34c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:06.787902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-24737492-7fcf-4dc4-b9a0-71add12d34c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:06.799829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24737492-7fcf-4dc4-b9a0-71add12d34c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:06.800615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24737492-7fcf-4dc4-b9a0-71add12d34c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:06.802112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24737492-7fcf-4dc4-b9a0-71add12d34c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:06.802952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24737492-7fcf-4dc4-b9a0-71add12d34c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:07.011499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-24737492-7fcf-4dc4-b9a0-71add12d34c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:07.019893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-24737492-7fcf-4dc4-b9a0-71add12d34c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.240772 May 23 13:40:07.020500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 480/926] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:06 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:07.026627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-09205c13-7223-4d98-9010-0faf8c6b5df4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:07.027876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09205c13-7223-4d98-9010-0faf8c6b5df4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:07.035657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09205c13-7223-4d98-9010-0faf8c6b5df4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:07.036118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09205c13-7223-4d98-9010-0faf8c6b5df4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:07.036958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09205c13-7223-4d98-9010-0faf8c6b5df4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:07.037406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09205c13-7223-4d98-9010-0faf8c6b5df4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:07.074075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-09205c13-7223-4d98-9010-0faf8c6b5df4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052332 May 23 13:40:07.074572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 481/927] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:07 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:07.079520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97995157-4ab5-41b4-abe7-997252d871f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:07.080460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97995157-4ab5-41b4-abe7-997252d871f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:07.087486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97995157-4ab5-41b4-abe7-997252d871f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:07.087951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97995157-4ab5-41b4-abe7-997252d871f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:07.088791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97995157-4ab5-41b4-abe7-997252d871f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:07.089251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97995157-4ab5-41b4-abe7-997252d871f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:07.123591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97995157-4ab5-41b4-abe7-997252d871f3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047910 May 23 13:40:07.124440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 482/928] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:07 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:08.039540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-383c874d-51a6-4130-af7f-d6978a2e2902 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:08.040594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-383c874d-51a6-4130-af7f-d6978a2e2902 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:08.047952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-383c874d-51a6-4130-af7f-d6978a2e2902 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:08.048551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-383c874d-51a6-4130-af7f-d6978a2e2902 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:08.049411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-383c874d-51a6-4130-af7f-d6978a2e2902 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:08.049943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-383c874d-51a6-4130-af7f-d6978a2e2902 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:08.211700 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-383c874d-51a6-4130-af7f-d6978a2e2902 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:08.225951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-383c874d-51a6-4130-af7f-d6978a2e2902 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.190291 May 23 13:40:08.227600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 483/929] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:08 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:08.236761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ba7ae725-b49b-4751-8cd0-46db28a04daf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:08.238600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ba7ae725-b49b-4751-8cd0-46db28a04daf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:08.249885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba7ae725-b49b-4751-8cd0-46db28a04daf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:08.250662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba7ae725-b49b-4751-8cd0-46db28a04daf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:08.252027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba7ae725-b49b-4751-8cd0-46db28a04daf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:08.252983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba7ae725-b49b-4751-8cd0-46db28a04daf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:08.289136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ba7ae725-b49b-4751-8cd0-46db28a04daf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059693 May 23 13:40:08.290725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 484/930] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:08 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:08.296672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d7bf337-f91a-4291-8aca-9850df53df45 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:08.297669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6d7bf337-f91a-4291-8aca-9850df53df45 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:08.307793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d7bf337-f91a-4291-8aca-9850df53df45 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:08.308244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d7bf337-f91a-4291-8aca-9850df53df45 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:08.309092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d7bf337-f91a-4291-8aca-9850df53df45 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:08.309541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d7bf337-f91a-4291-8aca-9850df53df45 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:08.344630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6d7bf337-f91a-4291-8aca-9850df53df45 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052353 May 23 13:40:08.345484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 485/931] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:08 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:08.446860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=47 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:08.479286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:09.245472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae8effb0-bb2f-44e9-90f8-a7bb7447074e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:09.246125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae8effb0-bb2f-44e9-90f8-a7bb7447074e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:09.248671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:09.254758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae8effb0-bb2f-44e9-90f8-a7bb7447074e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:09.255215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae8effb0-bb2f-44e9-90f8-a7bb7447074e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:09.256009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae8effb0-bb2f-44e9-90f8-a7bb7447074e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:09.256452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae8effb0-bb2f-44e9-90f8-a7bb7447074e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:09.415356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae8effb0-bb2f-44e9-90f8-a7bb7447074e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:09.423813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae8effb0-bb2f-44e9-90f8-a7bb7447074e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.182820 May 23 13:40:09.424403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 486/932] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:09 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:09.429474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cdfc1c5e-ea47-4041-b6cb-544432d8deaa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:09.431498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cdfc1c5e-ea47-4041-b6cb-544432d8deaa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:09.437685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdfc1c5e-ea47-4041-b6cb-544432d8deaa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:09.438137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdfc1c5e-ea47-4041-b6cb-544432d8deaa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:09.438916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdfc1c5e-ea47-4041-b6cb-544432d8deaa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:09.439350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdfc1c5e-ea47-4041-b6cb-544432d8deaa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:09.472992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cdfc1c5e-ea47-4041-b6cb-544432d8deaa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047417 May 23 13:40:09.473670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 487/933] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:09 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:09.481624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d13c578e-b087-4e94-b64d-f81de3f7479c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:09.482606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d13c578e-b087-4e94-b64d-f81de3f7479c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:09.489633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d13c578e-b087-4e94-b64d-f81de3f7479c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:09.490139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d13c578e-b087-4e94-b64d-f81de3f7479c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:09.490965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d13c578e-b087-4e94-b64d-f81de3f7479c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:09.491479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d13c578e-b087-4e94-b64d-f81de3f7479c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:09.526833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d13c578e-b087-4e94-b64d-f81de3f7479c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051700 May 23 13:40:09.527432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 488/934] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:09 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:10.443760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b912be6-c48b-4c29-b1b1-7153a3dd6379 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:10.444519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b912be6-c48b-4c29-b1b1-7153a3dd6379 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:10.452318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b912be6-c48b-4c29-b1b1-7153a3dd6379 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:10.452811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b912be6-c48b-4c29-b1b1-7153a3dd6379 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:10.453602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b912be6-c48b-4c29-b1b1-7153a3dd6379 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:10.454045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b912be6-c48b-4c29-b1b1-7153a3dd6379 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:10.610739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b912be6-c48b-4c29-b1b1-7153a3dd6379 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:10.621572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b912be6-c48b-4c29-b1b1-7153a3dd6379 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.181391 May 23 13:40:10.622642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 489/935] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:10 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:10.631730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9956db2e-600a-423e-a069-a3605a9f8ccd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:10.639044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9956db2e-600a-423e-a069-a3605a9f8ccd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:10.644715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9956db2e-600a-423e-a069-a3605a9f8ccd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:10.645500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9956db2e-600a-423e-a069-a3605a9f8ccd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:10.646940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9956db2e-600a-423e-a069-a3605a9f8ccd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:10.647736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9956db2e-600a-423e-a069-a3605a9f8ccd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:10.655893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:10.709535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9956db2e-600a-423e-a069-a3605a9f8ccd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084794 May 23 13:40:10.710526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 490/936] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:10 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:10.719566 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d325c56a-7c96-4bb4-8eb3-77ca95ec4df4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:10.721267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d325c56a-7c96-4bb4-8eb3-77ca95ec4df4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:10.732939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d325c56a-7c96-4bb4-8eb3-77ca95ec4df4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:10.733756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d325c56a-7c96-4bb4-8eb3-77ca95ec4df4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:10.735241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d325c56a-7c96-4bb4-8eb3-77ca95ec4df4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:10.735967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d325c56a-7c96-4bb4-8eb3-77ca95ec4df4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:10.772736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d325c56a-7c96-4bb4-8eb3-77ca95ec4df4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060565 May 23 13:40:10.773338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 491/937] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:10 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:11.640031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1b786bd-5d20-4347-8c96-1a2d7383bb97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:11.641043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1b786bd-5d20-4347-8c96-1a2d7383bb97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:11.647775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1b786bd-5d20-4347-8c96-1a2d7383bb97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:11.648232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1b786bd-5d20-4347-8c96-1a2d7383bb97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:11.650294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1b786bd-5d20-4347-8c96-1a2d7383bb97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:11.650755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1b786bd-5d20-4347-8c96-1a2d7383bb97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:11.826875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1b786bd-5d20-4347-8c96-1a2d7383bb97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:11.835509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1b786bd-5d20-4347-8c96-1a2d7383bb97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.199445 May 23 13:40:11.836831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 492/938] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:11 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:11.842924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d18fef7d-4f70-4cd9-a2bf-33ce207a4421 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:11.843879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d18fef7d-4f70-4cd9-a2bf-33ce207a4421 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:11.850442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18fef7d-4f70-4cd9-a2bf-33ce207a4421 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:11.850911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18fef7d-4f70-4cd9-a2bf-33ce207a4421 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:11.853636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18fef7d-4f70-4cd9-a2bf-33ce207a4421 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:11.853636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18fef7d-4f70-4cd9-a2bf-33ce207a4421 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:11.890687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d18fef7d-4f70-4cd9-a2bf-33ce207a4421 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051673 May 23 13:40:11.891190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 493/939] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:11 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:11.896282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c73380a8-b411-4814-9c4e-153341ab8d94 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:11.897253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c73380a8-b411-4814-9c4e-153341ab8d94 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:11.904963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c73380a8-b411-4814-9c4e-153341ab8d94 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:11.905424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c73380a8-b411-4814-9c4e-153341ab8d94 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:11.906214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c73380a8-b411-4814-9c4e-153341ab8d94 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:11.906658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c73380a8-b411-4814-9c4e-153341ab8d94 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:11.942626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c73380a8-b411-4814-9c4e-153341ab8d94 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050315 May 23 13:40:11.943239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 494/940] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:12.864043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e43026e2-ce9c-44a2-ab41-8e85ac645813 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:12.864925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e43026e2-ce9c-44a2-ab41-8e85ac645813 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:12.872010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e43026e2-ce9c-44a2-ab41-8e85ac645813 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:12.872458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e43026e2-ce9c-44a2-ab41-8e85ac645813 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:12.873287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e43026e2-ce9c-44a2-ab41-8e85ac645813 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:12.873729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e43026e2-ce9c-44a2-ab41-8e85ac645813 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:13.028551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e43026e2-ce9c-44a2-ab41-8e85ac645813 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:13.036902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e43026e2-ce9c-44a2-ab41-8e85ac645813 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.177081 May 23 13:40:13.037516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 495/941] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:12 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:13.042350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f769e59-b9c9-4c69-8135-7b7cbabebb8e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:13.043286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f769e59-b9c9-4c69-8135-7b7cbabebb8e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:13.051128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f769e59-b9c9-4c69-8135-7b7cbabebb8e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:13.051578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f769e59-b9c9-4c69-8135-7b7cbabebb8e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:13.052457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f769e59-b9c9-4c69-8135-7b7cbabebb8e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:13.052946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f769e59-b9c9-4c69-8135-7b7cbabebb8e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:13.087795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f769e59-b9c9-4c69-8135-7b7cbabebb8e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049193 May 23 13:40:13.088391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 496/942] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:13 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:13.093680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2bea1f95-a24a-451a-a9f2-5c1b414d185a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:13.094702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2bea1f95-a24a-451a-a9f2-5c1b414d185a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:13.103933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bea1f95-a24a-451a-a9f2-5c1b414d185a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:13.104397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bea1f95-a24a-451a-a9f2-5c1b414d185a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:13.105250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bea1f95-a24a-451a-a9f2-5c1b414d185a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:13.105689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bea1f95-a24a-451a-a9f2-5c1b414d185a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:13.138629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2bea1f95-a24a-451a-a9f2-5c1b414d185a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048776 May 23 13:40:13.139135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 497/943] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:13 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:14.060176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-255ab626-8553-431f-b376-7b051f48f664 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:14.060904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-255ab626-8553-431f-b376-7b051f48f664 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:14.069009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-255ab626-8553-431f-b376-7b051f48f664 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:14.069608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-255ab626-8553-431f-b376-7b051f48f664 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:14.070750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-255ab626-8553-431f-b376-7b051f48f664 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:14.071379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-255ab626-8553-431f-b376-7b051f48f664 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:14.233352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-255ab626-8553-431f-b376-7b051f48f664 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:14.241728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-255ab626-8553-431f-b376-7b051f48f664 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.185351 May 23 13:40:14.242353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 498/944] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:14 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:14.248005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9cf3b4a7-98ee-49f8-b288-81675ffb7d26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:14.248987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9cf3b4a7-98ee-49f8-b288-81675ffb7d26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:14.255644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cf3b4a7-98ee-49f8-b288-81675ffb7d26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:14.256099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cf3b4a7-98ee-49f8-b288-81675ffb7d26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:14.256919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cf3b4a7-98ee-49f8-b288-81675ffb7d26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:14.257364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cf3b4a7-98ee-49f8-b288-81675ffb7d26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:14.293971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9cf3b4a7-98ee-49f8-b288-81675ffb7d26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049844 May 23 13:40:14.294574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 499/945] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:14 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:14.299758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6285796a-9d63-4afc-b612-e45b2f0aceed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:14.300733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6285796a-9d63-4afc-b612-e45b2f0aceed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:14.308974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6285796a-9d63-4afc-b612-e45b2f0aceed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:14.309634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6285796a-9d63-4afc-b612-e45b2f0aceed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:14.310658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6285796a-9d63-4afc-b612-e45b2f0aceed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:14.311214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6285796a-9d63-4afc-b612-e45b2f0aceed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:14.348462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6285796a-9d63-4afc-b612-e45b2f0aceed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052722 May 23 13:40:14.349174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 500/946] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:14 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:15.262397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-665fc9d3-b53c-4656-a98b-6bac5a5dd125 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:15.263193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-665fc9d3-b53c-4656-a98b-6bac5a5dd125 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:15.269496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-665fc9d3-b53c-4656-a98b-6bac5a5dd125 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:15.269959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-665fc9d3-b53c-4656-a98b-6bac5a5dd125 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:15.270771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-665fc9d3-b53c-4656-a98b-6bac5a5dd125 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:15.271221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-665fc9d3-b53c-4656-a98b-6bac5a5dd125 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:15.424121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-665fc9d3-b53c-4656-a98b-6bac5a5dd125 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:15.433408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-665fc9d3-b53c-4656-a98b-6bac5a5dd125 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.175957 May 23 13:40:15.433916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 501/947] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:15 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:15.438834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5b36228c-3489-44d1-a0ad-dee92d6366be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:15.439793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5b36228c-3489-44d1-a0ad-dee92d6366be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:15.447885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b36228c-3489-44d1-a0ad-dee92d6366be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:15.448781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b36228c-3489-44d1-a0ad-dee92d6366be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:15.450216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b36228c-3489-44d1-a0ad-dee92d6366be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:15.451000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b36228c-3489-44d1-a0ad-dee92d6366be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:15.486703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5b36228c-3489-44d1-a0ad-dee92d6366be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051651 May 23 13:40:15.487854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 502/948] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:15 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:15.493230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e09e89b-5f39-4b1a-9b94-ba8e44f11b1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:15.494427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e09e89b-5f39-4b1a-9b94-ba8e44f11b1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:15.500970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e09e89b-5f39-4b1a-9b94-ba8e44f11b1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:15.501427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e09e89b-5f39-4b1a-9b94-ba8e44f11b1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:15.502238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e09e89b-5f39-4b1a-9b94-ba8e44f11b1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:15.502683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e09e89b-5f39-4b1a-9b94-ba8e44f11b1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:15.537470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e09e89b-5f39-4b1a-9b94-ba8e44f11b1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048726 May 23 13:40:15.538151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 503/949] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:15 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:16.460176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02fbfc61-6aa1-4a9e-b296-f48c1cacbda7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:16.460911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02fbfc61-6aa1-4a9e-b296-f48c1cacbda7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:16.468300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fbfc61-6aa1-4a9e-b296-f48c1cacbda7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:16.468848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fbfc61-6aa1-4a9e-b296-f48c1cacbda7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:16.469637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fbfc61-6aa1-4a9e-b296-f48c1cacbda7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:16.470071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fbfc61-6aa1-4a9e-b296-f48c1cacbda7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:16.636122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02fbfc61-6aa1-4a9e-b296-f48c1cacbda7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:16.650485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02fbfc61-6aa1-4a9e-b296-f48c1cacbda7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.194004 May 23 13:40:16.651467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 504/950] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:16 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:16.659962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a4f1e44f-f5e6-4d28-9ec7-45ac97e246a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:16.661120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a4f1e44f-f5e6-4d28-9ec7-45ac97e246a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:16.671659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4f1e44f-f5e6-4d28-9ec7-45ac97e246a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:16.672458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4f1e44f-f5e6-4d28-9ec7-45ac97e246a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:16.673912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4f1e44f-f5e6-4d28-9ec7-45ac97e246a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:16.677557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4f1e44f-f5e6-4d28-9ec7-45ac97e246a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:16.732730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a4f1e44f-f5e6-4d28-9ec7-45ac97e246a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079233 May 23 13:40:16.733703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 505/951] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:16 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:16.742837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ba4801e1-de37-40bf-bbb5-b36ee91b8e37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:16.744426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ba4801e1-de37-40bf-bbb5-b36ee91b8e37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:16.754940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba4801e1-de37-40bf-bbb5-b36ee91b8e37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:16.755902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba4801e1-de37-40bf-bbb5-b36ee91b8e37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:16.757101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba4801e1-de37-40bf-bbb5-b36ee91b8e37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:16.758447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba4801e1-de37-40bf-bbb5-b36ee91b8e37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:16.806516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:16.814999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ba4801e1-de37-40bf-bbb5-b36ee91b8e37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079571 May 23 13:40:16.818893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 506/952] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:17.668899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-acde3aaa-d514-4a4e-b0a9-ea1c387a90e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:17.669899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-acde3aaa-d514-4a4e-b0a9-ea1c387a90e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:17.676896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-acde3aaa-d514-4a4e-b0a9-ea1c387a90e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:17.677345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-acde3aaa-d514-4a4e-b0a9-ea1c387a90e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:17.678127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-acde3aaa-d514-4a4e-b0a9-ea1c387a90e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:17.678562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-acde3aaa-d514-4a4e-b0a9-ea1c387a90e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:17.831652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-acde3aaa-d514-4a4e-b0a9-ea1c387a90e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:17.840121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-acde3aaa-d514-4a4e-b0a9-ea1c387a90e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.175777 May 23 13:40:17.840741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 507/953] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:17 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:17.845828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e2ecbf60-08fd-462a-808f-cc424dd77fd8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:17.846809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e2ecbf60-08fd-462a-808f-cc424dd77fd8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:17.853572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2ecbf60-08fd-462a-808f-cc424dd77fd8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:17.854021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2ecbf60-08fd-462a-808f-cc424dd77fd8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:17.854805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2ecbf60-08fd-462a-808f-cc424dd77fd8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:17.855238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2ecbf60-08fd-462a-808f-cc424dd77fd8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:17.889397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e2ecbf60-08fd-462a-808f-cc424dd77fd8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047540 May 23 13:40:17.890068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 508/954] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:17 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:17.895977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d6662e7-33f1-40d0-8cb2-1e409bfb9c3a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:17.896943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5d6662e7-33f1-40d0-8cb2-1e409bfb9c3a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:17.904343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d6662e7-33f1-40d0-8cb2-1e409bfb9c3a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:17.904821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d6662e7-33f1-40d0-8cb2-1e409bfb9c3a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:17.905603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d6662e7-33f1-40d0-8cb2-1e409bfb9c3a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:17.906095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d6662e7-33f1-40d0-8cb2-1e409bfb9c3a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:17.941511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d6662e7-33f1-40d0-8cb2-1e409bfb9c3a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049898 May 23 13:40:17.942253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 509/955] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:18.858380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-95b3a593-3124-44a4-aeee-bbdadd549747 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:18.859055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-95b3a593-3124-44a4-aeee-bbdadd549747 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:18.866375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95b3a593-3124-44a4-aeee-bbdadd549747 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:18.866827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95b3a593-3124-44a4-aeee-bbdadd549747 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:18.867711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95b3a593-3124-44a4-aeee-bbdadd549747 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:18.868149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95b3a593-3124-44a4-aeee-bbdadd549747 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:19.016865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-95b3a593-3124-44a4-aeee-bbdadd549747 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:19.026454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-95b3a593-3124-44a4-aeee-bbdadd549747 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.171985 May 23 13:40:19.027069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 510/956] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:18 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:19.032083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ccfcc4c3-db9e-410d-93a7-6e372318990a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:19.033056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ccfcc4c3-db9e-410d-93a7-6e372318990a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:19.040412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccfcc4c3-db9e-410d-93a7-6e372318990a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:19.040910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccfcc4c3-db9e-410d-93a7-6e372318990a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:19.041742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccfcc4c3-db9e-410d-93a7-6e372318990a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:19.042190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccfcc4c3-db9e-410d-93a7-6e372318990a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:19.076803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ccfcc4c3-db9e-410d-93a7-6e372318990a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048576 May 23 13:40:19.077400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 511/957] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:19 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:19.082548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97209b6a-9932-4fb1-ae2b-53c8d8218739 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:19.083483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97209b6a-9932-4fb1-ae2b-53c8d8218739 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:19.094862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97209b6a-9932-4fb1-ae2b-53c8d8218739 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:19.095664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97209b6a-9932-4fb1-ae2b-53c8d8218739 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:19.097564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97209b6a-9932-4fb1-ae2b-53c8d8218739 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:19.098093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97209b6a-9932-4fb1-ae2b-53c8d8218739 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:19.143317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97209b6a-9932-4fb1-ae2b-53c8d8218739 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064705 May 23 13:40:19.143944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 512/958] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:19 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:20.051505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8f19e0d3-0a1b-4967-a985-8ae1f8f6a7e8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:20.052322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8f19e0d3-0a1b-4967-a985-8ae1f8f6a7e8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:20.060210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f19e0d3-0a1b-4967-a985-8ae1f8f6a7e8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:20.060710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f19e0d3-0a1b-4967-a985-8ae1f8f6a7e8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:20.061528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f19e0d3-0a1b-4967-a985-8ae1f8f6a7e8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:20.061981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f19e0d3-0a1b-4967-a985-8ae1f8f6a7e8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:20.226854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8f19e0d3-0a1b-4967-a985-8ae1f8f6a7e8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:20.235033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8f19e0d3-0a1b-4967-a985-8ae1f8f6a7e8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.190332 May 23 13:40:20.235644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 513/959] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:20 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:20.240792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-16d4bc51-3f7b-4243-8a41-8f4f248cf250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:20.241735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-16d4bc51-3f7b-4243-8a41-8f4f248cf250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:20.248193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16d4bc51-3f7b-4243-8a41-8f4f248cf250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:20.248736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16d4bc51-3f7b-4243-8a41-8f4f248cf250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:20.249578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16d4bc51-3f7b-4243-8a41-8f4f248cf250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:20.250060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16d4bc51-3f7b-4243-8a41-8f4f248cf250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:20.282828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-16d4bc51-3f7b-4243-8a41-8f4f248cf250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 May 23 13:40:20.283416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 514/960] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:20 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:20.288254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0e27ca4b-66e6-4d65-8d76-7d1c0aee4549 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:20.289783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0e27ca4b-66e6-4d65-8d76-7d1c0aee4549 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:20.296330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e27ca4b-66e6-4d65-8d76-7d1c0aee4549 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:20.296822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e27ca4b-66e6-4d65-8d76-7d1c0aee4549 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:20.297612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e27ca4b-66e6-4d65-8d76-7d1c0aee4549 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:20.298051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e27ca4b-66e6-4d65-8d76-7d1c0aee4549 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:20.330632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0e27ca4b-66e6-4d65-8d76-7d1c0aee4549 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046025 May 23 13:40:20.331152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 515/961] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:21.254441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-501c1f27-ff60-4b5e-9bf6-9ee7d09e11c1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:21.255200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-501c1f27-ff60-4b5e-9bf6-9ee7d09e11c1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:21.262511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-501c1f27-ff60-4b5e-9bf6-9ee7d09e11c1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:21.263128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-501c1f27-ff60-4b5e-9bf6-9ee7d09e11c1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:21.264026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-501c1f27-ff60-4b5e-9bf6-9ee7d09e11c1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:21.264652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-501c1f27-ff60-4b5e-9bf6-9ee7d09e11c1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:21.417359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-501c1f27-ff60-4b5e-9bf6-9ee7d09e11c1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:21.425804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-501c1f27-ff60-4b5e-9bf6-9ee7d09e11c1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.175756 May 23 13:40:21.426548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 516/962] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:21 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:21.436076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7dbcdaac-f2b6-4396-a6a5-f8d18fe27ed3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:21.437691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7dbcdaac-f2b6-4396-a6a5-f8d18fe27ed3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:21.446553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7dbcdaac-f2b6-4396-a6a5-f8d18fe27ed3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:21.447108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7dbcdaac-f2b6-4396-a6a5-f8d18fe27ed3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:21.447994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7dbcdaac-f2b6-4396-a6a5-f8d18fe27ed3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:21.448469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7dbcdaac-f2b6-4396-a6a5-f8d18fe27ed3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:21.482455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7dbcdaac-f2b6-4396-a6a5-f8d18fe27ed3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054373 May 23 13:40:21.483044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 517/963] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:21 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:21.488340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d22651d6-da8a-45ad-9905-0b4c7c60985e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:21.489317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d22651d6-da8a-45ad-9905-0b4c7c60985e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:21.496353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d22651d6-da8a-45ad-9905-0b4c7c60985e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:21.496831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d22651d6-da8a-45ad-9905-0b4c7c60985e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:21.497619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d22651d6-da8a-45ad-9905-0b4c7c60985e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:21.498061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d22651d6-da8a-45ad-9905-0b4c7c60985e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:21.537023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d22651d6-da8a-45ad-9905-0b4c7c60985e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052331 May 23 13:40:21.538110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 518/964] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:21 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:22.451907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2077c088-4e9a-440d-95ab-4d1df3ed16d3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:22.452702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2077c088-4e9a-440d-95ab-4d1df3ed16d3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:22.459675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2077c088-4e9a-440d-95ab-4d1df3ed16d3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:22.460118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2077c088-4e9a-440d-95ab-4d1df3ed16d3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:22.461560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2077c088-4e9a-440d-95ab-4d1df3ed16d3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:22.462284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2077c088-4e9a-440d-95ab-4d1df3ed16d3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:22.619563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2077c088-4e9a-440d-95ab-4d1df3ed16d3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:22.629857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2077c088-4e9a-440d-95ab-4d1df3ed16d3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.181760 May 23 13:40:22.630453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 519/965] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:22 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:22.638631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e9909fb-e798-4ff8-9d54-dd1c7131bc99 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:22.640299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e9909fb-e798-4ff8-9d54-dd1c7131bc99 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:22.650740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e9909fb-e798-4ff8-9d54-dd1c7131bc99 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:22.651351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e9909fb-e798-4ff8-9d54-dd1c7131bc99 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:22.652397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e9909fb-e798-4ff8-9d54-dd1c7131bc99 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:22.653049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e9909fb-e798-4ff8-9d54-dd1c7131bc99 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:22.689724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2e9909fb-e798-4ff8-9d54-dd1c7131bc99 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058048 May 23 13:40:22.690493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 520/966] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:22 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:22.697329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7289ed9-e142-4069-96fc-1316523b26cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:22.698288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7289ed9-e142-4069-96fc-1316523b26cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:22.705122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7289ed9-e142-4069-96fc-1316523b26cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:22.705470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7289ed9-e142-4069-96fc-1316523b26cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:22.706273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7289ed9-e142-4069-96fc-1316523b26cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:22.706726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7289ed9-e142-4069-96fc-1316523b26cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:22.742581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7289ed9-e142-4069-96fc-1316523b26cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050577 May 23 13:40:22.743247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 521/967] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:22 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:23.652871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cd5cca55-c459-4cbc-97da-78680da5925c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:23.653980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cd5cca55-c459-4cbc-97da-78680da5925c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:23.668196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd5cca55-c459-4cbc-97da-78680da5925c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:23.669365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd5cca55-c459-4cbc-97da-78680da5925c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:23.670417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd5cca55-c459-4cbc-97da-78680da5925c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:23.671212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd5cca55-c459-4cbc-97da-78680da5925c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:23.831429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cd5cca55-c459-4cbc-97da-78680da5925c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:23.840481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cd5cca55-c459-4cbc-97da-78680da5925c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.194956 May 23 13:40:23.841125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 522/968] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:23 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:23.846169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-07f771df-332d-492c-92b1-c69506f79225 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:23.848010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-07f771df-332d-492c-92b1-c69506f79225 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:23.854279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07f771df-332d-492c-92b1-c69506f79225 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:23.854740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07f771df-332d-492c-92b1-c69506f79225 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:23.855540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07f771df-332d-492c-92b1-c69506f79225 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:23.855986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07f771df-332d-492c-92b1-c69506f79225 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:23.875807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:23.890606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-07f771df-332d-492c-92b1-c69506f79225 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048370 May 23 13:40:23.893860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 523/969] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:23 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:23.896867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f759b12c-e687-4f3c-94f9-8e54d5fa7b15 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:23.897873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f759b12c-e687-4f3c-94f9-8e54d5fa7b15 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:23.905019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f759b12c-e687-4f3c-94f9-8e54d5fa7b15 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:23.905386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f759b12c-e687-4f3c-94f9-8e54d5fa7b15 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:23.906177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f759b12c-e687-4f3c-94f9-8e54d5fa7b15 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:23.906615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f759b12c-e687-4f3c-94f9-8e54d5fa7b15 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:23.940355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f759b12c-e687-4f3c-94f9-8e54d5fa7b15 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048023 May 23 13:40:23.941074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 524/970] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:24.860188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e378079a-57a3-414e-8ad4-7fc373791ac0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:24.860950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e378079a-57a3-414e-8ad4-7fc373791ac0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:24.869462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e378079a-57a3-414e-8ad4-7fc373791ac0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:24.870276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e378079a-57a3-414e-8ad4-7fc373791ac0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:24.872042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e378079a-57a3-414e-8ad4-7fc373791ac0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:24.872866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e378079a-57a3-414e-8ad4-7fc373791ac0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:25.057632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e378079a-57a3-414e-8ad4-7fc373791ac0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:25.078024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e378079a-57a3-414e-8ad4-7fc373791ac0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.221286 May 23 13:40:25.079416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 525/971] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:24 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:25.089166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-89d88ee7-a7a2-4004-88a1-86085ecceb48 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:25.090838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-89d88ee7-a7a2-4004-88a1-86085ecceb48 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:25.103326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89d88ee7-a7a2-4004-88a1-86085ecceb48 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:25.104135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89d88ee7-a7a2-4004-88a1-86085ecceb48 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:25.105928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89d88ee7-a7a2-4004-88a1-86085ecceb48 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:25.106740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89d88ee7-a7a2-4004-88a1-86085ecceb48 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:25.150587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-89d88ee7-a7a2-4004-88a1-86085ecceb48 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069283 May 23 13:40:25.151282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 526/972] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:25 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:25.159083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e924d6e-da87-47ee-8b87-6dda17b0d9fd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:25.160200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e924d6e-da87-47ee-8b87-6dda17b0d9fd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:25.167425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e924d6e-da87-47ee-8b87-6dda17b0d9fd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:25.167928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e924d6e-da87-47ee-8b87-6dda17b0d9fd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:25.168864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e924d6e-da87-47ee-8b87-6dda17b0d9fd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:25.169394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e924d6e-da87-47ee-8b87-6dda17b0d9fd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:25.230032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e924d6e-da87-47ee-8b87-6dda17b0d9fd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076411 May 23 13:40:25.230587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 527/973] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:26.098531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-00758bb7-43a9-4cd2-83f3-25bce7263bf2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:26.099592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-00758bb7-43a9-4cd2-83f3-25bce7263bf2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:26.107501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00758bb7-43a9-4cd2-83f3-25bce7263bf2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:26.108165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00758bb7-43a9-4cd2-83f3-25bce7263bf2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:26.109195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00758bb7-43a9-4cd2-83f3-25bce7263bf2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:26.109747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00758bb7-43a9-4cd2-83f3-25bce7263bf2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:26.274984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-00758bb7-43a9-4cd2-83f3-25bce7263bf2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:26.283253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-00758bb7-43a9-4cd2-83f3-25bce7263bf2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.189196 May 23 13:40:26.283849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 528/974] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:26 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:26.289408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c220f418-8127-4b2e-b899-e18104c47951 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:26.290708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c220f418-8127-4b2e-b899-e18104c47951 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:26.297315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c220f418-8127-4b2e-b899-e18104c47951 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:26.297775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c220f418-8127-4b2e-b899-e18104c47951 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:26.298573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c220f418-8127-4b2e-b899-e18104c47951 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:26.299018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c220f418-8127-4b2e-b899-e18104c47951 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:26.332601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c220f418-8127-4b2e-b899-e18104c47951 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047526 May 23 13:40:26.333128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 529/975] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:26 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:26.338442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bae7f2a6-ea6e-4360-bb5e-fffe9ec23b48 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:26.339381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bae7f2a6-ea6e-4360-bb5e-fffe9ec23b48 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:26.345898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bae7f2a6-ea6e-4360-bb5e-fffe9ec23b48 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:26.346354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bae7f2a6-ea6e-4360-bb5e-fffe9ec23b48 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:26.347149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bae7f2a6-ea6e-4360-bb5e-fffe9ec23b48 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:26.347589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bae7f2a6-ea6e-4360-bb5e-fffe9ec23b48 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:26.381135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bae7f2a6-ea6e-4360-bb5e-fffe9ec23b48 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046884 May 23 13:40:26.381734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 530/976] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:27.302644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6edcf569-2c38-45f7-b7d5-140407b5dc24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:27.303456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6edcf569-2c38-45f7-b7d5-140407b5dc24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:27.311823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6edcf569-2c38-45f7-b7d5-140407b5dc24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:27.312285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6edcf569-2c38-45f7-b7d5-140407b5dc24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:27.313129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6edcf569-2c38-45f7-b7d5-140407b5dc24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:27.313575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6edcf569-2c38-45f7-b7d5-140407b5dc24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:27.464521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6edcf569-2c38-45f7-b7d5-140407b5dc24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:27.477690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6edcf569-2c38-45f7-b7d5-140407b5dc24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.179020 May 23 13:40:27.478303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 531/977] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:27 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:27.483245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4349f262-d1ef-46b9-b684-1918a9c2846d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:27.484176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4349f262-d1ef-46b9-b684-1918a9c2846d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:27.490868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4349f262-d1ef-46b9-b684-1918a9c2846d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:27.491307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4349f262-d1ef-46b9-b684-1918a9c2846d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:27.492155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4349f262-d1ef-46b9-b684-1918a9c2846d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:27.492608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4349f262-d1ef-46b9-b684-1918a9c2846d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:27.526482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4349f262-d1ef-46b9-b684-1918a9c2846d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047052 May 23 13:40:27.527079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 532/978] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:27 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:27.531925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-400ab317-b12d-41d7-861f-b1487a80d9d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:27.532868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-400ab317-b12d-41d7-861f-b1487a80d9d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:27.540226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-400ab317-b12d-41d7-861f-b1487a80d9d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:27.540774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-400ab317-b12d-41d7-861f-b1487a80d9d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:27.541696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-400ab317-b12d-41d7-861f-b1487a80d9d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:27.542213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-400ab317-b12d-41d7-861f-b1487a80d9d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:27.575171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-400ab317-b12d-41d7-861f-b1487a80d9d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046979 May 23 13:40:27.576101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 533/979] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:28.497702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-19c4d2fc-9304-4bf0-8499-b95337e98421 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:28.498671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-19c4d2fc-9304-4bf0-8499-b95337e98421 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:28.506105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19c4d2fc-9304-4bf0-8499-b95337e98421 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:28.506572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19c4d2fc-9304-4bf0-8499-b95337e98421 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:28.507373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19c4d2fc-9304-4bf0-8499-b95337e98421 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:28.507809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19c4d2fc-9304-4bf0-8499-b95337e98421 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:28.677628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-19c4d2fc-9304-4bf0-8499-b95337e98421 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:28.686289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-19c4d2fc-9304-4bf0-8499-b95337e98421 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.192763 May 23 13:40:28.691239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 534/980] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:28 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:28.691892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c573eec-2863-4d94-b786-6b3cd5ed4c15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:28.692895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8c573eec-2863-4d94-b786-6b3cd5ed4c15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:28.700219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c573eec-2863-4d94-b786-6b3cd5ed4c15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:28.700706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c573eec-2863-4d94-b786-6b3cd5ed4c15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:28.701514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c573eec-2863-4d94-b786-6b3cd5ed4c15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:28.701954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c573eec-2863-4d94-b786-6b3cd5ed4c15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:28.737848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8c573eec-2863-4d94-b786-6b3cd5ed4c15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049814 May 23 13:40:28.738421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 535/981] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:28 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:28.743867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8532d369-3485-4996-9c3d-3a0e7a8d3f3d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:28.744976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8532d369-3485-4996-9c3d-3a0e7a8d3f3d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:28.747037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:28.754679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8532d369-3485-4996-9c3d-3a0e7a8d3f3d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:28.755134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8532d369-3485-4996-9c3d-3a0e7a8d3f3d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:28.755952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8532d369-3485-4996-9c3d-3a0e7a8d3f3d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:28.756394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8532d369-3485-4996-9c3d-3a0e7a8d3f3d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:28.801988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8532d369-3485-4996-9c3d-3a0e7a8d3f3d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062039 May 23 13:40:28.803162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 536/982] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:28 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:29.705818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf8425ea-0553-4148-b08d-cd15f5cd8500 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:29.706559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf8425ea-0553-4148-b08d-cd15f5cd8500 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:29.715350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf8425ea-0553-4148-b08d-cd15f5cd8500 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:29.715812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf8425ea-0553-4148-b08d-cd15f5cd8500 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:29.716646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf8425ea-0553-4148-b08d-cd15f5cd8500 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:29.717098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf8425ea-0553-4148-b08d-cd15f5cd8500 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:29.904998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf8425ea-0553-4148-b08d-cd15f5cd8500 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:40:29.927967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf8425ea-0553-4148-b08d-cd15f5cd8500 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.211819 May 23 13:40:29.927967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 537/983] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:40:29 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:40:29.927967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9b11bb86-cf3d-4c16-b511-bbae5bd109ca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:29.927967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9b11bb86-cf3d-4c16-b511-bbae5bd109ca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:29.931587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b11bb86-cf3d-4c16-b511-bbae5bd109ca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:29.932137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b11bb86-cf3d-4c16-b511-bbae5bd109ca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:29.933056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b11bb86-cf3d-4c16-b511-bbae5bd109ca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:29.933514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b11bb86-cf3d-4c16-b511-bbae5bd109ca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:29.973822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9b11bb86-cf3d-4c16-b511-bbae5bd109ca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057927 May 23 13:40:29.975041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 538/984] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:40:29 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:40:29.981735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b98fac4d-d617-4de9-8072-4bf7fbf0a2c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:29.983356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b98fac4d-d617-4de9-8072-4bf7fbf0a2c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:29.992765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98fac4d-d617-4de9-8072-4bf7fbf0a2c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:29.993317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98fac4d-d617-4de9-8072-4bf7fbf0a2c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:29.994194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98fac4d-d617-4de9-8072-4bf7fbf0a2c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:29.994898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98fac4d-d617-4de9-8072-4bf7fbf0a2c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:30.035373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b98fac4d-d617-4de9-8072-4bf7fbf0a2c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058815 May 23 13:40:30.036363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 539/985] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:40:29 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:40:30.120116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-0a092fe1-fa91-4a8f-bd45-17ffb8924cfc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:40:30.189806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9084b83-5509-4178-834b-13264f2f6eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:40:30.189806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9084b83-5509-4178-834b-13264f2f6eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:40:30.195457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9084b83-5509-4178-834b-13264f2f6eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:30.196080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9084b83-5509-4178-834b-13264f2f6eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:30.196918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9084b83-5509-4178-834b-13264f2f6eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:40:30.197357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9084b83-5509-4178-834b-13264f2f6eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:40:30.202157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:40.126073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:40.190378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=9 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:40:40.242441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:41:42.450682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:41:42.451312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:41:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb (ip 10.222.0.70) !!! May 23 13:41:44.540637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0a092fe1-fa91-4a8f-bd45-17ffb8924cfc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 202 len: 0 microversion: 2.1 time: 106.098010 May 23 13:41:44.540637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 447/986] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:39:58 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 0 bytes in 106100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:41:44.542431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d3bef4d-096c-4485-94af-2a2fe6ea2159 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:41:44.543158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d3bef4d-096c-4485-94af-2a2fe6ea2159 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:41:44.550460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d3bef4d-096c-4485-94af-2a2fe6ea2159 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:41:44.551589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d3bef4d-096c-4485-94af-2a2fe6ea2159 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:41:44.552864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d3bef4d-096c-4485-94af-2a2fe6ea2159 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:41:44.553624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d3bef4d-096c-4485-94af-2a2fe6ea2159 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:41:44.567467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-b9084b83-5509-4178-834b-13264f2f6eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:41:44.720476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d3bef4d-096c-4485-94af-2a2fe6ea2159 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:41:44.731892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d3bef4d-096c-4485-94af-2a2fe6ea2159 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.195287 May 23 13:41:44.732918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 448/987] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:41:44 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:41:44.743426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-91d74501-b62b-4666-81e3-ef2422e1481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:41:44.745333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-91d74501-b62b-4666-81e3-ef2422e1481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:41:44.758560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91d74501-b62b-4666-81e3-ef2422e1481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:41:44.759097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91d74501-b62b-4666-81e3-ef2422e1481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:41:44.760955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91d74501-b62b-4666-81e3-ef2422e1481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:41:44.761578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91d74501-b62b-4666-81e3-ef2422e1481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:41:44.798301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-91d74501-b62b-4666-81e3-ef2422e1481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063773 May 23 13:41:44.799069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 449/988] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:41:44 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:41:44.804360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-219695ca-0af9-4cac-ad8a-7453698705f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:41:44.805326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-219695ca-0af9-4cac-ad8a-7453698705f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:41:44.811740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-219695ca-0af9-4cac-ad8a-7453698705f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:41:44.812183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-219695ca-0af9-4cac-ad8a-7453698705f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:41:44.813017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-219695ca-0af9-4cac-ad8a-7453698705f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:41:44.813445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-219695ca-0af9-4cac-ad8a-7453698705f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:41:44.854541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-219695ca-0af9-4cac-ad8a-7453698705f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052197 May 23 13:41:44.854541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 450/989] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:41:44 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:41:44.862222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:41:44.862826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:41:44.870892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:41:44.871447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:41:44.872614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:41:44.873217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:41:52.447330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:41:52.448026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb (ip 10.222.0.70) !!! May 23 13:41:54.578163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:41:54.867994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:41:54.895020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:41:56.823069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:41:56.823680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:42:03.454023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:42:03.454742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:42:09.739141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:42:09.739980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:42:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:42:30.533207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:42:30.571610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9084b83-5509-4178-834b-13264f2f6eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 202 len: 0 microversion: 2.1 time: 120.392767 May 23 13:42:30.584960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 540/990] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:40:30 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 0 bytes in 120395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 13:42:30.584960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:42:30.586991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:42:30.595135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:42:30.595909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:42:30.596867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:42:30.597317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:42:40.540664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:42:40.595860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:42:40.618456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:43:45.068960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c19edea6-8380-43cd-938e-2f1e0d4abe62) May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:43:45.074047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:43:45.077045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c19edea6-8380-43cd-938e-2f1e0d4abe62) May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:43:45.078884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c19edea6-8380-43cd-938e-2f1e0d4abe62) May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:43:45.081275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c19edea6-8380-43cd-938e-2f1e0d4abe62) May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:43:45.083498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c19edea6-8380-43cd-938e-2f1e0d4abe62) May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:43:45.086181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c19edea6-8380-43cd-938e-2f1e0d4abe62) May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c19edea6-8380-43cd-938e-2f1e0d4abe62) May 23 13:43:45.088625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:43:45.090826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c19edea6-8380-43cd-938e-2f1e0d4abe62) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:43:45.090826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9180d67c-3a72-4ff3-b1fc-78cbc9dac1ad tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 120.221354 May 23 13:43:45.090826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 451/991] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:41:44 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 120223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:43:45.090826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af677329-6431-4ad4-94e9-04afbab6ccc9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:43:45.091874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-af677329-6431-4ad4-94e9-04afbab6ccc9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:43:45.100164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af677329-6431-4ad4-94e9-04afbab6ccc9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:43:45.108398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af677329-6431-4ad4-94e9-04afbab6ccc9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:43:45.109930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af677329-6431-4ad4-94e9-04afbab6ccc9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:43:45.110371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af677329-6431-4ad4-94e9-04afbab6ccc9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:43:45.151732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:43:45.320788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af677329-6431-4ad4-94e9-04afbab6ccc9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:43:45.335877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-af677329-6431-4ad4-94e9-04afbab6ccc9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.256394 May 23 13:43:45.337128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 452/992] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:43:45 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:43:45.346875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0910fb72-75f9-4603-aff0-5f8f99224edd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:43:45.348514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0910fb72-75f9-4603-aff0-5f8f99224edd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:43:45.357984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0910fb72-75f9-4603-aff0-5f8f99224edd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:43:45.358668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0910fb72-75f9-4603-aff0-5f8f99224edd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:43:45.359764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0910fb72-75f9-4603-aff0-5f8f99224edd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:43:45.360399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0910fb72-75f9-4603-aff0-5f8f99224edd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:43:45.395110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0910fb72-75f9-4603-aff0-5f8f99224edd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055787 May 23 13:43:45.395703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 453/993] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:43:45 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:43:45.531383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8cdd9f86-a66f-4458-abdd-c42c7927869c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:43:45.532529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8cdd9f86-a66f-4458-abdd-c42c7927869c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:43:45.542481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cdd9f86-a66f-4458-abdd-c42c7927869c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:43:45.543295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cdd9f86-a66f-4458-abdd-c42c7927869c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:43:45.544822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cdd9f86-a66f-4458-abdd-c42c7927869c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:43:45.545388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cdd9f86-a66f-4458-abdd-c42c7927869c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:43:45.591678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8cdd9f86-a66f-4458-abdd-c42c7927869c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.194493 May 23 13:43:45.592989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 454/994] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:43:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:43:45.601174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:43:45.602242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:43:45.613813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:43:45.614471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:43:45.615777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:43:45.616494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:43:55.167999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:43:55.608722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:43:55.647698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=22 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:44:30.808486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a624c065-dffd-431d-8936-887af7651ec4) May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:44:30.811022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:44:30.812441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a624c065-dffd-431d-8936-887af7651ec4) May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:44:30.813972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a624c065-dffd-431d-8936-887af7651ec4) May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:44:30.815814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a624c065-dffd-431d-8936-887af7651ec4) May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:44:30.818167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a624c065-dffd-431d-8936-887af7651ec4) May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:44:30.821162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a624c065-dffd-431d-8936-887af7651ec4) May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a624c065-dffd-431d-8936-887af7651ec4) May 23 13:44:30.822431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:44:30.825259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a624c065-dffd-431d-8936-887af7651ec4) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:44:30.825259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d271e5f-7c56-4113-9787-99ab9f6c81a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 400 len: 269 microversion: 2.1 time: 120.239137 May 23 13:44:30.825259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 541/995] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:42:30 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 269 bytes in 120241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:44:30.825259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:44:30.825861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:44:30.831958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:44:30.832414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:44:30.833237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:44:30.833808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:44:30.882954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:44:40.829163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:44:40.862873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:44:40.888110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:45:02.460019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:45:02.460859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:45:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb (ip 10.222.0.70) !!! May 23 13:45:12.456866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:45:12.457526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:45:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb (ip 10.222.0.70) !!! May 23 13:45:16.832868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:45:16.833553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:45:23.463494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:45:23.464181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:45:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:45:29.748067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:45:29.748917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:45:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:45:45.788243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:45:45.923660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e3a0226-b781-45c2-b9e6-f049ac9026ad) May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:45:45.925882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:45:45.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e3a0226-b781-45c2-b9e6-f049ac9026ad) May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:45:45.933007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e3a0226-b781-45c2-b9e6-f049ac9026ad) May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:45:45.935298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e3a0226-b781-45c2-b9e6-f049ac9026ad) May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:45:45.938252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e3a0226-b781-45c2-b9e6-f049ac9026ad) May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:45:45.940706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e3a0226-b781-45c2-b9e6-f049ac9026ad) May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e3a0226-b781-45c2-b9e6-f049ac9026ad) May 23 13:45:45.943183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:45:45.947038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e3a0226-b781-45c2-b9e6-f049ac9026ad) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:45:45.947038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8f26e6f-c78e-495d-ba96-79cb8a36846c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 120.333371 May 23 13:45:45.947038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 455/996] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:43:45 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 120335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:45:46.044069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-910180b1-a8ce-4c6e-9b85-7eb6930842c0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:45:46.044716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-910180b1-a8ce-4c6e-9b85-7eb6930842c0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:45:46.051022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-910180b1-a8ce-4c6e-9b85-7eb6930842c0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:45:46.051532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-910180b1-a8ce-4c6e-9b85-7eb6930842c0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:45:46.052361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-910180b1-a8ce-4c6e-9b85-7eb6930842c0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:45:46.052830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-910180b1-a8ce-4c6e-9b85-7eb6930842c0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:45:46.196731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-910180b1-a8ce-4c6e-9b85-7eb6930842c0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:45:46.204330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-910180b1-a8ce-4c6e-9b85-7eb6930842c0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.274665 May 23 13:45:46.207671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 456/997] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:45:45 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:45:46.293767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8187dfe-0fd3-4871-bc79-b22a72495be2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:45:46.293767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8187dfe-0fd3-4871-bc79-b22a72495be2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:45:46.303842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8187dfe-0fd3-4871-bc79-b22a72495be2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:45:46.304600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8187dfe-0fd3-4871-bc79-b22a72495be2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:45:46.307784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8187dfe-0fd3-4871-bc79-b22a72495be2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:45:46.308619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8187dfe-0fd3-4871-bc79-b22a72495be2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:45:46.373841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8187dfe-0fd3-4871-bc79-b22a72495be2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167676 May 23 13:45:46.383717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 457/998] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:45:46 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:45:46.383717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-82345716-4caf-44b1-804e-e87c3d4a27e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:45:46.383717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-82345716-4caf-44b1-804e-e87c3d4a27e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:45:46.388396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82345716-4caf-44b1-804e-e87c3d4a27e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:45:46.388945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82345716-4caf-44b1-804e-e87c3d4a27e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:45:46.389723 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82345716-4caf-44b1-804e-e87c3d4a27e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:45:46.390155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82345716-4caf-44b1-804e-e87c3d4a27e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:45:46.420546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-82345716-4caf-44b1-804e-e87c3d4a27e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044492 May 23 13:45:46.421143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 458/999] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:45:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:45:46.425732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:45:46.426224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:45:46.433077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:45:46.433526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:45:46.434308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:45:46.434743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:45:55.793855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:45:56.431202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:45:56.453924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=22 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f40d273b-a341-49c4-967c-18a7808b729c) May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:46:31.077019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:46:31.079849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f40d273b-a341-49c4-967c-18a7808b729c) May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:46:31.081481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f40d273b-a341-49c4-967c-18a7808b729c) May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:46:31.083987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f40d273b-a341-49c4-967c-18a7808b729c) May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:46:31.090219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f40d273b-a341-49c4-967c-18a7808b729c) May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:46:31.092184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f40d273b-a341-49c4-967c-18a7808b729c) May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f40d273b-a341-49c4-967c-18a7808b729c) May 23 13:46:31.094222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:46:31.096087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f40d273b-a341-49c4-967c-18a7808b729c) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:46:31.096087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49c9ffd7-bf34-4b76-9885-326d7e70e4f7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 400 len: 269 microversion: 2.1 time: 120.272129 May 23 13:46:31.096087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 542/1000] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:44:30 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 269 bytes in 120273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:46:31.103094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:46:31.103609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:46:31.110705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:46:31.111158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:46:31.111972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:46:31.112417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:46:31.147100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:46:41.107187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:46:41.138776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:46:41.153789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:47:23.789310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:47:23.789982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:47:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb (ip 10.222.0.70) !!! May 23 13:47:46.675784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:47:46.758981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fd2510-4d8f-4e08-832f-fcca74017279) May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:47:46.761191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:47:46.763913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fd2510-4d8f-4e08-832f-fcca74017279) May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:47:46.765825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fd2510-4d8f-4e08-832f-fcca74017279) May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:47:46.768320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fd2510-4d8f-4e08-832f-fcca74017279) May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:47:46.771177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fd2510-4d8f-4e08-832f-fcca74017279) May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:47:46.773469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fd2510-4d8f-4e08-832f-fcca74017279) May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fd2510-4d8f-4e08-832f-fcca74017279) May 23 13:47:46.776180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:47:46.785392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fd2510-4d8f-4e08-832f-fcca74017279) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:47:46.785392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-15d9f191-5fa6-416b-9b51-162028ab2390 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 120.340543 May 23 13:47:46.785392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 459/1001] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:45:46 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 120342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:47:46.785392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d19ef14-1264-41aa-8782-c3602b922eeb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:47:46.786041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d19ef14-1264-41aa-8782-c3602b922eeb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:47:46.786041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d19ef14-1264-41aa-8782-c3602b922eeb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:47:46.786041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d19ef14-1264-41aa-8782-c3602b922eeb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:47:46.786041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d19ef14-1264-41aa-8782-c3602b922eeb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:47:46.786440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d19ef14-1264-41aa-8782-c3602b922eeb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:47:46.946217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d19ef14-1264-41aa-8782-c3602b922eeb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:47:46.960150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d19ef14-1264-41aa-8782-c3602b922eeb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.192405 May 23 13:47:46.961009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 460/1002] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:47:46 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:47:46.966887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2f5ff010-9f9c-4ef4-b8ab-6f5cdf1fef54 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:47:46.967872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2f5ff010-9f9c-4ef4-b8ab-6f5cdf1fef54 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:47:46.975329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f5ff010-9f9c-4ef4-b8ab-6f5cdf1fef54 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:47:46.975769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f5ff010-9f9c-4ef4-b8ab-6f5cdf1fef54 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:47:46.976552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f5ff010-9f9c-4ef4-b8ab-6f5cdf1fef54 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:47:46.977013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f5ff010-9f9c-4ef4-b8ab-6f5cdf1fef54 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:47:47.010225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2f5ff010-9f9c-4ef4-b8ab-6f5cdf1fef54 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047931 May 23 13:47:47.010729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 461/1003] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:47:46 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:47:47.015522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-29be95a2-1bad-4f27-9818-34fb860ad41a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:47:47.017000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-29be95a2-1bad-4f27-9818-34fb860ad41a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:47:47.023410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29be95a2-1bad-4f27-9818-34fb860ad41a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:47:47.023867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29be95a2-1bad-4f27-9818-34fb860ad41a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:47:47.024685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29be95a2-1bad-4f27-9818-34fb860ad41a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:47:47.025129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29be95a2-1bad-4f27-9818-34fb860ad41a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:47:47.058439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-29be95a2-1bad-4f27-9818-34fb860ad41a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046625 May 23 13:47:47.060868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 462/1004] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:47:47 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:47:47.063679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-792a4a58-e095-480f-b426-e97c6be4838e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:47:47.064172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-792a4a58-e095-480f-b426-e97c6be4838e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:47:47.070373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-792a4a58-e095-480f-b426-e97c6be4838e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:47:47.070869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-792a4a58-e095-480f-b426-e97c6be4838e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:47:47.071610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-792a4a58-e095-480f-b426-e97c6be4838e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:47:47.072054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-792a4a58-e095-480f-b426-e97c6be4838e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:47:56.681070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:47:57.068086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:47:57.102751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=22 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:48:22.470418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:48:22.471217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:48:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 (ip 10.222.0.70) !!! May 23 13:48:32.031582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e7a7f65-e769-4966-ad11-bcc0783d4315) May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:48:32.034052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:48:32.037485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e7a7f65-e769-4966-ad11-bcc0783d4315) May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.039369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e7a7f65-e769-4966-ad11-bcc0783d4315) May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.041142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e7a7f65-e769-4966-ad11-bcc0783d4315) May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.043455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e7a7f65-e769-4966-ad11-bcc0783d4315) May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.044839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e7a7f65-e769-4966-ad11-bcc0783d4315) May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e7a7f65-e769-4966-ad11-bcc0783d4315) May 23 13:48:32.046287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.047942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e7a7f65-e769-4966-ad11-bcc0783d4315) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:48:32.047942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 400 len: 269 microversion: 2.1 time: 120.946986 May 23 13:48:32.047942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:48:32.047942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:48:32 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (10.222.0.70) May 23 13:48:32.047942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: CRITICAL nova [None req-65322f7a-f8bd-42f9-a528-aae7f59d2809 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Unhandled error: OSError: write error May 23 13:48:32.047942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova OSError: write error May 23 13:48:32.047942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova May 23 13:48:32.048747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 543/1005] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:46:31 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 0 bytes in 120949 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) May 23 13:48:32.048747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:32.048747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:32.053996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.056767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.056767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.056767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.089896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-792a4a58-e095-480f-b426-e97c6be4838e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'services' on Instance uuid 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:48:32.179262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:48:32.348027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e1a69b8-679c-4df5-b842-57eb8ad39be6) May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:48:32.350014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:48:32.351714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e1a69b8-679c-4df5-b842-57eb8ad39be6) May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.352468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e1a69b8-679c-4df5-b842-57eb8ad39be6) May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.353730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e1a69b8-679c-4df5-b842-57eb8ad39be6) May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.355134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e1a69b8-679c-4df5-b842-57eb8ad39be6) May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.357422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e1a69b8-679c-4df5-b842-57eb8ad39be6) May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e1a69b8-679c-4df5-b842-57eb8ad39be6) May 23 13:48:32.359384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.361288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e1a69b8-679c-4df5-b842-57eb8ad39be6) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:48:32.361288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9af221dc-f504-4aec-9126-1157f8643272 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 0.312953 May 23 13:48:32.361288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 544/1006] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:48:32 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 314 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:48:32.361288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:32.361871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:32.363665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.364121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.364942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.365391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.374581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-792a4a58-e095-480f-b426-e97c6be4838e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737" status: 202 len: 0 microversion: 2.1 time: 45.314099 May 23 13:48:32.378938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 463/1007] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:47:47 2022] DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 => generated 0 bytes in 45316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:48:32.381170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-22562c69-3e90-45b1-a600-361354d9b009 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:32.381881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-22562c69-3e90-45b1-a600-361354d9b009 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:32.390215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22562c69-3e90-45b1-a600-361354d9b009 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.390696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22562c69-3e90-45b1-a600-361354d9b009 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.391507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22562c69-3e90-45b1-a600-361354d9b009 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.391951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22562c69-3e90-45b1-a600-361354d9b009 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.466638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:48:32.466852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 (ip 10.222.0.70) !!! May 23 13:48:32.477125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:48:32.540504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e98ddaf3-28a2-46dd-8e1d-2a9435211422) May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:48:32.543020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:48:32.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e98ddaf3-28a2-46dd-8e1d-2a9435211422) May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.546898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e98ddaf3-28a2-46dd-8e1d-2a9435211422) May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.548172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e98ddaf3-28a2-46dd-8e1d-2a9435211422) May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.554696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e98ddaf3-28a2-46dd-8e1d-2a9435211422) May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.556102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e98ddaf3-28a2-46dd-8e1d-2a9435211422) May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e98ddaf3-28a2-46dd-8e1d-2a9435211422) May 23 13:48:32.557447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.558998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e98ddaf3-28a2-46dd-8e1d-2a9435211422) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:48:32.558998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65b5bef6-8984-41e7-9db0-0a0538b65f13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 400 len: 269 microversion: 2.1 time: 0.191950 May 23 13:48:32.558998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 545/1008] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:48:32 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 269 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:48:32.559338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22562c69-3e90-45b1-a600-361354d9b009 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:48:32.559467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f3caf9fe-4751-43bb-8291-8e89e75c05ea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:32.559467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f3caf9fe-4751-43bb-8291-8e89e75c05ea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:32.559654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-22562c69-3e90-45b1-a600-361354d9b009 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.177695 May 23 13:48:32.559654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 464/1009] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:48:32 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:48:32.561250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3caf9fe-4751-43bb-8291-8e89e75c05ea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.561787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3caf9fe-4751-43bb-8291-8e89e75c05ea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.562672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3caf9fe-4751-43bb-8291-8e89e75c05ea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.563179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3caf9fe-4751-43bb-8291-8e89e75c05ea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.563498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e68b843-00ed-4ae3-979d-153363a255f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:32.564682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e68b843-00ed-4ae3-979d-153363a255f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:32.571060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e68b843-00ed-4ae3-979d-153363a255f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.571484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e68b843-00ed-4ae3-979d-153363a255f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.572278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e68b843-00ed-4ae3-979d-153363a255f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.572816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e68b843-00ed-4ae3-979d-153363a255f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.598745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f3caf9fe-4751-43bb-8291-8e89e75c05ea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052569 May 23 13:48:32.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 546/1010] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:48:32 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:48:32.604035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:32.604532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:32.608680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e68b843-00ed-4ae3-979d-153363a255f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052366 May 23 13:48:32.609401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 465/1011] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:48:32 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:48:32.611437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.611883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.612688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.613126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.614275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:32.614768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:32.620915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.621389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.622153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.622585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.714722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'services' on Instance uuid 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:48:32.767877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:48:32.803846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40cc0fd9-9682-40ef-8670-23a570c1f28a) May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Request method failure captured: May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 HTTP/1.1 May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii40vd-P_YQXvsLwcStOUniM2vkJyRg_9f4ypUf1NkkYBUuBYj2FbSHcSv09Y9UyJFDGDsNJcps9rLkf-R9JngusICk7Pshxpnmguo79u6cuDaKW3P7O5Kr8RUgShdV8NPhuCdPEBp1AigrrZ-EzRROO12MbsaMVt6LTwkGHqvChOO6M May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:48:32.806044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}] May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 659caf32fa614f64bcd780a264674e33 May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:48:32.808053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40cc0fd9-9682-40ef-8670-23a570c1f28a) May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '72d8069e-32b9-4e3b-aabc-a8bf5bd66c55', 'id': '4d44b192-0fb0-44fe-8b5d-58f1d30f9737'} May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.810185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40cc0fd9-9682-40ef-8670-23a570c1f28a) May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.814358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40cc0fd9-9682-40ef-8670-23a570c1f28a) May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.817001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40cc0fd9-9682-40ef-8670-23a570c1f28a) May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.820237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40cc0fd9-9682-40ef-8670-23a570c1f28a) May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40cc0fd9-9682-40ef-8670-23a570c1f28a) May 23 13:48:32.824060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:48:32.826620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40cc0fd9-9682-40ef-8670-23a570c1f28a) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:48:32.826620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-04fc41c9-4ee0-4ae1-b5fe-42096fa073e6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737" status: 400 len: 269 microversion: 2.1 time: 0.207275 May 23 13:48:32.826620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 547/1012] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:48:32 2022] DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 => generated 269 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:48:32.826620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:32.828132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:32.828132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.828132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.828132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.829520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.853714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56e6fe1a-617b-43db-8c35-1f9b8dfd7ecb) May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:48:32.859435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:48:32.860888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56e6fe1a-617b-43db-8c35-1f9b8dfd7ecb) May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.861623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56e6fe1a-617b-43db-8c35-1f9b8dfd7ecb) May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:48:32.862976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56e6fe1a-617b-43db-8c35-1f9b8dfd7ecb) May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.864641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56e6fe1a-617b-43db-8c35-1f9b8dfd7ecb) May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.865895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56e6fe1a-617b-43db-8c35-1f9b8dfd7ecb) May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56e6fe1a-617b-43db-8c35-1f9b8dfd7ecb) May 23 13:48:32.867162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:48:32.868377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56e6fe1a-617b-43db-8c35-1f9b8dfd7ecb) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:48:32.868377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-28133254-dfca-4df1-957c-bdbeaf70e2ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 0.251800 May 23 13:48:32.868377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 466/1013] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:48:32 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:48:32.871866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-367e33a5-ade6-41af-a030-955f873909e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:32.873623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-367e33a5-ade6-41af-a030-955f873909e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:32.884520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-367e33a5-ade6-41af-a030-955f873909e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.885319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-367e33a5-ade6-41af-a030-955f873909e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.886640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-367e33a5-ade6-41af-a030-955f873909e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:32.887355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-367e33a5-ade6-41af-a030-955f873909e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:32.918527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:48:33.099172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-367e33a5-ade6-41af-a030-955f873909e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:48:33.099172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-367e33a5-ade6-41af-a030-955f873909e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.220576 May 23 13:48:33.099172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 467/1014] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:48:32 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:48:33.099172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d1f4c25-8a49-40e9-a23b-c5039ebf43f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:33.101192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d1f4c25-8a49-40e9-a23b-c5039ebf43f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:33.101192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d1f4c25-8a49-40e9-a23b-c5039ebf43f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:33.101192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d1f4c25-8a49-40e9-a23b-c5039ebf43f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:33.101192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d1f4c25-8a49-40e9-a23b-c5039ebf43f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:33.101749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d1f4c25-8a49-40e9-a23b-c5039ebf43f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:33.135368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d1f4c25-8a49-40e9-a23b-c5039ebf43f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047673 May 23 13:48:33.136436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 468/1015] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:48:33 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:48:33.152629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6fad89af-b9c1-4b04-a2c5-a7556045f1d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:33.153612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6fad89af-b9c1-4b04-a2c5-a7556045f1d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:33.160245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fad89af-b9c1-4b04-a2c5-a7556045f1d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:33.160725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fad89af-b9c1-4b04-a2c5-a7556045f1d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:33.161564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fad89af-b9c1-4b04-a2c5-a7556045f1d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:33.161999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fad89af-b9c1-4b04-a2c5-a7556045f1d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:33.194952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6fad89af-b9c1-4b04-a2c5-a7556045f1d1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048889 May 23 13:48:33.195538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 469/1016] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:48:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:48:33.200359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:48:33.200973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:48:33.209988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:33.210543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:33.211364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:48:33.211795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:48:36.844683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:48:36.845423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:48:42.820925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:48:42.924647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=38 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:48:43.205483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=14 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:48:43.232645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:48:43.474007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:48:43.474253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:48:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:48:49.757593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:48:49.758251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:48:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 (ip 10.222.0.70) !!! May 23 13:49:46.909783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49b5c1d4-202c-4db5-a0e8-d75771d3a65d) May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:49:46.910404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:46.912697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49b5c1d4-202c-4db5-a0e8-d75771d3a65d) May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:46.913997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49b5c1d4-202c-4db5-a0e8-d75771d3a65d) May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:46.917051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49b5c1d4-202c-4db5-a0e8-d75771d3a65d) May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:46.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49b5c1d4-202c-4db5-a0e8-d75771d3a65d) May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:46.920301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49b5c1d4-202c-4db5-a0e8-d75771d3a65d) May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49b5c1d4-202c-4db5-a0e8-d75771d3a65d) May 23 13:49:46.922831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:46.925122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49b5c1d4-202c-4db5-a0e8-d75771d3a65d) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:46.925122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-096df857-dcf9-4884-8161-3416f9251e39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 400 len: 269 microversion: 2.1 time: 74.102567 May 23 13:49:46.925122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 548/1017] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:48:32 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 269 bytes in 74104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:47.098201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a56545cf-e3c5-431d-a0da-83c61a47cccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.099404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a56545cf-e3c5-431d-a0da-83c61a47cccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.106360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a56545cf-e3c5-431d-a0da-83c61a47cccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.112047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a56545cf-e3c5-431d-a0da-83c61a47cccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.112047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a56545cf-e3c5-431d-a0da-83c61a47cccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.112047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a56545cf-e3c5-431d-a0da-83c61a47cccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.141968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a56545cf-e3c5-431d-a0da-83c61a47cccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228142 May 23 13:49:47.142332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 549/1018] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:46 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:47.147775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.152312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.154542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'services' on Instance uuid 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:47.155161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.156156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.157305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.157605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.237850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c01d10f4-0bcd-4be6-97ec-3bb8480d1492) May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Request method failure captured: May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 HTTP/1.1 May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii40vd-P_YQXvsLwcStOUniM2vkJyRg_9f4ypUf1NkkYBUuBYj2FbSHcSv09Y9UyJFDGDsNJcps9rLkf-R9JngusICk7Pshxpnmguo79u6cuDaKW3P7O5Kr8RUgShdV8NPhuCdPEBp1AigrrZ-EzRROO12MbsaMVt6LTwkGHqvChOO6M May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:49:47.240127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}] May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 659caf32fa614f64bcd780a264674e33 May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:47.241951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c01d10f4-0bcd-4be6-97ec-3bb8480d1492) May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '72d8069e-32b9-4e3b-aabc-a8bf5bd66c55', 'id': '4d44b192-0fb0-44fe-8b5d-58f1d30f9737'} May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.243504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c01d10f4-0bcd-4be6-97ec-3bb8480d1492) May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.245510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c01d10f4-0bcd-4be6-97ec-3bb8480d1492) May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.247921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c01d10f4-0bcd-4be6-97ec-3bb8480d1492) May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.250335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c01d10f4-0bcd-4be6-97ec-3bb8480d1492) May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c01d10f4-0bcd-4be6-97ec-3bb8480d1492) May 23 13:49:47.252548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.254823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c01d10f4-0bcd-4be6-97ec-3bb8480d1492) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:47.254823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0dfa6b0b-51db-449d-bdb9-56bb4b38867a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737" status: 400 len: 269 microversion: 2.1 time: 74.045156 May 23 13:49:47.254823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 470/1019] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:48:33 2022] DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 => generated 269 bytes in 74046 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:47.254823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.255430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.258332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.258732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.259513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.259956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.291991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:47.357070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:47.393350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b215222d-e0c9-46c8-881a-bbf8457b1cba) May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:49:47.395634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:47.397166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b215222d-e0c9-46c8-881a-bbf8457b1cba) May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.398122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b215222d-e0c9-46c8-881a-bbf8457b1cba) May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.399376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b215222d-e0c9-46c8-881a-bbf8457b1cba) May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.400766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b215222d-e0c9-46c8-881a-bbf8457b1cba) May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.401828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b215222d-e0c9-46c8-881a-bbf8457b1cba) May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b215222d-e0c9-46c8-881a-bbf8457b1cba) May 23 13:49:47.402950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.403958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b215222d-e0c9-46c8-881a-bbf8457b1cba) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:47.403958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-774aa841-033b-4bbe-8f0f-9d8e43400255 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 0.253626 May 23 13:49:47.403958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 550/1020] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:47 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:47.403958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ffbeceb0-35a8-4cf0-8c59-96c189bcf91b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.404256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ffbeceb0-35a8-4cf0-8c59-96c189bcf91b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.411256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffbeceb0-35a8-4cf0-8c59-96c189bcf91b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.411760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffbeceb0-35a8-4cf0-8c59-96c189bcf91b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.412559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffbeceb0-35a8-4cf0-8c59-96c189bcf91b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.413034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffbeceb0-35a8-4cf0-8c59-96c189bcf91b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.436022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3eb9754-7326-488b-bf91-91e8cd64374e) May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:49:47.438536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:47.443375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3eb9754-7326-488b-bf91-91e8cd64374e) May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.444538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3eb9754-7326-488b-bf91-91e8cd64374e) May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.446491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3eb9754-7326-488b-bf91-91e8cd64374e) May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.448000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3eb9754-7326-488b-bf91-91e8cd64374e) May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.450259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3eb9754-7326-488b-bf91-91e8cd64374e) May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3eb9754-7326-488b-bf91-91e8cd64374e) May 23 13:49:47.452522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.454661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b3eb9754-7326-488b-bf91-91e8cd64374e) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:47.454661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b757b662-0e4b-4176-b5e6-c750adde1261 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 400 len: 269 microversion: 2.1 time: 0.196706 May 23 13:49:47.454661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 471/1021] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:47 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 269 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:47.454661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-25989b05-ca32-455f-9b08-3a1e9f9ab08d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.455299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-25989b05-ca32-455f-9b08-3a1e9f9ab08d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.459884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25989b05-ca32-455f-9b08-3a1e9f9ab08d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.460413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25989b05-ca32-455f-9b08-3a1e9f9ab08d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.461452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25989b05-ca32-455f-9b08-3a1e9f9ab08d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.462124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25989b05-ca32-455f-9b08-3a1e9f9ab08d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.498141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-25989b05-ca32-455f-9b08-3a1e9f9ab08d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056293 May 23 13:49:47.498739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 472/1022] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:47 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:47.576013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ffbeceb0-35a8-4cf0-8c59-96c189bcf91b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:47.587586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ffbeceb0-35a8-4cf0-8c59-96c189bcf91b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1563 microversion: 2.1 time: 0.188628 May 23 13:49:47.588284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 551/1023] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:47 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:47.597098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.597667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.606841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.607095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.608810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.609845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.661944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-daf07af9-2fa5-4017-a8dc-b72a167a042b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.663697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-daf07af9-2fa5-4017-a8dc-b72a167a042b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.670618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-daf07af9-2fa5-4017-a8dc-b72a167a042b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.672515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-daf07af9-2fa5-4017-a8dc-b72a167a042b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.673357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-daf07af9-2fa5-4017-a8dc-b72a167a042b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.673807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-daf07af9-2fa5-4017-a8dc-b72a167a042b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.709367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-daf07af9-2fa5-4017-a8dc-b72a167a042b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.209204 May 23 13:49:47.709971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 473/1024] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:49:47 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:49:47.714884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-80d9594e-0707-4164-8e8f-b3a98025ca4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.716089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-80d9594e-0707-4164-8e8f-b3a98025ca4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.723436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80d9594e-0707-4164-8e8f-b3a98025ca4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.723698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'services' on Instance uuid 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:47.723895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80d9594e-0707-4164-8e8f-b3a98025ca4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.724781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80d9594e-0707-4164-8e8f-b3a98025ca4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.725226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80d9594e-0707-4164-8e8f-b3a98025ca4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.759315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-80d9594e-0707-4164-8e8f-b3a98025ca4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048247 May 23 13:49:47.760180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 474/1025] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:47 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:47.766474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.766990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.773417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.773875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.774659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.775096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.798965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70b32587-1079-424d-acf3-4226ea859318) May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Request method failure captured: May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 HTTP/1.1 May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii40vd-P_YQXvsLwcStOUniM2vkJyRg_9f4ypUf1NkkYBUuBYj2FbSHcSv09Y9UyJFDGDsNJcps9rLkf-R9JngusICk7Pshxpnmguo79u6cuDaKW3P7O5Kr8RUgShdV8NPhuCdPEBp1AigrrZ-EzRROO12MbsaMVt6LTwkGHqvChOO6M May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:49:47.801285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}] May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 659caf32fa614f64bcd780a264674e33 May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:47.803211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70b32587-1079-424d-acf3-4226ea859318) May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '72d8069e-32b9-4e3b-aabc-a8bf5bd66c55', 'id': '4d44b192-0fb0-44fe-8b5d-58f1d30f9737'} May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.804336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70b32587-1079-424d-acf3-4226ea859318) May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.806313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70b32587-1079-424d-acf3-4226ea859318) May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.809744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70b32587-1079-424d-acf3-4226ea859318) May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.812374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70b32587-1079-424d-acf3-4226ea859318) May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70b32587-1079-424d-acf3-4226ea859318) May 23 13:49:47.815035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:47.817709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70b32587-1079-424d-acf3-4226ea859318) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:47.817709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-faef07db-fa0c-4408-8cda-9d147f9659a2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737" status: 400 len: 269 microversion: 2.1 time: 0.213424 May 23 13:49:47.817709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 552/1026] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:47 2022] DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 => generated 269 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:47.817709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.819816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.819816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.819816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.819816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.820253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.867396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:47.916338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:47.949521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ea1e3-d67f-4ba2-be2e-778c25f8a971) May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:49:47.952008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:47.955182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ea1e3-d67f-4ba2-be2e-778c25f8a971) May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.957160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ea1e3-d67f-4ba2-be2e-778c25f8a971) May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:47.959124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ea1e3-d67f-4ba2-be2e-778c25f8a971) May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.962218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ea1e3-d67f-4ba2-be2e-778c25f8a971) May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.965147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ea1e3-d67f-4ba2-be2e-778c25f8a971) May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ea1e3-d67f-4ba2-be2e-778c25f8a971) May 23 13:49:47.968072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:47.981348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ea1e3-d67f-4ba2-be2e-778c25f8a971) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:47.981348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1be601ec-fc4b-4546-a126-7fee82ef2f3c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 0.193162 May 23 13:49:47.981348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 475/1027] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:47 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:47.981348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89c9dac9-cf9b-4675-8980-9b21f7fde20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:47.982685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-89c9dac9-cf9b-4675-8980-9b21f7fde20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:47.982685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89c9dac9-cf9b-4675-8980-9b21f7fde20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.982685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89c9dac9-cf9b-4675-8980-9b21f7fde20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.982685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89c9dac9-cf9b-4675-8980-9b21f7fde20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:47.983492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89c9dac9-cf9b-4675-8980-9b21f7fde20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:47.992638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7d2f949-196a-4ef6-9119-375f3e0517eb) May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:49:47.994867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:47.997934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7d2f949-196a-4ef6-9119-375f3e0517eb) May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.000060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7d2f949-196a-4ef6-9119-375f3e0517eb) May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.007049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7d2f949-196a-4ef6-9119-375f3e0517eb) May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.008934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7d2f949-196a-4ef6-9119-375f3e0517eb) May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.010678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7d2f949-196a-4ef6-9119-375f3e0517eb) May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7d2f949-196a-4ef6-9119-375f3e0517eb) May 23 13:49:48.013113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.015879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7d2f949-196a-4ef6-9119-375f3e0517eb) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:48.015879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d4ccc943-ff4c-4a46-b838-78e70d2cb94d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 400 len: 269 microversion: 2.1 time: 0.191729 May 23 13:49:48.015879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 553/1028] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:47 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 269 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:48.015879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-18a36bb0-fed2-40ae-9df9-516c89b73816 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.016482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-18a36bb0-fed2-40ae-9df9-516c89b73816 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.016482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18a36bb0-fed2-40ae-9df9-516c89b73816 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.016482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18a36bb0-fed2-40ae-9df9-516c89b73816 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.016482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18a36bb0-fed2-40ae-9df9-516c89b73816 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.016981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18a36bb0-fed2-40ae-9df9-516c89b73816 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.057282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-18a36bb0-fed2-40ae-9df9-516c89b73816 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058914 May 23 13:49:48.057995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 554/1029] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:47 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:48.063773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c20650f1-9e37-44fa-a491-e3737bf0f144 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.068201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c20650f1-9e37-44fa-a491-e3737bf0f144 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.071975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c20650f1-9e37-44fa-a491-e3737bf0f144 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.072558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c20650f1-9e37-44fa-a491-e3737bf0f144 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.073464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c20650f1-9e37-44fa-a491-e3737bf0f144 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.073915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c20650f1-9e37-44fa-a491-e3737bf0f144 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.115523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c20650f1-9e37-44fa-a491-e3737bf0f144 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056296 May 23 13:49:48.116109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 555/1030] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:49:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:49:48.121340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.121853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.128989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.129445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.130241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.131015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.156973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89c9dac9-cf9b-4675-8980-9b21f7fde20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:48.165909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89c9dac9-cf9b-4675-8980-9b21f7fde20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1563 microversion: 2.1 time: 0.209616 May 23 13:49:48.166519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 476/1031] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:47 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1563 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:48.172117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cdc06e56-529e-44c3-be7a-955e0336e8c7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.173350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cdc06e56-529e-44c3-be7a-955e0336e8c7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.179829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdc06e56-529e-44c3-be7a-955e0336e8c7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.180284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdc06e56-529e-44c3-be7a-955e0336e8c7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.181103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdc06e56-529e-44c3-be7a-955e0336e8c7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.181542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdc06e56-529e-44c3-be7a-955e0336e8c7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.214654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cdc06e56-529e-44c3-be7a-955e0336e8c7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047034 May 23 13:49:48.215247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 477/1032] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:48.221483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.222022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.228654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.229133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.229887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.230327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.253364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'services' on Instance uuid 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:48.349797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d12ad72-5b6b-4a2e-bfbe-4dfbfef01306) May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Request method failure captured: May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 HTTP/1.1 May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii40vd-P_YQXvsLwcStOUniM2vkJyRg_9f4ypUf1NkkYBUuBYj2FbSHcSv09Y9UyJFDGDsNJcps9rLkf-R9JngusICk7Pshxpnmguo79u6cuDaKW3P7O5Kr8RUgShdV8NPhuCdPEBp1AigrrZ-EzRROO12MbsaMVt6LTwkGHqvChOO6M May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:49:48.354279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}] May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 659caf32fa614f64bcd780a264674e33 May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:48.356158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d12ad72-5b6b-4a2e-bfbe-4dfbfef01306) May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '72d8069e-32b9-4e3b-aabc-a8bf5bd66c55', 'id': '4d44b192-0fb0-44fe-8b5d-58f1d30f9737'} May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.357230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d12ad72-5b6b-4a2e-bfbe-4dfbfef01306) May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d12ad72-5b6b-4a2e-bfbe-4dfbfef01306) May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.360789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d12ad72-5b6b-4a2e-bfbe-4dfbfef01306) May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.362335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d12ad72-5b6b-4a2e-bfbe-4dfbfef01306) May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d12ad72-5b6b-4a2e-bfbe-4dfbfef01306) May 23 13:49:48.363640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.366427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d12ad72-5b6b-4a2e-bfbe-4dfbfef01306) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:48.366427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17ef0624-4a98-4292-ae66-a18b45b84277 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737" status: 400 len: 269 microversion: 2.1 time: 0.239702 May 23 13:49:48.366427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 556/1033] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:48 2022] DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 => generated 269 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:48.367023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.367871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.378890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.379684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.381182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.381980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.404039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:48.477001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65633f26-a2c6-4130-92f2-6f6c7e581c21) May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:49:48.479781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:48.482826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65633f26-a2c6-4130-92f2-6f6c7e581c21) May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.484623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65633f26-a2c6-4130-92f2-6f6c7e581c21) May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65633f26-a2c6-4130-92f2-6f6c7e581c21) May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.488783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65633f26-a2c6-4130-92f2-6f6c7e581c21) May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.490752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65633f26-a2c6-4130-92f2-6f6c7e581c21) May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65633f26-a2c6-4130-92f2-6f6c7e581c21) May 23 13:49:48.494318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:48.497095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65633f26-a2c6-4130-92f2-6f6c7e581c21) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:48.497095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e3a330f9-0138-49ec-9f8f-6d0172517b13 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 0.265717 May 23 13:49:48.497095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 478/1034] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:48 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 268 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:48.497095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f85469fd-ebcb-4585-bb54-db23c9d0681b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.497769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f85469fd-ebcb-4585-bb54-db23c9d0681b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.502360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f85469fd-ebcb-4585-bb54-db23c9d0681b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.503021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f85469fd-ebcb-4585-bb54-db23c9d0681b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.504166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f85469fd-ebcb-4585-bb54-db23c9d0681b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.504775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f85469fd-ebcb-4585-bb54-db23c9d0681b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.540251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:48.639268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0e345ad-9568-4a7f-a3e4-8cd6505e33ef) May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:49:48.645157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:48.649616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0e345ad-9568-4a7f-a3e4-8cd6505e33ef) May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.650924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0e345ad-9568-4a7f-a3e4-8cd6505e33ef) May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.653714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0e345ad-9568-4a7f-a3e4-8cd6505e33ef) May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.656550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0e345ad-9568-4a7f-a3e4-8cd6505e33ef) May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.659338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0e345ad-9568-4a7f-a3e4-8cd6505e33ef) May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0e345ad-9568-4a7f-a3e4-8cd6505e33ef) May 23 13:49:48.661741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.663971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0e345ad-9568-4a7f-a3e4-8cd6505e33ef) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:48.663971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-32ccd8e0-0523-4784-b097-d79e384c8182 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 400 len: 269 microversion: 2.1 time: 0.287936 May 23 13:49:48.663971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 557/1035] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:48 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 269 bytes in 290 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:48.663971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17e51927-1b24-4d5c-b8c6-4a483bb7524a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.664755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17e51927-1b24-4d5c-b8c6-4a483bb7524a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.672745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17e51927-1b24-4d5c-b8c6-4a483bb7524a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.673047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17e51927-1b24-4d5c-b8c6-4a483bb7524a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.674520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17e51927-1b24-4d5c-b8c6-4a483bb7524a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.675839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17e51927-1b24-4d5c-b8c6-4a483bb7524a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.691952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f85469fd-ebcb-4585-bb54-db23c9d0681b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:48.703633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f85469fd-ebcb-4585-bb54-db23c9d0681b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1563 microversion: 2.1 time: 0.218659 May 23 13:49:48.704517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 479/1036] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:48 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:48.709970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-02c12038-a992-4313-afa3-ab44109e6eff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.711010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-02c12038-a992-4313-afa3-ab44109e6eff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.718280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02c12038-a992-4313-afa3-ab44109e6eff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.718965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02c12038-a992-4313-afa3-ab44109e6eff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.719807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02c12038-a992-4313-afa3-ab44109e6eff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.719992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17e51927-1b24-4d5c-b8c6-4a483bb7524a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069448 May 23 13:49:48.720246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02c12038-a992-4313-afa3-ab44109e6eff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.720783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 558/1037] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:48 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:48.725940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.726446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.733321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.734485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.735305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.735757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.767133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-02c12038-a992-4313-afa3-ab44109e6eff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060930 May 23 13:49:48.768373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 480/1038] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:49:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:49:48.777333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a42bb93-da4a-4242-aceb-cafde790ce22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.779042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a42bb93-da4a-4242-aceb-cafde790ce22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.789861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a42bb93-da4a-4242-aceb-cafde790ce22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.790674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a42bb93-da4a-4242-aceb-cafde790ce22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.791871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a42bb93-da4a-4242-aceb-cafde790ce22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.792703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a42bb93-da4a-4242-aceb-cafde790ce22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.828388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'services' on Instance uuid 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:48.850659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a42bb93-da4a-4242-aceb-cafde790ce22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079964 May 23 13:49:48.851612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 481/1039] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:48.858107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.863252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.873799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.874542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.875717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.876398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.888855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76919906-2804-4964-abb3-8c49a94486b1) May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Request method failure captured: May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 HTTP/1.1 May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii40vd-P_YQXvsLwcStOUniM2vkJyRg_9f4ypUf1NkkYBUuBYj2FbSHcSv09Y9UyJFDGDsNJcps9rLkf-R9JngusICk7Pshxpnmguo79u6cuDaKW3P7O5Kr8RUgShdV8NPhuCdPEBp1AigrrZ-EzRROO12MbsaMVt6LTwkGHqvChOO6M May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:49:48.891107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}] May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 659caf32fa614f64bcd780a264674e33 May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:48.892680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76919906-2804-4964-abb3-8c49a94486b1) May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '72d8069e-32b9-4e3b-aabc-a8bf5bd66c55', 'id': '4d44b192-0fb0-44fe-8b5d-58f1d30f9737'} May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.893288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76919906-2804-4964-abb3-8c49a94486b1) May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:48.894324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76919906-2804-4964-abb3-8c49a94486b1) May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.895506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76919906-2804-4964-abb3-8c49a94486b1) May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.896484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76919906-2804-4964-abb3-8c49a94486b1) May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76919906-2804-4964-abb3-8c49a94486b1) May 23 13:49:48.897606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:48.898699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76919906-2804-4964-abb3-8c49a94486b1) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:48.898699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-232eeffd-aa67-40e8-8606-01451b319309 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737" status: 400 len: 269 microversion: 2.1 time: 0.170622 May 23 13:49:48.898699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 559/1040] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:48 2022] DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 => generated 269 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:48.898699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:48.899003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:48.904746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.905733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.906522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:48.907017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:48.989887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:49.038215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'services' on Instance uuid 6ea1331e-b180-41c8-910a-04b7cff4a9f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:49.071589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6609cb0b-724c-4649-96c0-38a3eab07999) May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:49:49.073904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:49.075629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6609cb0b-724c-4649-96c0-38a3eab07999) May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:49.078383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6609cb0b-724c-4649-96c0-38a3eab07999) May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:49.080336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6609cb0b-724c-4649-96c0-38a3eab07999) May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.082252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6609cb0b-724c-4649-96c0-38a3eab07999) May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:49.083842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6609cb0b-724c-4649-96c0-38a3eab07999) May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6609cb0b-724c-4649-96c0-38a3eab07999) May 23 13:49:49.088623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.091273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6609cb0b-724c-4649-96c0-38a3eab07999) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:49.091273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-52ca50f4-fbab-4c9a-af06-067ee075902c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 0.222734 May 23 13:49:49.091273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 482/1041] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:48 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:49.091273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6b3fdb1-8166-40b5-9c50-98b6327c2cc2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:49.091765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c6b3fdb1-8166-40b5-9c50-98b6327c2cc2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:49.091765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6b3fdb1-8166-40b5-9c50-98b6327c2cc2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.091765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6b3fdb1-8166-40b5-9c50-98b6327c2cc2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.092493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6b3fdb1-8166-40b5-9c50-98b6327c2cc2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.093719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6b3fdb1-8166-40b5-9c50-98b6327c2cc2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.114131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95f8da8d-da49-45f2-a977-33ce6ef5a319) May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 HTTP/1.1 May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:49:49.117143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 13:49:49.118442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95f8da8d-da49-45f2-a977-33ce6ef5a319) May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '6ea1331e-b180-41c8-910a-04b7cff4a9f7', 'id': '2e1f9d6a-4778-4fc3-9ac2-4bc492d50148'} May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:49.119064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95f8da8d-da49-45f2-a977-33ce6ef5a319) May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:49.120073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95f8da8d-da49-45f2-a977-33ce6ef5a319) May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.121428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95f8da8d-da49-45f2-a977-33ce6ef5a319) May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:49.122822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95f8da8d-da49-45f2-a977-33ce6ef5a319) May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95f8da8d-da49-45f2-a977-33ce6ef5a319) May 23 13:49:49.125595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.127688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95f8da8d-da49-45f2-a977-33ce6ef5a319) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:49.127688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a0b974c3-e2d1-4e8c-bc38-62cadffea5fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148" status: 400 len: 269 microversion: 2.1 time: 0.225057 May 23 13:49:49.127688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 560/1042] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:48 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments/2e1f9d6a-4778-4fc3-9ac2-4bc492d50148 => generated 269 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:49.127688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aee08d21-3f64-4ad5-9a86-323c31bb9822 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:49.128653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aee08d21-3f64-4ad5-9a86-323c31bb9822 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:49.139213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee08d21-3f64-4ad5-9a86-323c31bb9822 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.139213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee08d21-3f64-4ad5-9a86-323c31bb9822 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.139213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee08d21-3f64-4ad5-9a86-323c31bb9822 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.140159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee08d21-3f64-4ad5-9a86-323c31bb9822 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.173325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aee08d21-3f64-4ad5-9a86-323c31bb9822 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049820 May 23 13:49:49.173809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 561/1043] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:49 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:49.178888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e94f8dd5-405f-4e6a-8153-dbd3d98668da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:49.179824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e94f8dd5-405f-4e6a-8153-dbd3d98668da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:49.186209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e94f8dd5-405f-4e6a-8153-dbd3d98668da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.186742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e94f8dd5-405f-4e6a-8153-dbd3d98668da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.187605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e94f8dd5-405f-4e6a-8153-dbd3d98668da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.188046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e94f8dd5-405f-4e6a-8153-dbd3d98668da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.221812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e94f8dd5-405f-4e6a-8153-dbd3d98668da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046875 May 23 13:49:49.222401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 562/1044] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 13:49:49 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:49:49.231186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:49.231726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:49.241247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.242082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.243505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.244308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.252207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:49:49.258343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c6b3fdb1-8166-40b5-9c50-98b6327c2cc2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:49.269870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c6b3fdb1-8166-40b5-9c50-98b6327c2cc2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1563 microversion: 2.1 time: 0.192792 May 23 13:49:49.273005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 483/1045] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:49 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:49.275808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-595b3267-f757-4cac-bdc6-f3fe94fb350d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:49.276802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-595b3267-f757-4cac-bdc6-f3fe94fb350d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:49.285262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-595b3267-f757-4cac-bdc6-f3fe94fb350d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.285828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-595b3267-f757-4cac-bdc6-f3fe94fb350d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.286916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-595b3267-f757-4cac-bdc6-f3fe94fb350d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.287474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-595b3267-f757-4cac-bdc6-f3fe94fb350d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.333416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-595b3267-f757-4cac-bdc6-f3fe94fb350d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061768 May 23 13:49:49.334740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 484/1046] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:49 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:49.339854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:49.340616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:49.350036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.350986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.351991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.352793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.361095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lazy-loading 'services' on Instance uuid 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:49.383211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:49:49.441802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc6fd072-d804-4e2d-96dc-bdeae9743384) May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Request method failure captured: May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 HTTP/1.1 May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii40vd-P_YQXvsLwcStOUniM2vkJyRg_9f4ypUf1NkkYBUuBYj2FbSHcSv09Y9UyJFDGDsNJcps9rLkf-R9JngusICk7Pshxpnmguo79u6cuDaKW3P7O5Kr8RUgShdV8NPhuCdPEBp1AigrrZ-EzRROO12MbsaMVt6LTwkGHqvChOO6M May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 13:49:49.444315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/562a3f075cb64d668a76838fd4f9c8f5"}]}] May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 562a3f075cb64d668a76838fd4f9c8f5 May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699784808 May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 659caf32fa614f64bcd780a264674e33 May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699784808-project May 23 13:49:49.446350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc6fd072-d804-4e2d-96dc-bdeae9743384) May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '72d8069e-32b9-4e3b-aabc-a8bf5bd66c55', 'id': '4d44b192-0fb0-44fe-8b5d-58f1d30f9737'} May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:49.447268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc6fd072-d804-4e2d-96dc-bdeae9743384) May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:49.448292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc6fd072-d804-4e2d-96dc-bdeae9743384) May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.449467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc6fd072-d804-4e2d-96dc-bdeae9743384) May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:49.450677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc6fd072-d804-4e2d-96dc-bdeae9743384) May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc6fd072-d804-4e2d-96dc-bdeae9743384) May 23 13:49:49.451788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 13:49:49.454994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc6fd072-d804-4e2d-96dc-bdeae9743384) {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:49.454994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8c1b68df-4b93-4a9c-9f4c-6c7d1e8cb6b5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737" status: 400 len: 269 microversion: 2.1 time: 0.222392 May 23 13:49:49.454994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 563/1047] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:49 2022] DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55/os-volume_attachments/4d44b192-0fb0-44fe-8b5d-58f1d30f9737 => generated 269 bytes in 226 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:49.454994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff55c409-fd97-4d5a-a70f-4ee3895e02b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:49.455512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff55c409-fd97-4d5a-a70f-4ee3895e02b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:49.462931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff55c409-fd97-4d5a-a70f-4ee3895e02b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.463384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff55c409-fd97-4d5a-a70f-4ee3895e02b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.464180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff55c409-fd97-4d5a-a70f-4ee3895e02b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:49.466186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff55c409-fd97-4d5a-a70f-4ee3895e02b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:49.503847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff55c409-fd97-4d5a-a70f-4ee3895e02b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053554 May 23 13:49:49.507752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 564/1048] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:49.507993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lazy-loading 'services' on Instance uuid 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 13:49:49.589634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-062431d5-0da6-49b1-b8b0-775aae2ad216) May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Request method failure captured: May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb HTTP/1.1 May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii41cCdxb96G28dtMbDA5K3e9hWmXieBRn1Zrwvwy3prYvrxJluyjJH8JAQCb5gYK2MTpicurKQxciHscFMuuHuhpBGMROE8sYqHfOYYjVDNSOxwEmGPe3zoVB-eSLltrx6Prs_P2vIwhOPOkWMZgmXjMtsiCWuCiijy8zKgSPBTQ2sI May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 13:49:49.594619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3407c9665e0448e18fd87ec20b0843e4"}]}] May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 3407c9665e0448e18fd87ec20b0843e4 May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-874674570 May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 701b374f2fcf437dad87cec756232547 May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-874674570-project May 23 13:49:49.596005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-062431d5-0da6-49b1-b8b0-775aae2ad216) May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '05ddd2ac-4582-4472-a43f-e3a8b4944ed2', 'id': '97d0c08d-8b73-4e27-b687-aa249e246ccb'} May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:49.596680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-062431d5-0da6-49b1-b8b0-775aae2ad216) May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 13:49:49.597957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-062431d5-0da6-49b1-b8b0-775aae2ad216) May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.599329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-062431d5-0da6-49b1-b8b0-775aae2ad216) May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:49.600600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-062431d5-0da6-49b1-b8b0-775aae2ad216) May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-062431d5-0da6-49b1-b8b0-775aae2ad216) May 23 13:49:49.601800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 13:49:49.603050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-062431d5-0da6-49b1-b8b0-775aae2ad216) {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 13:49:49.603050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1e530bd4-ebc1-411e-b2a1-ca278d125187 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb" status: 400 len: 269 microversion: 2.1 time: 0.258825 May 23 13:49:49.603050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 485/1049] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 13:49:49 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2/os-volume_attachments/97d0c08d-8b73-4e27-b687-aa249e246ccb => generated 269 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 13:49:50.185866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-19cbd5c8-6af5-47e1-935d-997a128d95dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:49:50.186958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-19cbd5c8-6af5-47e1-935d-997a128d95dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:50.194294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19cbd5c8-6af5-47e1-935d-997a128d95dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.194752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19cbd5c8-6af5-47e1-935d-997a128d95dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.195539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19cbd5c8-6af5-47e1-935d-997a128d95dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.195988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19cbd5c8-6af5-47e1-935d-997a128d95dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.241913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c56518bc-cfe3-4ead-9016-ae7722cf1652 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:49:50.244934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c56518bc-cfe3-4ead-9016-ae7722cf1652 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:50.251636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c56518bc-cfe3-4ead-9016-ae7722cf1652 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.252091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c56518bc-cfe3-4ead-9016-ae7722cf1652 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.252910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c56518bc-cfe3-4ead-9016-ae7722cf1652 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.253350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c56518bc-cfe3-4ead-9016-ae7722cf1652 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.309736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-19cbd5c8-6af5-47e1-935d-997a128d95dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/action" status: 200 len: 41275 microversion: 2.1 time: 0.128690 May 23 13:49:50.310403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 565/1050] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:49:50 2022] POST /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa/action => generated 41275 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 13:49:50.352223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14301f86-3d40-4560-8fce-d8e5986e6f8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:50.354463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-14301f86-3d40-4560-8fce-d8e5986e6f8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:50.362183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14301f86-3d40-4560-8fce-d8e5986e6f8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.362639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14301f86-3d40-4560-8fce-d8e5986e6f8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.363417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14301f86-3d40-4560-8fce-d8e5986e6f8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.364262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14301f86-3d40-4560-8fce-d8e5986e6f8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.400753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-14301f86-3d40-4560-8fce-d8e5986e6f8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057783 May 23 13:49:50.405343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c56518bc-cfe3-4ead-9016-ae7722cf1652 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/action" status: 200 len: 37501 microversion: 2.20 time: 0.170981 May 23 13:49:50.414470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 566/1051] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:50.416615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 486/1052] 10.222.0.70 () {62 vars in 1318 bytes} [Mon May 23 13:49:50 2022] POST /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4/action => generated 37501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 23 13:49:50.474589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-edb21837-33b1-4ac8-8221-904c784e5d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:50.474589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-edb21837-33b1-4ac8-8221-904c784e5d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:50.474589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edb21837-33b1-4ac8-8221-904c784e5d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.475031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edb21837-33b1-4ac8-8221-904c784e5d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.475782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edb21837-33b1-4ac8-8221-904c784e5d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.476232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edb21837-33b1-4ac8-8221-904c784e5d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.515820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-edb21837-33b1-4ac8-8221-904c784e5d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:49:50.587771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-17eb065c-7eb3-457d-bf37-07ba00b2eb05 req-2c5777ec-2367-4f75-815c-106d4927e713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83ea9db-9db3-48c0-83a5-c423a1151195", "tag": "fcdea6af-6005-431d-b6d7-10f18e37002a"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:49:50.605306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-17eb065c-7eb3-457d-bf37-07ba00b2eb05 req-2c5777ec-2367-4f75-815c-106d4927e713 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.605306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-17eb065c-7eb3-457d-bf37-07ba00b2eb05 req-2c5777ec-2367-4f75-815c-106d4927e713 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.616987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-17eb065c-7eb3-457d-bf37-07ba00b2eb05 req-2c5777ec-2367-4f75-815c-106d4927e713 service nova] Creating event network-changed:fcdea6af-6005-431d-b6d7-10f18e37002a for instance f83ea9db-9db3-48c0-83a5-c423a1151195 on hv-cinder-82549 May 23 13:49:50.622459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-17eb065c-7eb3-457d-bf37-07ba00b2eb05 req-2c5777ec-2367-4f75-815c-106d4927e713 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152045 May 23 13:49:50.623052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 487/1053] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:50.634540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ddc7ec7e-9bc8-49d3-9b2f-dc7f33a8fe32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:50.635585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ddc7ec7e-9bc8-49d3-9b2f-dc7f33a8fe32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:50.643368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc7ec7e-9bc8-49d3-9b2f-dc7f33a8fe32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.643819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc7ec7e-9bc8-49d3-9b2f-dc7f33a8fe32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.644618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc7ec7e-9bc8-49d3-9b2f-dc7f33a8fe32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.645050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc7ec7e-9bc8-49d3-9b2f-dc7f33a8fe32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.691990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ddc7ec7e-9bc8-49d3-9b2f-dc7f33a8fe32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062264 May 23 13:49:50.692486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 488/1054] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:50.947010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-edb21837-33b1-4ac8-8221-904c784e5d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 204 len: 0 microversion: 2.1 time: 0.485687 May 23 13:49:50.947405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 567/1055] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:49:50 2022] DELETE /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 13:49:50.956553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57b5a765-b779-437b-8979-d4cd91dee7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:50.957298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57b5a765-b779-437b-8979-d4cd91dee7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:50.964249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57b5a765-b779-437b-8979-d4cd91dee7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.964749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57b5a765-b779-437b-8979-d4cd91dee7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:50.965550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57b5a765-b779-437b-8979-d4cd91dee7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:50.966468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57b5a765-b779-437b-8979-d4cd91dee7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:51.142654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57b5a765-b779-437b-8979-d4cd91dee7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:51.151124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57b5a765-b779-437b-8979-d4cd91dee7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1569 microversion: 2.1 time: 0.198678 May 23 13:49:51.151825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 489/1056] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:50 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:51.432791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87b686f3-1a39-4b27-82e9-164e8017156c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:51.436600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87b686f3-1a39-4b27-82e9-164e8017156c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:51.447103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87b686f3-1a39-4b27-82e9-164e8017156c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:51.451468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87b686f3-1a39-4b27-82e9-164e8017156c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:51.451468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87b686f3-1a39-4b27-82e9-164e8017156c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:51.451468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87b686f3-1a39-4b27-82e9-164e8017156c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:51.488795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87b686f3-1a39-4b27-82e9-164e8017156c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062559 May 23 13:49:51.491685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 568/1057] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:51 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:49:51.711158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8b59cb78-9439-4432-9628-ab928009ce44 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:51.711158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8b59cb78-9439-4432-9628-ab928009ce44 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:51.713658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b59cb78-9439-4432-9628-ab928009ce44 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:51.714125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b59cb78-9439-4432-9628-ab928009ce44 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:51.714909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b59cb78-9439-4432-9628-ab928009ce44 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:51.715351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b59cb78-9439-4432-9628-ab928009ce44 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:51.756794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8b59cb78-9439-4432-9628-ab928009ce44 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057048 May 23 13:49:51.757523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 490/1058] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:52.072156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-c38959a3-6afc-42be-bf63-daa334f26b24 req-f6cbd840-d6d9-435c-8d5d-6480fb7aaad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83ea9db-9db3-48c0-83a5-c423a1151195", "name": "network-vif-deleted", "tag": "fcdea6af-6005-431d-b6d7-10f18e37002a"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:49:52.081360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c38959a3-6afc-42be-bf63-daa334f26b24 req-f6cbd840-d6d9-435c-8d5d-6480fb7aaad5 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:52.081808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c38959a3-6afc-42be-bf63-daa334f26b24 req-f6cbd840-d6d9-435c-8d5d-6480fb7aaad5 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:52.095331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-c38959a3-6afc-42be-bf63-daa334f26b24 req-f6cbd840-d6d9-435c-8d5d-6480fb7aaad5 service nova] Creating event network-vif-deleted:fcdea6af-6005-431d-b6d7-10f18e37002a for instance f83ea9db-9db3-48c0-83a5-c423a1151195 on hv-cinder-82549 May 23 13:49:52.105074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-c38959a3-6afc-42be-bf63-daa334f26b24 req-f6cbd840-d6d9-435c-8d5d-6480fb7aaad5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099244 May 23 13:49:52.105074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 569/1059] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:52.170277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6566ecd3-963d-4243-8a0c-6c35bd331f69 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:52.170821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6566ecd3-963d-4243-8a0c-6c35bd331f69 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:52.177781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6566ecd3-963d-4243-8a0c-6c35bd331f69 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:52.178266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6566ecd3-963d-4243-8a0c-6c35bd331f69 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:52.179074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6566ecd3-963d-4243-8a0c-6c35bd331f69 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:52.179521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6566ecd3-963d-4243-8a0c-6c35bd331f69 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:52.258804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6566ecd3-963d-4243-8a0c-6c35bd331f69 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:52.267634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6566ecd3-963d-4243-8a0c-6c35bd331f69 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1383 microversion: 2.1 time: 0.101193 May 23 13:49:52.268219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 491/1060] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:52 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1383 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:49:52.510977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d64da393-66fc-4d75-be0a-fdb3bb347326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:52.511913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d64da393-66fc-4d75-be0a-fdb3bb347326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:52.519321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d64da393-66fc-4d75-be0a-fdb3bb347326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:52.519778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d64da393-66fc-4d75-be0a-fdb3bb347326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:52.520589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d64da393-66fc-4d75-be0a-fdb3bb347326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:52.521037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d64da393-66fc-4d75-be0a-fdb3bb347326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:52.554463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d64da393-66fc-4d75-be0a-fdb3bb347326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050180 May 23 13:49:52.555065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 570/1061] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:52 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:52.768630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eb80d4dc-f9ce-4a6b-8ce0-0a949a732f9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:52.769496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eb80d4dc-f9ce-4a6b-8ce0-0a949a732f9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:52.775940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb80d4dc-f9ce-4a6b-8ce0-0a949a732f9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:52.776465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb80d4dc-f9ce-4a6b-8ce0-0a949a732f9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:52.777266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb80d4dc-f9ce-4a6b-8ce0-0a949a732f9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:52.777699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb80d4dc-f9ce-4a6b-8ce0-0a949a732f9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:52.809311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eb80d4dc-f9ce-4a6b-8ce0-0a949a732f9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 May 23 13:49:52.809876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 492/1062] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:53.285869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-039fafb9-0da2-47bd-8d2b-429932340be3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:53.286496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-039fafb9-0da2-47bd-8d2b-429932340be3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:53.292871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-039fafb9-0da2-47bd-8d2b-429932340be3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:53.293329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-039fafb9-0da2-47bd-8d2b-429932340be3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:53.294118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-039fafb9-0da2-47bd-8d2b-429932340be3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:53.294562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-039fafb9-0da2-47bd-8d2b-429932340be3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:53.369304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-039fafb9-0da2-47bd-8d2b-429932340be3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:53.378220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-039fafb9-0da2-47bd-8d2b-429932340be3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.096347 May 23 13:49:53.378810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 571/1063] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:53 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:53.567873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9610123b-70e5-4119-a855-16288b3070ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:53.569125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9610123b-70e5-4119-a855-16288b3070ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:53.577051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9610123b-70e5-4119-a855-16288b3070ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:53.577782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9610123b-70e5-4119-a855-16288b3070ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:53.578728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9610123b-70e5-4119-a855-16288b3070ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:53.579483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9610123b-70e5-4119-a855-16288b3070ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:53.619835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9610123b-70e5-4119-a855-16288b3070ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056865 May 23 13:49:53.620416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 493/1064] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:53 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:53.821972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b364f5a4-49df-4bf6-b1b9-877dbb441579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:53.823656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b364f5a4-49df-4bf6-b1b9-877dbb441579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:53.832224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b364f5a4-49df-4bf6-b1b9-877dbb441579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:53.832721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b364f5a4-49df-4bf6-b1b9-877dbb441579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:53.834015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b364f5a4-49df-4bf6-b1b9-877dbb441579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:53.834781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b364f5a4-49df-4bf6-b1b9-877dbb441579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:53.870649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b364f5a4-49df-4bf6-b1b9-877dbb441579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052787 May 23 13:49:53.871242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 572/1065] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:54.395993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e67be96a-5c6a-4a8a-bc16-641092d01543 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:54.396623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e67be96a-5c6a-4a8a-bc16-641092d01543 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:54.402898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e67be96a-5c6a-4a8a-bc16-641092d01543 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:54.403347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e67be96a-5c6a-4a8a-bc16-641092d01543 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:54.404120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e67be96a-5c6a-4a8a-bc16-641092d01543 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:54.404559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e67be96a-5c6a-4a8a-bc16-641092d01543 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:54.467915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e67be96a-5c6a-4a8a-bc16-641092d01543 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:54.475601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e67be96a-5c6a-4a8a-bc16-641092d01543 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083457 May 23 13:49:54.476166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 494/1066] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:54 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:54.631670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8870dd1-3102-4b4c-b827-ed9283b24b22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:54.632701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8870dd1-3102-4b4c-b827-ed9283b24b22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:54.638804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8870dd1-3102-4b4c-b827-ed9283b24b22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:54.639864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8870dd1-3102-4b4c-b827-ed9283b24b22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:54.640631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8870dd1-3102-4b4c-b827-ed9283b24b22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:54.641085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8870dd1-3102-4b4c-b827-ed9283b24b22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:54.672314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8870dd1-3102-4b4c-b827-ed9283b24b22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 May 23 13:49:54.672936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 573/1067] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:54 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:54.883556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ddc2e3cf-1c56-4cbd-8c5b-66be60a4c100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:54.884537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ddc2e3cf-1c56-4cbd-8c5b-66be60a4c100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:54.892324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc2e3cf-1c56-4cbd-8c5b-66be60a4c100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:54.892807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc2e3cf-1c56-4cbd-8c5b-66be60a4c100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:54.893581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc2e3cf-1c56-4cbd-8c5b-66be60a4c100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:54.894026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc2e3cf-1c56-4cbd-8c5b-66be60a4c100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:54.928509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ddc2e3cf-1c56-4cbd-8c5b-66be60a4c100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048910 May 23 13:49:54.929117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 495/1068] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:55.492644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fe1fb5a9-ff8a-4d00-846c-14c44afcf12d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:55.493189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fe1fb5a9-ff8a-4d00-846c-14c44afcf12d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:55.500506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe1fb5a9-ff8a-4d00-846c-14c44afcf12d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:55.501041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe1fb5a9-ff8a-4d00-846c-14c44afcf12d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:55.501835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe1fb5a9-ff8a-4d00-846c-14c44afcf12d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:55.502267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe1fb5a9-ff8a-4d00-846c-14c44afcf12d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:55.564779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe1fb5a9-ff8a-4d00-846c-14c44afcf12d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:55.572400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fe1fb5a9-ff8a-4d00-846c-14c44afcf12d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083682 May 23 13:49:55.573007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 574/1069] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:55 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:55.684454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0f5fe27d-2dcb-4b15-be57-3ba945f8a8e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:55.685402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0f5fe27d-2dcb-4b15-be57-3ba945f8a8e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:55.692011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f5fe27d-2dcb-4b15-be57-3ba945f8a8e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:55.692456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f5fe27d-2dcb-4b15-be57-3ba945f8a8e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:55.693255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f5fe27d-2dcb-4b15-be57-3ba945f8a8e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:55.693693 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f5fe27d-2dcb-4b15-be57-3ba945f8a8e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:55.726433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0f5fe27d-2dcb-4b15-be57-3ba945f8a8e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 May 23 13:49:55.727018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 496/1070] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:55 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:55.941416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c7892db-39a5-44a5-b53d-7534a3782674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:55.942339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c7892db-39a5-44a5-b53d-7534a3782674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:55.948391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c7892db-39a5-44a5-b53d-7534a3782674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:55.948877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c7892db-39a5-44a5-b53d-7534a3782674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:55.949651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c7892db-39a5-44a5-b53d-7534a3782674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:55.950087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c7892db-39a5-44a5-b53d-7534a3782674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:55.981411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c7892db-39a5-44a5-b53d-7534a3782674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043910 May 23 13:49:55.981985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 575/1071] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:56.590326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d78cb0cb-51d2-4e7d-a746-07732b2cf202 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:56.591138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d78cb0cb-51d2-4e7d-a746-07732b2cf202 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:56.597795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d78cb0cb-51d2-4e7d-a746-07732b2cf202 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:56.598246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d78cb0cb-51d2-4e7d-a746-07732b2cf202 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:56.599002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d78cb0cb-51d2-4e7d-a746-07732b2cf202 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:56.599435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d78cb0cb-51d2-4e7d-a746-07732b2cf202 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:56.665499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d78cb0cb-51d2-4e7d-a746-07732b2cf202 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:56.676513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d78cb0cb-51d2-4e7d-a746-07732b2cf202 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090181 May 23 13:49:56.679463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 497/1072] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:56 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:56.739335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c64713ae-6a89-4c8e-a8bf-29d4735e4b7b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:56.740255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c64713ae-6a89-4c8e-a8bf-29d4735e4b7b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:56.746747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c64713ae-6a89-4c8e-a8bf-29d4735e4b7b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:56.747209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c64713ae-6a89-4c8e-a8bf-29d4735e4b7b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:56.747949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c64713ae-6a89-4c8e-a8bf-29d4735e4b7b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:56.748379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c64713ae-6a89-4c8e-a8bf-29d4735e4b7b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:56.780013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c64713ae-6a89-4c8e-a8bf-29d4735e4b7b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 May 23 13:49:56.781287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 576/1073] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:56 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:56.996854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-87753604-0ec9-4000-9907-52ecf63c8b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:56.997871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-87753604-0ec9-4000-9907-52ecf63c8b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:57.009253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87753604-0ec9-4000-9907-52ecf63c8b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:57.009716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87753604-0ec9-4000-9907-52ecf63c8b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:57.010479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87753604-0ec9-4000-9907-52ecf63c8b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:57.012293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87753604-0ec9-4000-9907-52ecf63c8b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:57.049469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-87753604-0ec9-4000-9907-52ecf63c8b31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059737 May 23 13:49:57.050038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 498/1074] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:57.698820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b65f2cbe-8e89-43bb-9271-535869d46b9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:57.699464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b65f2cbe-8e89-43bb-9271-535869d46b9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:57.706567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b65f2cbe-8e89-43bb-9271-535869d46b9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:57.707019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b65f2cbe-8e89-43bb-9271-535869d46b9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:57.707798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b65f2cbe-8e89-43bb-9271-535869d46b9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:57.708238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b65f2cbe-8e89-43bb-9271-535869d46b9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:57.774436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b65f2cbe-8e89-43bb-9271-535869d46b9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:57.783114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b65f2cbe-8e89-43bb-9271-535869d46b9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088190 May 23 13:49:57.783711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 577/1075] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:57 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:57.792925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95f362c1-fb5c-4fa0-9ce3-634947a78f88 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:57.793841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95f362c1-fb5c-4fa0-9ce3-634947a78f88 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:57.801681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95f362c1-fb5c-4fa0-9ce3-634947a78f88 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:57.802130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95f362c1-fb5c-4fa0-9ce3-634947a78f88 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:57.802997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95f362c1-fb5c-4fa0-9ce3-634947a78f88 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:57.803434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95f362c1-fb5c-4fa0-9ce3-634947a78f88 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:57.834057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95f362c1-fb5c-4fa0-9ce3-634947a78f88 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 May 23 13:49:57.834623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 499/1076] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:57 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:58.061483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-856e3335-d2ed-4a14-9e85-50ebae1c68e2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:58.063071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-856e3335-d2ed-4a14-9e85-50ebae1c68e2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:58.069578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-856e3335-d2ed-4a14-9e85-50ebae1c68e2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:58.070035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-856e3335-d2ed-4a14-9e85-50ebae1c68e2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:58.070803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-856e3335-d2ed-4a14-9e85-50ebae1c68e2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:58.071239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-856e3335-d2ed-4a14-9e85-50ebae1c68e2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:58.097573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:49:58.102015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-856e3335-d2ed-4a14-9e85-50ebae1c68e2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 May 23 13:49:58.102563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 578/1077] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:58 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:58.799430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-117370f4-42f7-43f2-9923-9c6561b649be tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:58.800109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-117370f4-42f7-43f2-9923-9c6561b649be tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:58.807168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-117370f4-42f7-43f2-9923-9c6561b649be tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:58.807613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-117370f4-42f7-43f2-9923-9c6561b649be tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:58.808385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-117370f4-42f7-43f2-9923-9c6561b649be tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:58.808848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-117370f4-42f7-43f2-9923-9c6561b649be tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:58.846927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fcc1e62c-ada6-4df5-9539-898da4e41ec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:58.847849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fcc1e62c-ada6-4df5-9539-898da4e41ec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:58.855646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc1e62c-ada6-4df5-9539-898da4e41ec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:58.856092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc1e62c-ada6-4df5-9539-898da4e41ec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:58.856887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc1e62c-ada6-4df5-9539-898da4e41ec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:58.857381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc1e62c-ada6-4df5-9539-898da4e41ec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:58.885920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-117370f4-42f7-43f2-9923-9c6561b649be tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:58.891371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fcc1e62c-ada6-4df5-9539-898da4e41ec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049247 May 23 13:49:58.892128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 579/1078] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:58 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:49:58.894810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-117370f4-42f7-43f2-9923-9c6561b649be tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.099230 May 23 13:49:58.895402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 500/1079] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:58 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:49:59.113905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dede5d35-1533-416c-97ce-cf7dec57216f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:59.114851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dede5d35-1533-416c-97ce-cf7dec57216f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:59.122831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dede5d35-1533-416c-97ce-cf7dec57216f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:59.130353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dede5d35-1533-416c-97ce-cf7dec57216f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:59.130353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dede5d35-1533-416c-97ce-cf7dec57216f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:59.130353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dede5d35-1533-416c-97ce-cf7dec57216f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:59.158527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dede5d35-1533-416c-97ce-cf7dec57216f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048647 May 23 13:49:59.159147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 580/1080] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:59.904727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eb1a2108-e1fb-4235-8e5c-a1e1bbdc5fc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:59.906181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eb1a2108-e1fb-4235-8e5c-a1e1bbdc5fc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:59.913113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7be7cdd0-da40-4d75-9e1b-bc35f7b35937 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:49:59.913758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb1a2108-e1fb-4235-8e5c-a1e1bbdc5fc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:59.913758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb1a2108-e1fb-4235-8e5c-a1e1bbdc5fc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:59.914032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7be7cdd0-da40-4d75-9e1b-bc35f7b35937 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:49:59.914456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb1a2108-e1fb-4235-8e5c-a1e1bbdc5fc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:59.914977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb1a2108-e1fb-4235-8e5c-a1e1bbdc5fc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:59.922002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7be7cdd0-da40-4d75-9e1b-bc35f7b35937 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:59.922454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7be7cdd0-da40-4d75-9e1b-bc35f7b35937 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:59.923238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7be7cdd0-da40-4d75-9e1b-bc35f7b35937 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:49:59.923671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7be7cdd0-da40-4d75-9e1b-bc35f7b35937 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:49:59.947589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eb1a2108-e1fb-4235-8e5c-a1e1bbdc5fc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046873 May 23 13:49:59.948243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 501/1081] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:49:59 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:49:59.990666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7be7cdd0-da40-4d75-9e1b-bc35f7b35937 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:49:59.999030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7be7cdd0-da40-4d75-9e1b-bc35f7b35937 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.089726 May 23 13:49:59.999693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 581/1082] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:49:59 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:50:00.174042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb5562f8-d562-4ee6-9f13-496b4e89cd03 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:00.175477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb5562f8-d562-4ee6-9f13-496b4e89cd03 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:00.185681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb5562f8-d562-4ee6-9f13-496b4e89cd03 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:00.186861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb5562f8-d562-4ee6-9f13-496b4e89cd03 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:00.188300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb5562f8-d562-4ee6-9f13-496b4e89cd03 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:00.189093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb5562f8-d562-4ee6-9f13-496b4e89cd03 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:00.236270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:00.241244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb5562f8-d562-4ee6-9f13-496b4e89cd03 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074768 May 23 13:50:00.241833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 502/1083] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:00.960102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91a4fdc0-4a69-48eb-996e-6f2043667f27 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:00.961127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-91a4fdc0-4a69-48eb-996e-6f2043667f27 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:00.968595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91a4fdc0-4a69-48eb-996e-6f2043667f27 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:00.969058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91a4fdc0-4a69-48eb-996e-6f2043667f27 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:00.969842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91a4fdc0-4a69-48eb-996e-6f2043667f27 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:00.970284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91a4fdc0-4a69-48eb-996e-6f2043667f27 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:01.002701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-91a4fdc0-4a69-48eb-996e-6f2043667f27 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046591 May 23 13:50:01.003290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 582/1084] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:00 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:01.016638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d41dc00-6ffd-4096-93ce-02d813c58c23 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:01.017310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d41dc00-6ffd-4096-93ce-02d813c58c23 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:01.024665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d41dc00-6ffd-4096-93ce-02d813c58c23 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:01.025115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d41dc00-6ffd-4096-93ce-02d813c58c23 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:01.025967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d41dc00-6ffd-4096-93ce-02d813c58c23 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:01.026400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d41dc00-6ffd-4096-93ce-02d813c58c23 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:01.256951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fee0aeef-961c-4df9-8f05-087d065ebb16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:01.257807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fee0aeef-961c-4df9-8f05-087d065ebb16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:01.264778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fee0aeef-961c-4df9-8f05-087d065ebb16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:01.265729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fee0aeef-961c-4df9-8f05-087d065ebb16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:01.266527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fee0aeef-961c-4df9-8f05-087d065ebb16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:01.266971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fee0aeef-961c-4df9-8f05-087d065ebb16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:01.300832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fee0aeef-961c-4df9-8f05-087d065ebb16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047947 May 23 13:50:01.301425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 583/1085] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:50:01.349304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d41dc00-6ffd-4096-93ce-02d813c58c23 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:01.362869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d41dc00-6ffd-4096-93ce-02d813c58c23 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.349656 May 23 13:50:01.363788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 503/1086] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:01 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:02.013762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5977e88a-43fa-42a6-aebb-25e31a1ec733 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:02.014722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5977e88a-43fa-42a6-aebb-25e31a1ec733 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:02.022545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5977e88a-43fa-42a6-aebb-25e31a1ec733 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:02.023244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5977e88a-43fa-42a6-aebb-25e31a1ec733 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:02.024460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5977e88a-43fa-42a6-aebb-25e31a1ec733 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:02.025164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5977e88a-43fa-42a6-aebb-25e31a1ec733 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:02.059069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5977e88a-43fa-42a6-aebb-25e31a1ec733 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047943 May 23 13:50:02.059069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 584/1087] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:02 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:02.315334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-84871301-e03e-4510-a507-e2e3a1167274 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:02.316265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-84871301-e03e-4510-a507-e2e3a1167274 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:02.322999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84871301-e03e-4510-a507-e2e3a1167274 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:02.323443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84871301-e03e-4510-a507-e2e3a1167274 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:02.324222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84871301-e03e-4510-a507-e2e3a1167274 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:02.324691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84871301-e03e-4510-a507-e2e3a1167274 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:02.357051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-84871301-e03e-4510-a507-e2e3a1167274 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 May 23 13:50:02.357649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 504/1088] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:02.380810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ea1ea43e-68f3-45c2-8b58-7c512f9afb3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:02.381520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ea1ea43e-68f3-45c2-8b58-7c512f9afb3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:02.387704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea1ea43e-68f3-45c2-8b58-7c512f9afb3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:02.388160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea1ea43e-68f3-45c2-8b58-7c512f9afb3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:02.388962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea1ea43e-68f3-45c2-8b58-7c512f9afb3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:02.389428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea1ea43e-68f3-45c2-8b58-7c512f9afb3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:02.451396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ea1ea43e-68f3-45c2-8b58-7c512f9afb3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:02.459740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ea1ea43e-68f3-45c2-8b58-7c512f9afb3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082760 May 23 13:50:02.460263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 585/1089] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:02 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:03.069960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1cf703a3-4a6e-4c06-9204-1a5cc402ad5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:03.070875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1cf703a3-4a6e-4c06-9204-1a5cc402ad5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:03.078371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1cf703a3-4a6e-4c06-9204-1a5cc402ad5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:03.079041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1cf703a3-4a6e-4c06-9204-1a5cc402ad5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:03.080017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1cf703a3-4a6e-4c06-9204-1a5cc402ad5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:03.080448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1cf703a3-4a6e-4c06-9204-1a5cc402ad5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:03.110775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1cf703a3-4a6e-4c06-9204-1a5cc402ad5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 May 23 13:50:03.111328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 505/1090] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:03 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:03.370359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1b246cd9-ee98-4141-9e33-2a9769af478b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:03.371284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1b246cd9-ee98-4141-9e33-2a9769af478b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:03.378724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b246cd9-ee98-4141-9e33-2a9769af478b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:03.379167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b246cd9-ee98-4141-9e33-2a9769af478b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:03.379925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b246cd9-ee98-4141-9e33-2a9769af478b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:03.380358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b246cd9-ee98-4141-9e33-2a9769af478b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:03.409323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1b246cd9-ee98-4141-9e33-2a9769af478b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043119 May 23 13:50:03.424442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 586/1091] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:03.477422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d13df16-66f5-4208-92f3-64af9141d6ff tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:03.478058 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d13df16-66f5-4208-92f3-64af9141d6ff tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:03.485504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d13df16-66f5-4208-92f3-64af9141d6ff tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:03.485972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d13df16-66f5-4208-92f3-64af9141d6ff tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:03.486767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d13df16-66f5-4208-92f3-64af9141d6ff tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:03.487236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d13df16-66f5-4208-92f3-64af9141d6ff tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:03.551713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d13df16-66f5-4208-92f3-64af9141d6ff tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:03.559561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d13df16-66f5-4208-92f3-64af9141d6ff tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086014 May 23 13:50:03.560138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 506/1092] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:03 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:04.122874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-408b35f4-0815-40ce-98aa-289527ba75be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:04.124823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-408b35f4-0815-40ce-98aa-289527ba75be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:04.130731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-408b35f4-0815-40ce-98aa-289527ba75be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:04.131194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-408b35f4-0815-40ce-98aa-289527ba75be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:04.131976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-408b35f4-0815-40ce-98aa-289527ba75be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:04.132421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-408b35f4-0815-40ce-98aa-289527ba75be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:04.161796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-408b35f4-0815-40ce-98aa-289527ba75be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042943 May 23 13:50:04.162360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 587/1093] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:04 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:04.421286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0832be56-9782-4f90-a41b-b93537951276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:04.422121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0832be56-9782-4f90-a41b-b93537951276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:04.428265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0832be56-9782-4f90-a41b-b93537951276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:04.428757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0832be56-9782-4f90-a41b-b93537951276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:04.429530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0832be56-9782-4f90-a41b-b93537951276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:04.429964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0832be56-9782-4f90-a41b-b93537951276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:04.460966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0832be56-9782-4f90-a41b-b93537951276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043803 May 23 13:50:04.461546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 507/1094] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:04.577385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7ba3c88-b900-4323-a5ff-a82f4581b2e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:04.577987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7ba3c88-b900-4323-a5ff-a82f4581b2e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:04.584651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7ba3c88-b900-4323-a5ff-a82f4581b2e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:04.585103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7ba3c88-b900-4323-a5ff-a82f4581b2e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:04.585871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7ba3c88-b900-4323-a5ff-a82f4581b2e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:04.586301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7ba3c88-b900-4323-a5ff-a82f4581b2e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:04.653118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7ba3c88-b900-4323-a5ff-a82f4581b2e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:04.660856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7ba3c88-b900-4323-a5ff-a82f4581b2e1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088017 May 23 13:50:04.661421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 588/1095] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:04 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:05.174637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9b7dca44-aeda-411c-bea0-141983f1f2f9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:05.175564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9b7dca44-aeda-411c-bea0-141983f1f2f9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:05.182429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b7dca44-aeda-411c-bea0-141983f1f2f9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:05.182694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b7dca44-aeda-411c-bea0-141983f1f2f9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:05.183465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b7dca44-aeda-411c-bea0-141983f1f2f9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:05.183904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b7dca44-aeda-411c-bea0-141983f1f2f9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:05.217140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9b7dca44-aeda-411c-bea0-141983f1f2f9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047278 May 23 13:50:05.218536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 508/1096] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:05 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:05.474165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d9d7ef7-edfc-4315-ba75-95871bbe7ecd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:05.475043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d9d7ef7-edfc-4315-ba75-95871bbe7ecd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:05.481357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d9d7ef7-edfc-4315-ba75-95871bbe7ecd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:05.481815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d9d7ef7-edfc-4315-ba75-95871bbe7ecd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:05.482585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d9d7ef7-edfc-4315-ba75-95871bbe7ecd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:05.483081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d9d7ef7-edfc-4315-ba75-95871bbe7ecd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:05.511029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d9d7ef7-edfc-4315-ba75-95871bbe7ecd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 May 23 13:50:05.511587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 589/1097] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:05.679084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8fdbfac5-5b33-4656-af14-ec26d80eda88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:05.679730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8fdbfac5-5b33-4656-af14-ec26d80eda88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:05.685789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fdbfac5-5b33-4656-af14-ec26d80eda88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:05.686855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fdbfac5-5b33-4656-af14-ec26d80eda88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:05.687614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fdbfac5-5b33-4656-af14-ec26d80eda88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:05.688043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fdbfac5-5b33-4656-af14-ec26d80eda88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:05.763588 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8fdbfac5-5b33-4656-af14-ec26d80eda88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:05.771820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8fdbfac5-5b33-4656-af14-ec26d80eda88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.096655 May 23 13:50:05.772397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 509/1098] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:05 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:06.229246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0981b602-0885-4c31-aede-e85cf581e106 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:06.230167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0981b602-0885-4c31-aede-e85cf581e106 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:06.236870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0981b602-0885-4c31-aede-e85cf581e106 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:06.237298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0981b602-0885-4c31-aede-e85cf581e106 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:06.238061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0981b602-0885-4c31-aede-e85cf581e106 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:06.238496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0981b602-0885-4c31-aede-e85cf581e106 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:06.268148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0981b602-0885-4c31-aede-e85cf581e106 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042861 May 23 13:50:06.268729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 590/1099] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:06 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:06.524655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ba5b1b9-98c5-423d-9b84-7a6bbfc78ba4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:06.524655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ba5b1b9-98c5-423d-9b84-7a6bbfc78ba4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:06.531572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ba5b1b9-98c5-423d-9b84-7a6bbfc78ba4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:06.532015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ba5b1b9-98c5-423d-9b84-7a6bbfc78ba4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:06.532882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ba5b1b9-98c5-423d-9b84-7a6bbfc78ba4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:06.533317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ba5b1b9-98c5-423d-9b84-7a6bbfc78ba4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:06.566764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ba5b1b9-98c5-423d-9b84-7a6bbfc78ba4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 May 23 13:50:06.567790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 510/1100] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:06.789192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-af8f71a6-ef60-451b-bb49-2774ab4c3279 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:06.789736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-af8f71a6-ef60-451b-bb49-2774ab4c3279 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:06.795925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af8f71a6-ef60-451b-bb49-2774ab4c3279 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:06.796377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af8f71a6-ef60-451b-bb49-2774ab4c3279 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:06.797176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af8f71a6-ef60-451b-bb49-2774ab4c3279 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:06.797617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af8f71a6-ef60-451b-bb49-2774ab4c3279 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:06.863895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-af8f71a6-ef60-451b-bb49-2774ab4c3279 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:06.871465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-af8f71a6-ef60-451b-bb49-2774ab4c3279 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086620 May 23 13:50:06.872035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 591/1101] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:06 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:07.280634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb451eec-6435-4510-9fb0-002c8232142e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:07.281545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb451eec-6435-4510-9fb0-002c8232142e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:07.287669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb451eec-6435-4510-9fb0-002c8232142e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:07.288116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb451eec-6435-4510-9fb0-002c8232142e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:07.289089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb451eec-6435-4510-9fb0-002c8232142e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:07.289516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb451eec-6435-4510-9fb0-002c8232142e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:07.320149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb451eec-6435-4510-9fb0-002c8232142e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 May 23 13:50:07.320762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 511/1102] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:07 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:07.579902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e67d426e-0b19-4e3a-864c-6456b27bb4cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:07.580813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e67d426e-0b19-4e3a-864c-6456b27bb4cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:07.587469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e67d426e-0b19-4e3a-864c-6456b27bb4cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:07.587924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e67d426e-0b19-4e3a-864c-6456b27bb4cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:07.588736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e67d426e-0b19-4e3a-864c-6456b27bb4cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:07.589186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e67d426e-0b19-4e3a-864c-6456b27bb4cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:07.618502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e67d426e-0b19-4e3a-864c-6456b27bb4cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043319 May 23 13:50:07.619063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 592/1103] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:07.889145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-078e4ae0-30d0-459b-a4c4-4771e25343a8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:07.889767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-078e4ae0-30d0-459b-a4c4-4771e25343a8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:07.896481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-078e4ae0-30d0-459b-a4c4-4771e25343a8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:07.896968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-078e4ae0-30d0-459b-a4c4-4771e25343a8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:07.897745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-078e4ae0-30d0-459b-a4c4-4771e25343a8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:07.898188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-078e4ae0-30d0-459b-a4c4-4771e25343a8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:07.962930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-078e4ae0-30d0-459b-a4c4-4771e25343a8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:07.971732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-078e4ae0-30d0-459b-a4c4-4771e25343a8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086490 May 23 13:50:07.972328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 512/1104] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:07 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:08.332124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-afe16f2c-a6e9-4756-afdb-d999c3970e59 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:08.333164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-afe16f2c-a6e9-4756-afdb-d999c3970e59 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:08.339461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afe16f2c-a6e9-4756-afdb-d999c3970e59 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:08.340174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afe16f2c-a6e9-4756-afdb-d999c3970e59 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:08.341010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afe16f2c-a6e9-4756-afdb-d999c3970e59 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:08.341505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afe16f2c-a6e9-4756-afdb-d999c3970e59 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:08.373132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-afe16f2c-a6e9-4756-afdb-d999c3970e59 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 May 23 13:50:08.373737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 593/1105] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:08 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:08.631046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d7ac5109-028d-4cc1-b0cc-4b4ccd198db9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:08.632008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d7ac5109-028d-4cc1-b0cc-4b4ccd198db9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:08.638196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7ac5109-028d-4cc1-b0cc-4b4ccd198db9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:08.642178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7ac5109-028d-4cc1-b0cc-4b4ccd198db9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:08.642178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7ac5109-028d-4cc1-b0cc-4b4ccd198db9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:08.642178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7ac5109-028d-4cc1-b0cc-4b4ccd198db9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:08.671815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d7ac5109-028d-4cc1-b0cc-4b4ccd198db9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 May 23 13:50:08.672357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 513/1106] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:08.988269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fcc366fa-5654-4eb6-b973-0497ddf7c562 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:08.988860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fcc366fa-5654-4eb6-b973-0497ddf7c562 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:08.995585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc366fa-5654-4eb6-b973-0497ddf7c562 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:08.996033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc366fa-5654-4eb6-b973-0497ddf7c562 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:08.996845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc366fa-5654-4eb6-b973-0497ddf7c562 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:08.997360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcc366fa-5654-4eb6-b973-0497ddf7c562 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:09.062429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fcc366fa-5654-4eb6-b973-0497ddf7c562 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:09.070428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fcc366fa-5654-4eb6-b973-0497ddf7c562 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086151 May 23 13:50:09.071003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 594/1107] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:08 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:09.384704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55c711e7-2826-491e-a52d-256ff3a2d5d4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:09.385635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55c711e7-2826-491e-a52d-256ff3a2d5d4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:09.392762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55c711e7-2826-491e-a52d-256ff3a2d5d4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:09.393205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55c711e7-2826-491e-a52d-256ff3a2d5d4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:09.393969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55c711e7-2826-491e-a52d-256ff3a2d5d4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:09.394391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55c711e7-2826-491e-a52d-256ff3a2d5d4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:09.427447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55c711e7-2826-491e-a52d-256ff3a2d5d4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046874 May 23 13:50:09.428024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 514/1108] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:09 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:09.683745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ea4702fd-d26f-445a-8f3f-684a3816f592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:09.684608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ea4702fd-d26f-445a-8f3f-684a3816f592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:09.688101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:09.691597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea4702fd-d26f-445a-8f3f-684a3816f592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:09.692055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea4702fd-d26f-445a-8f3f-684a3816f592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:09.692851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea4702fd-d26f-445a-8f3f-684a3816f592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:09.693294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea4702fd-d26f-445a-8f3f-684a3816f592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:09.713267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:09.727202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ea4702fd-d26f-445a-8f3f-684a3816f592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047610 May 23 13:50:09.727783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 595/1109] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:10.087653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7d3fe89e-6ddd-4bac-b3d9-682deef5637f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:10.088181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7d3fe89e-6ddd-4bac-b3d9-682deef5637f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:10.095598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d3fe89e-6ddd-4bac-b3d9-682deef5637f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:10.096054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d3fe89e-6ddd-4bac-b3d9-682deef5637f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:10.096926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d3fe89e-6ddd-4bac-b3d9-682deef5637f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:10.097361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d3fe89e-6ddd-4bac-b3d9-682deef5637f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:10.168479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7d3fe89e-6ddd-4bac-b3d9-682deef5637f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:10.177274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7d3fe89e-6ddd-4bac-b3d9-682deef5637f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093544 May 23 13:50:10.177863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 515/1110] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:10 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:50:10.440884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-96681aaa-8207-4d15-995f-a3b5eb7b74d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:10.441826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-96681aaa-8207-4d15-995f-a3b5eb7b74d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:10.449065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96681aaa-8207-4d15-995f-a3b5eb7b74d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:10.449523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96681aaa-8207-4d15-995f-a3b5eb7b74d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:10.450300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96681aaa-8207-4d15-995f-a3b5eb7b74d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:10.450738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96681aaa-8207-4d15-995f-a3b5eb7b74d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:10.484110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-96681aaa-8207-4d15-995f-a3b5eb7b74d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047234 May 23 13:50:10.484697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 596/1111] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:10 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:10.739317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1fb0689-3746-4e80-a110-a06ae664e4de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:10.740193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1fb0689-3746-4e80-a110-a06ae664e4de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:10.747083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1fb0689-3746-4e80-a110-a06ae664e4de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:10.747529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1fb0689-3746-4e80-a110-a06ae664e4de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:10.748299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1fb0689-3746-4e80-a110-a06ae664e4de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:10.748782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1fb0689-3746-4e80-a110-a06ae664e4de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:10.780454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1fb0689-3746-4e80-a110-a06ae664e4de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 May 23 13:50:10.781054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 516/1112] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:11.195166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bac4fd2b-bb22-496e-89dd-cb5fcc028b2b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:11.195780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bac4fd2b-bb22-496e-89dd-cb5fcc028b2b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:11.204342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bac4fd2b-bb22-496e-89dd-cb5fcc028b2b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:11.204829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bac4fd2b-bb22-496e-89dd-cb5fcc028b2b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:11.205628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bac4fd2b-bb22-496e-89dd-cb5fcc028b2b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:11.206098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bac4fd2b-bb22-496e-89dd-cb5fcc028b2b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:11.278737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bac4fd2b-bb22-496e-89dd-cb5fcc028b2b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:11.286509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bac4fd2b-bb22-496e-89dd-cb5fcc028b2b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.095339 May 23 13:50:11.287074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 597/1113] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:11 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:11.496106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9af48611-289e-4e5a-abb2-2e421b858f71 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:11.496965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9af48611-289e-4e5a-abb2-2e421b858f71 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:11.503600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9af48611-289e-4e5a-abb2-2e421b858f71 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:11.504044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9af48611-289e-4e5a-abb2-2e421b858f71 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:11.504900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9af48611-289e-4e5a-abb2-2e421b858f71 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:11.505340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9af48611-289e-4e5a-abb2-2e421b858f71 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:11.535387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9af48611-289e-4e5a-abb2-2e421b858f71 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043293 May 23 13:50:11.535954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 517/1114] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:11 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:11.792412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e909427f-4e14-4e59-9841-57d77954e8f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:11.793358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e909427f-4e14-4e59-9841-57d77954e8f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:11.800621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e909427f-4e14-4e59-9841-57d77954e8f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:11.801079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e909427f-4e14-4e59-9841-57d77954e8f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:11.801929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e909427f-4e14-4e59-9841-57d77954e8f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:11.802492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e909427f-4e14-4e59-9841-57d77954e8f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:11.833934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e909427f-4e14-4e59-9841-57d77954e8f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 May 23 13:50:11.834485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 598/1115] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:12.304129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-37b9347c-fd99-407c-bf62-5640e4dfeda8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:12.304772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-37b9347c-fd99-407c-bf62-5640e4dfeda8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:12.311936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37b9347c-fd99-407c-bf62-5640e4dfeda8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:12.312383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37b9347c-fd99-407c-bf62-5640e4dfeda8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:12.313182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37b9347c-fd99-407c-bf62-5640e4dfeda8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:12.313615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37b9347c-fd99-407c-bf62-5640e4dfeda8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:12.376586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-37b9347c-fd99-407c-bf62-5640e4dfeda8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:12.384115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-37b9347c-fd99-407c-bf62-5640e4dfeda8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084054 May 23 13:50:12.384713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 518/1116] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:12 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:12.548801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5130e503-1a27-4f66-95f4-268fc4cddda7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:12.549654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5130e503-1a27-4f66-95f4-268fc4cddda7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:12.555669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5130e503-1a27-4f66-95f4-268fc4cddda7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:12.556125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5130e503-1a27-4f66-95f4-268fc4cddda7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:12.556935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5130e503-1a27-4f66-95f4-268fc4cddda7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:12.557382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5130e503-1a27-4f66-95f4-268fc4cddda7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:12.586711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5130e503-1a27-4f66-95f4-268fc4cddda7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 May 23 13:50:12.587279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 599/1117] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:12 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:12.846016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d134a3d-5ee1-47fb-9417-f0f60f52eab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:12.846985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d134a3d-5ee1-47fb-9417-f0f60f52eab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:12.853246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d134a3d-5ee1-47fb-9417-f0f60f52eab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:12.853691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d134a3d-5ee1-47fb-9417-f0f60f52eab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:12.854453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d134a3d-5ee1-47fb-9417-f0f60f52eab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:12.854888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d134a3d-5ee1-47fb-9417-f0f60f52eab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:12.871389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:12.884485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d134a3d-5ee1-47fb-9417-f0f60f52eab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042630 May 23 13:50:12.885081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 519/1118] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:13.401121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fbe0fc9b-5445-4d1f-a990-26e1d23bdda3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:13.401729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fbe0fc9b-5445-4d1f-a990-26e1d23bdda3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:13.408826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbe0fc9b-5445-4d1f-a990-26e1d23bdda3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:13.409272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbe0fc9b-5445-4d1f-a990-26e1d23bdda3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:13.410028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbe0fc9b-5445-4d1f-a990-26e1d23bdda3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:13.410458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fbe0fc9b-5445-4d1f-a990-26e1d23bdda3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:13.472134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fbe0fc9b-5445-4d1f-a990-26e1d23bdda3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:13.479715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fbe0fc9b-5445-4d1f-a990-26e1d23bdda3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082479 May 23 13:50:13.480280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 600/1119] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:13 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:13.599935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2faa80c5-9e3a-4f01-b978-a7664a29e4ef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:13.600910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2faa80c5-9e3a-4f01-b978-a7664a29e4ef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:13.603287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=99 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:13.609373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2faa80c5-9e3a-4f01-b978-a7664a29e4ef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:13.615110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2faa80c5-9e3a-4f01-b978-a7664a29e4ef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:13.615110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2faa80c5-9e3a-4f01-b978-a7664a29e4ef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:13.615110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2faa80c5-9e3a-4f01-b978-a7664a29e4ef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:13.643006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2faa80c5-9e3a-4f01-b978-a7664a29e4ef tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047319 May 23 13:50:13.643573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 520/1120] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:13 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:13.896097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f90e7898-d459-4af8-a574-ec630ce2794d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:13.897036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f90e7898-d459-4af8-a574-ec630ce2794d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:13.903275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f90e7898-d459-4af8-a574-ec630ce2794d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:13.903721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f90e7898-d459-4af8-a574-ec630ce2794d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:13.905224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f90e7898-d459-4af8-a574-ec630ce2794d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:13.905756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f90e7898-d459-4af8-a574-ec630ce2794d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:13.934005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f90e7898-d459-4af8-a574-ec630ce2794d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041868 May 23 13:50:13.934599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 601/1121] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:14.496741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b20b5eb7-57dc-4e4a-8cab-d2ad97be43e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:14.497270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b20b5eb7-57dc-4e4a-8cab-d2ad97be43e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:14.503487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b20b5eb7-57dc-4e4a-8cab-d2ad97be43e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:14.503940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b20b5eb7-57dc-4e4a-8cab-d2ad97be43e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:14.504724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b20b5eb7-57dc-4e4a-8cab-d2ad97be43e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:14.505156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b20b5eb7-57dc-4e4a-8cab-d2ad97be43e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:14.567174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b20b5eb7-57dc-4e4a-8cab-d2ad97be43e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:14.574850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b20b5eb7-57dc-4e4a-8cab-d2ad97be43e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082153 May 23 13:50:14.575412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 521/1122] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:14 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:14.654858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d5207521-96b0-4c3d-bd7c-18b00e7d807c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:14.655774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d5207521-96b0-4c3d-bd7c-18b00e7d807c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:14.662364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5207521-96b0-4c3d-bd7c-18b00e7d807c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:14.662816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5207521-96b0-4c3d-bd7c-18b00e7d807c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:14.663606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5207521-96b0-4c3d-bd7c-18b00e7d807c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:14.664045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5207521-96b0-4c3d-bd7c-18b00e7d807c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:14.694055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d5207521-96b0-4c3d-bd7c-18b00e7d807c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043212 May 23 13:50:14.694607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 602/1123] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:14 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:14.945780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c4b6b58f-a7ca-49e7-bdc1-489daea5b812 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:14.946707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c4b6b58f-a7ca-49e7-bdc1-489daea5b812 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:14.953917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b6b58f-a7ca-49e7-bdc1-489daea5b812 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:14.954370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b6b58f-a7ca-49e7-bdc1-489daea5b812 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:14.955138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b6b58f-a7ca-49e7-bdc1-489daea5b812 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:14.955578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b6b58f-a7ca-49e7-bdc1-489daea5b812 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:14.986013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c4b6b58f-a7ca-49e7-bdc1-489daea5b812 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 May 23 13:50:14.986576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 522/1124] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:15.593983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eaabb56c-2ee6-4dca-bfdc-333f7e915663 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:15.594511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eaabb56c-2ee6-4dca-bfdc-333f7e915663 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:15.600720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eaabb56c-2ee6-4dca-bfdc-333f7e915663 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:15.601178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eaabb56c-2ee6-4dca-bfdc-333f7e915663 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:15.601949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eaabb56c-2ee6-4dca-bfdc-333f7e915663 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:15.602388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eaabb56c-2ee6-4dca-bfdc-333f7e915663 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:15.666404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eaabb56c-2ee6-4dca-bfdc-333f7e915663 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:15.674938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eaabb56c-2ee6-4dca-bfdc-333f7e915663 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086449 May 23 13:50:15.675519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 603/1125] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:15 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:15.706386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-722da616-e19c-48d0-8dfc-a7872ec2548b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:15.707309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-722da616-e19c-48d0-8dfc-a7872ec2548b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:15.713357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-722da616-e19c-48d0-8dfc-a7872ec2548b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:15.713809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-722da616-e19c-48d0-8dfc-a7872ec2548b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:15.714835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-722da616-e19c-48d0-8dfc-a7872ec2548b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:15.715271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-722da616-e19c-48d0-8dfc-a7872ec2548b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:15.745998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-722da616-e19c-48d0-8dfc-a7872ec2548b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 May 23 13:50:15.746564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 523/1126] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:15 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:15.997754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48849504-8f7f-4684-8305-b46309bc1f10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:15.998678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-48849504-8f7f-4684-8305-b46309bc1f10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:16.004961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48849504-8f7f-4684-8305-b46309bc1f10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:16.005411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48849504-8f7f-4684-8305-b46309bc1f10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:16.006170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48849504-8f7f-4684-8305-b46309bc1f10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:16.006597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48849504-8f7f-4684-8305-b46309bc1f10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:16.037017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48849504-8f7f-4684-8305-b46309bc1f10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043144 May 23 13:50:16.037587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 604/1127] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:16.692296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f563ff72-7b58-4749-ba51-0a20282595e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:16.692953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f563ff72-7b58-4749-ba51-0a20282595e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:16.699494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f563ff72-7b58-4749-ba51-0a20282595e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:16.699942 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f563ff72-7b58-4749-ba51-0a20282595e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:16.700758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f563ff72-7b58-4749-ba51-0a20282595e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:16.701284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f563ff72-7b58-4749-ba51-0a20282595e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:16.757872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d50a0275-1702-4d60-bf44-0a54b83109a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:16.758969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d50a0275-1702-4d60-bf44-0a54b83109a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:16.772965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d50a0275-1702-4d60-bf44-0a54b83109a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:16.772965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d50a0275-1702-4d60-bf44-0a54b83109a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:16.773228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f563ff72-7b58-4749-ba51-0a20282595e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:16.773362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d50a0275-1702-4d60-bf44-0a54b83109a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:16.773362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d50a0275-1702-4d60-bf44-0a54b83109a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:16.776219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f563ff72-7b58-4749-ba51-0a20282595e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087745 May 23 13:50:16.776837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 524/1128] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:16 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:16.799491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d50a0275-1702-4d60-bf44-0a54b83109a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 May 23 13:50:16.800062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 605/1129] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:16 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:50:17.050343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6c8f9c9a-23fd-41d8-b2b2-267fd59a15c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:17.051178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6c8f9c9a-23fd-41d8-b2b2-267fd59a15c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:17.057308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c8f9c9a-23fd-41d8-b2b2-267fd59a15c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:17.057736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c8f9c9a-23fd-41d8-b2b2-267fd59a15c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:17.058498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c8f9c9a-23fd-41d8-b2b2-267fd59a15c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:17.058928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c8f9c9a-23fd-41d8-b2b2-267fd59a15c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:17.088786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6c8f9c9a-23fd-41d8-b2b2-267fd59a15c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 May 23 13:50:17.089339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 525/1130] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:17.793747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-09ddb1ff-ec06-4016-8b07-3b28d36d18eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:17.794365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09ddb1ff-ec06-4016-8b07-3b28d36d18eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:17.801686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09ddb1ff-ec06-4016-8b07-3b28d36d18eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:17.802141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09ddb1ff-ec06-4016-8b07-3b28d36d18eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:17.802917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09ddb1ff-ec06-4016-8b07-3b28d36d18eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:17.803357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09ddb1ff-ec06-4016-8b07-3b28d36d18eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:17.810366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8efa9ad2-65d4-4af0-ac17-200108f9b435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:17.811489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8efa9ad2-65d4-4af0-ac17-200108f9b435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:17.817701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8efa9ad2-65d4-4af0-ac17-200108f9b435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:17.818154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8efa9ad2-65d4-4af0-ac17-200108f9b435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:17.818929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8efa9ad2-65d4-4af0-ac17-200108f9b435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:17.819360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8efa9ad2-65d4-4af0-ac17-200108f9b435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:17.849717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8efa9ad2-65d4-4af0-ac17-200108f9b435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 May 23 13:50:17.850297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 526/1131] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:17 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:50:17.867090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-09ddb1ff-ec06-4016-8b07-3b28d36d18eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:17.874750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-09ddb1ff-ec06-4016-8b07-3b28d36d18eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084869 May 23 13:50:17.875315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 606/1132] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:17 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:18.102056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b08d89cd-9934-438d-b028-4b7e3f8f99c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:18.102898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b08d89cd-9934-438d-b028-4b7e3f8f99c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:18.108977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b08d89cd-9934-438d-b028-4b7e3f8f99c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:18.109443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b08d89cd-9934-438d-b028-4b7e3f8f99c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:18.110192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b08d89cd-9934-438d-b028-4b7e3f8f99c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:18.110630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b08d89cd-9934-438d-b028-4b7e3f8f99c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:18.140258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b08d89cd-9934-438d-b028-4b7e3f8f99c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042192 May 23 13:50:18.140849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 527/1133] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:18.861993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0625ecc1-5df4-4f66-8745-563d05fec84f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:18.862920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0625ecc1-5df4-4f66-8745-563d05fec84f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:18.869493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0625ecc1-5df4-4f66-8745-563d05fec84f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:18.869980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0625ecc1-5df4-4f66-8745-563d05fec84f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:18.870757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0625ecc1-5df4-4f66-8745-563d05fec84f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:18.871199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0625ecc1-5df4-4f66-8745-563d05fec84f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:18.891910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1062f1bf-a9cf-4070-92b7-1764ed4106d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:18.892521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1062f1bf-a9cf-4070-92b7-1764ed4106d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:18.899041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1062f1bf-a9cf-4070-92b7-1764ed4106d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:18.899489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1062f1bf-a9cf-4070-92b7-1764ed4106d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:18.900326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1062f1bf-a9cf-4070-92b7-1764ed4106d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:18.900794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1062f1bf-a9cf-4070-92b7-1764ed4106d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:18.902460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0625ecc1-5df4-4f66-8745-563d05fec84f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 May 23 13:50:18.903257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 607/1134] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:18 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:18.966272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1062f1bf-a9cf-4070-92b7-1764ed4106d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:18.974461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1062f1bf-a9cf-4070-92b7-1764ed4106d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087065 May 23 13:50:18.975040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 528/1135] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:18 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:50:19.151598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9d40c08-73e5-4150-8f20-100232bed502 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:19.152607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9d40c08-73e5-4150-8f20-100232bed502 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:19.159012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9d40c08-73e5-4150-8f20-100232bed502 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:19.159454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9d40c08-73e5-4150-8f20-100232bed502 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:19.160210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9d40c08-73e5-4150-8f20-100232bed502 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:19.160672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9d40c08-73e5-4150-8f20-100232bed502 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:19.194791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9d40c08-73e5-4150-8f20-100232bed502 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047188 May 23 13:50:19.195369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 608/1136] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:19.914676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0366062e-e747-4ea5-bc1d-ef4fe78c6ef1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:19.915498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0366062e-e747-4ea5-bc1d-ef4fe78c6ef1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:19.922646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0366062e-e747-4ea5-bc1d-ef4fe78c6ef1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:19.923093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0366062e-e747-4ea5-bc1d-ef4fe78c6ef1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:19.923854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0366062e-e747-4ea5-bc1d-ef4fe78c6ef1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:19.924288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0366062e-e747-4ea5-bc1d-ef4fe78c6ef1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:19.953469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0366062e-e747-4ea5-bc1d-ef4fe78c6ef1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042805 May 23 13:50:19.954029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 529/1137] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:19 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:19.993002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ff1c546-3e7e-4d02-94d0-336bf1c92028 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:19.993631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3ff1c546-3e7e-4d02-94d0-336bf1c92028 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:20.000580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ff1c546-3e7e-4d02-94d0-336bf1c92028 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:20.001043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ff1c546-3e7e-4d02-94d0-336bf1c92028 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:20.001821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ff1c546-3e7e-4d02-94d0-336bf1c92028 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:20.002265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ff1c546-3e7e-4d02-94d0-336bf1c92028 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:20.064680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ff1c546-3e7e-4d02-94d0-336bf1c92028 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:20.072372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ff1c546-3e7e-4d02-94d0-336bf1c92028 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083828 May 23 13:50:20.072985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 609/1138] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:19 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:20.207063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ece6caca-2e4c-4633-8c73-f6ae7033d45c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:20.207988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ece6caca-2e4c-4633-8c73-f6ae7033d45c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:20.214103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ece6caca-2e4c-4633-8c73-f6ae7033d45c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:20.214815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ece6caca-2e4c-4633-8c73-f6ae7033d45c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:20.215578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ece6caca-2e4c-4633-8c73-f6ae7033d45c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:20.216019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ece6caca-2e4c-4633-8c73-f6ae7033d45c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:20.245579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ece6caca-2e4c-4633-8c73-f6ae7033d45c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 May 23 13:50:20.246135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 530/1139] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:20.965708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-597d5de3-cfa7-4506-bedb-7726ff82cc57 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:20.967341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-597d5de3-cfa7-4506-bedb-7726ff82cc57 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:20.973383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-597d5de3-cfa7-4506-bedb-7726ff82cc57 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:20.973830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-597d5de3-cfa7-4506-bedb-7726ff82cc57 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:20.974625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-597d5de3-cfa7-4506-bedb-7726ff82cc57 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:20.975066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-597d5de3-cfa7-4506-bedb-7726ff82cc57 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:21.005252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-597d5de3-cfa7-4506-bedb-7726ff82cc57 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 May 23 13:50:21.005940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 610/1140] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:20 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:21.091263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-456446d6-7c26-4ada-9075-25efe3645a70 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:21.091891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-456446d6-7c26-4ada-9075-25efe3645a70 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:21.098442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-456446d6-7c26-4ada-9075-25efe3645a70 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:21.098885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-456446d6-7c26-4ada-9075-25efe3645a70 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:21.099637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-456446d6-7c26-4ada-9075-25efe3645a70 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:21.100064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-456446d6-7c26-4ada-9075-25efe3645a70 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:21.162525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-456446d6-7c26-4ada-9075-25efe3645a70 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:21.170909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-456446d6-7c26-4ada-9075-25efe3645a70 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084147 May 23 13:50:21.171488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 531/1141] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:21 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:21.258192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e94ccd71-c46e-403b-9b18-da4f8e515dc5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:21.259074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e94ccd71-c46e-403b-9b18-da4f8e515dc5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:21.265578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e94ccd71-c46e-403b-9b18-da4f8e515dc5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:21.266035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e94ccd71-c46e-403b-9b18-da4f8e515dc5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:21.266822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e94ccd71-c46e-403b-9b18-da4f8e515dc5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:21.267542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e94ccd71-c46e-403b-9b18-da4f8e515dc5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:21.298869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e94ccd71-c46e-403b-9b18-da4f8e515dc5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 May 23 13:50:21.299442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 611/1142] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:22.017855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-00cbb973-34b2-4b66-b8e7-d8d9ba5b94a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:22.018713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-00cbb973-34b2-4b66-b8e7-d8d9ba5b94a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:22.024759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00cbb973-34b2-4b66-b8e7-d8d9ba5b94a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:22.025202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00cbb973-34b2-4b66-b8e7-d8d9ba5b94a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:22.025972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00cbb973-34b2-4b66-b8e7-d8d9ba5b94a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:22.026376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00cbb973-34b2-4b66-b8e7-d8d9ba5b94a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:22.058720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-00cbb973-34b2-4b66-b8e7-d8d9ba5b94a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045345 May 23 13:50:22.059284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 532/1143] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:22 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:22.189800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c55cc2b-8ffa-4dac-808c-02bc6b3b0c1e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:22.190429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c55cc2b-8ffa-4dac-808c-02bc6b3b0c1e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:22.197139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c55cc2b-8ffa-4dac-808c-02bc6b3b0c1e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:22.197597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c55cc2b-8ffa-4dac-808c-02bc6b3b0c1e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:22.198373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c55cc2b-8ffa-4dac-808c-02bc6b3b0c1e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:22.198816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c55cc2b-8ffa-4dac-808c-02bc6b3b0c1e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:22.203549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:22.261623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c55cc2b-8ffa-4dac-808c-02bc6b3b0c1e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:22.270352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c55cc2b-8ffa-4dac-808c-02bc6b3b0c1e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085689 May 23 13:50:22.270858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 612/1144] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:22 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:22.311899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b463d83a-c6ed-4428-ae19-605a2c84ab17 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:22.312846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b463d83a-c6ed-4428-ae19-605a2c84ab17 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:22.319300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b463d83a-c6ed-4428-ae19-605a2c84ab17 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:22.319750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b463d83a-c6ed-4428-ae19-605a2c84ab17 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:22.320636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b463d83a-c6ed-4428-ae19-605a2c84ab17 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:22.320967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b463d83a-c6ed-4428-ae19-605a2c84ab17 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:22.351522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b463d83a-c6ed-4428-ae19-605a2c84ab17 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 May 23 13:50:22.352067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 533/1145] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:23.071386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-80f90475-a981-4e05-a520-e1f6ff4d21ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:23.072228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-80f90475-a981-4e05-a520-e1f6ff4d21ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:23.078925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80f90475-a981-4e05-a520-e1f6ff4d21ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:23.079410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80f90475-a981-4e05-a520-e1f6ff4d21ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:23.080183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80f90475-a981-4e05-a520-e1f6ff4d21ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:23.080651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80f90475-a981-4e05-a520-e1f6ff4d21ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:23.114543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-80f90475-a981-4e05-a520-e1f6ff4d21ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047333 May 23 13:50:23.115118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 613/1146] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:23 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:23.288063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-136117ad-3120-4df1-a6f9-334a8dd5a9ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:23.288736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-136117ad-3120-4df1-a6f9-334a8dd5a9ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:23.296036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-136117ad-3120-4df1-a6f9-334a8dd5a9ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:23.296487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-136117ad-3120-4df1-a6f9-334a8dd5a9ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:23.297295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-136117ad-3120-4df1-a6f9-334a8dd5a9ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:23.297730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-136117ad-3120-4df1-a6f9-334a8dd5a9ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:23.363832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f20e609-fe05-415c-a481-391f23d36989 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:23.364793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f20e609-fe05-415c-a481-391f23d36989 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:23.368742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-136117ad-3120-4df1-a6f9-334a8dd5a9ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:23.371356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f20e609-fe05-415c-a481-391f23d36989 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:23.371820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f20e609-fe05-415c-a481-391f23d36989 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:23.373248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f20e609-fe05-415c-a481-391f23d36989 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:23.373709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f20e609-fe05-415c-a481-391f23d36989 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:23.376259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-136117ad-3120-4df1-a6f9-334a8dd5a9ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092073 May 23 13:50:23.376867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 534/1147] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:23 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:23.407006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f20e609-fe05-415c-a481-391f23d36989 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047060 May 23 13:50:23.407579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 614/1148] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:50:24.126831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6608d096-597d-484e-9508-a455c137834a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:24.127758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6608d096-597d-484e-9508-a455c137834a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:24.134106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6608d096-597d-484e-9508-a455c137834a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:24.134546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6608d096-597d-484e-9508-a455c137834a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:24.135308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6608d096-597d-484e-9508-a455c137834a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:24.135829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6608d096-597d-484e-9508-a455c137834a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:24.167079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6608d096-597d-484e-9508-a455c137834a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 May 23 13:50:24.167636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 535/1149] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:24 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:24.394144 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e37f58da-5aa7-4595-8144-f7113bb64686 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:24.394787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e37f58da-5aa7-4595-8144-f7113bb64686 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:24.401326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e37f58da-5aa7-4595-8144-f7113bb64686 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:24.401777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e37f58da-5aa7-4595-8144-f7113bb64686 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:24.402545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e37f58da-5aa7-4595-8144-f7113bb64686 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:24.402984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e37f58da-5aa7-4595-8144-f7113bb64686 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:24.418763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99a3974b-ac50-45ac-97f5-4609e8283e91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:24.419865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99a3974b-ac50-45ac-97f5-4609e8283e91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:24.426239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99a3974b-ac50-45ac-97f5-4609e8283e91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:24.426687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99a3974b-ac50-45ac-97f5-4609e8283e91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:24.427457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99a3974b-ac50-45ac-97f5-4609e8283e91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:24.427896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99a3974b-ac50-45ac-97f5-4609e8283e91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:24.431647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:24.458083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99a3974b-ac50-45ac-97f5-4609e8283e91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043230 May 23 13:50:24.458661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 536/1150] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:50:24.469907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e37f58da-5aa7-4595-8144-f7113bb64686 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:24.477653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e37f58da-5aa7-4595-8144-f7113bb64686 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087353 May 23 13:50:24.478210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 615/1151] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:24 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:25.179303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1646cd33-76a3-4597-9070-1ef58cf7eec4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:25.180229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1646cd33-76a3-4597-9070-1ef58cf7eec4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:25.187703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1646cd33-76a3-4597-9070-1ef58cf7eec4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:25.188151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1646cd33-76a3-4597-9070-1ef58cf7eec4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:25.188949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1646cd33-76a3-4597-9070-1ef58cf7eec4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:25.189387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1646cd33-76a3-4597-9070-1ef58cf7eec4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:25.219237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1646cd33-76a3-4597-9070-1ef58cf7eec4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 May 23 13:50:25.219793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 537/1152] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:25 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:25.470632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2df7a9d1-77cb-4e8d-9c43-d8060b7edb83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:25.471470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2df7a9d1-77cb-4e8d-9c43-d8060b7edb83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:25.478041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2df7a9d1-77cb-4e8d-9c43-d8060b7edb83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:25.478487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2df7a9d1-77cb-4e8d-9c43-d8060b7edb83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:25.479252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2df7a9d1-77cb-4e8d-9c43-d8060b7edb83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:25.479692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2df7a9d1-77cb-4e8d-9c43-d8060b7edb83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:25.495708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-845b4d6e-d490-4fe2-a09c-c2325ad1f040 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:25.496318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-845b4d6e-d490-4fe2-a09c-c2325ad1f040 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:25.502824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-845b4d6e-d490-4fe2-a09c-c2325ad1f040 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:25.503265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-845b4d6e-d490-4fe2-a09c-c2325ad1f040 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:25.504040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-845b4d6e-d490-4fe2-a09c-c2325ad1f040 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:25.504621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-845b4d6e-d490-4fe2-a09c-c2325ad1f040 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:25.510870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2df7a9d1-77cb-4e8d-9c43-d8060b7edb83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 May 23 13:50:25.511440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 616/1153] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:25.569810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-845b4d6e-d490-4fe2-a09c-c2325ad1f040 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:25.577625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-845b4d6e-d490-4fe2-a09c-c2325ad1f040 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086787 May 23 13:50:25.578191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 538/1154] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:25 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:50:26.230972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fd7b5951-1f17-4a6a-9377-d87d8525c348 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:26.232027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fd7b5951-1f17-4a6a-9377-d87d8525c348 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:26.238054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b5951-1f17-4a6a-9377-d87d8525c348 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:26.238593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b5951-1f17-4a6a-9377-d87d8525c348 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:26.239346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b5951-1f17-4a6a-9377-d87d8525c348 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:26.239780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd7b5951-1f17-4a6a-9377-d87d8525c348 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:26.271610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fd7b5951-1f17-4a6a-9377-d87d8525c348 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 May 23 13:50:26.272203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 617/1155] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:26 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:26.523023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f53136c7-005f-4d84-9103-44db900a4f50 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:26.523864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f53136c7-005f-4d84-9103-44db900a4f50 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:26.530771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53136c7-005f-4d84-9103-44db900a4f50 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:26.531209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53136c7-005f-4d84-9103-44db900a4f50 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:26.531965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53136c7-005f-4d84-9103-44db900a4f50 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:26.532394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53136c7-005f-4d84-9103-44db900a4f50 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:26.561989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f53136c7-005f-4d84-9103-44db900a4f50 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 May 23 13:50:26.562545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 539/1156] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:26.594933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4a707e6d-fedc-4d71-a588-a29bde920940 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:26.595692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4a707e6d-fedc-4d71-a588-a29bde920940 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:26.602249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a707e6d-fedc-4d71-a588-a29bde920940 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:26.602699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a707e6d-fedc-4d71-a588-a29bde920940 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:26.603477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a707e6d-fedc-4d71-a588-a29bde920940 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:26.603914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a707e6d-fedc-4d71-a588-a29bde920940 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:26.667881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4a707e6d-fedc-4d71-a588-a29bde920940 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:26.676208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4a707e6d-fedc-4d71-a588-a29bde920940 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085382 May 23 13:50:26.676801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 618/1157] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:26 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:27.283868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d6e92064-8f65-4ad6-81ab-76f5c2071485 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:27.284829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d6e92064-8f65-4ad6-81ab-76f5c2071485 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:27.290945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6e92064-8f65-4ad6-81ab-76f5c2071485 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:27.291396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6e92064-8f65-4ad6-81ab-76f5c2071485 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:27.292157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6e92064-8f65-4ad6-81ab-76f5c2071485 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:27.292620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6e92064-8f65-4ad6-81ab-76f5c2071485 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:27.321279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d6e92064-8f65-4ad6-81ab-76f5c2071485 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 May 23 13:50:27.321752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 540/1158] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:27 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:27.574086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1cb0e5b0-b9f3-4157-b11a-48e5e561ef28 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:27.574930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1cb0e5b0-b9f3-4157-b11a-48e5e561ef28 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:27.582248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1cb0e5b0-b9f3-4157-b11a-48e5e561ef28 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:27.582702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1cb0e5b0-b9f3-4157-b11a-48e5e561ef28 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:27.583529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1cb0e5b0-b9f3-4157-b11a-48e5e561ef28 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:27.583972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1cb0e5b0-b9f3-4157-b11a-48e5e561ef28 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:27.615138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1cb0e5b0-b9f3-4157-b11a-48e5e561ef28 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 May 23 13:50:27.615993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 619/1159] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:27.692988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6cd14fab-b566-462c-9089-69c9289e8489 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:27.693592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6cd14fab-b566-462c-9089-69c9289e8489 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:27.700111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cd14fab-b566-462c-9089-69c9289e8489 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:27.701180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cd14fab-b566-462c-9089-69c9289e8489 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:27.701996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cd14fab-b566-462c-9089-69c9289e8489 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:27.702422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cd14fab-b566-462c-9089-69c9289e8489 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:27.767070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6cd14fab-b566-462c-9089-69c9289e8489 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:27.775126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6cd14fab-b566-462c-9089-69c9289e8489 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086037 May 23 13:50:27.775688 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 541/1160] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:27 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:28.333060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92f15cc5-fe10-4f52-8884-0ed5db3988f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:28.333973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92f15cc5-fe10-4f52-8884-0ed5db3988f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:28.340319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92f15cc5-fe10-4f52-8884-0ed5db3988f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:28.341289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92f15cc5-fe10-4f52-8884-0ed5db3988f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:28.342066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92f15cc5-fe10-4f52-8884-0ed5db3988f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:28.342497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92f15cc5-fe10-4f52-8884-0ed5db3988f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:28.371847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92f15cc5-fe10-4f52-8884-0ed5db3988f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 May 23 13:50:28.372468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 620/1161] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:28 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:28.627843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-80afb3be-1657-44c9-80c6-cb25dc8ccb41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:28.628797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-80afb3be-1657-44c9-80c6-cb25dc8ccb41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:28.635155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80afb3be-1657-44c9-80c6-cb25dc8ccb41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:28.635601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80afb3be-1657-44c9-80c6-cb25dc8ccb41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:28.636356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80afb3be-1657-44c9-80c6-cb25dc8ccb41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:28.636816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80afb3be-1657-44c9-80c6-cb25dc8ccb41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:28.665962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-80afb3be-1657-44c9-80c6-cb25dc8ccb41 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042090 May 23 13:50:28.666519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 542/1162] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:28.793157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-967f2107-6051-4d9f-a4f1-e7efab48f4e5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:28.794361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-967f2107-6051-4d9f-a4f1-e7efab48f4e5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:28.801118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967f2107-6051-4d9f-a4f1-e7efab48f4e5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:28.801574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967f2107-6051-4d9f-a4f1-e7efab48f4e5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:28.802347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967f2107-6051-4d9f-a4f1-e7efab48f4e5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:28.802782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967f2107-6051-4d9f-a4f1-e7efab48f4e5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:28.865391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-967f2107-6051-4d9f-a4f1-e7efab48f4e5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:28.872904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-967f2107-6051-4d9f-a4f1-e7efab48f4e5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084408 May 23 13:50:28.873463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 621/1163] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:28 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:29.384797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-389c479b-4faa-477c-a545-5f315f6f881b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:29.385709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-389c479b-4faa-477c-a545-5f315f6f881b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:29.392393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-389c479b-4faa-477c-a545-5f315f6f881b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:29.392874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-389c479b-4faa-477c-a545-5f315f6f881b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:29.393708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-389c479b-4faa-477c-a545-5f315f6f881b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:29.394141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-389c479b-4faa-477c-a545-5f315f6f881b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:29.425582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-389c479b-4faa-477c-a545-5f315f6f881b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 May 23 13:50:29.426128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 543/1164] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:29 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:29.685793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7331e3be-9c6f-4d36-852d-cc423f0ae049 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:29.686751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7331e3be-9c6f-4d36-852d-cc423f0ae049 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:29.692883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7331e3be-9c6f-4d36-852d-cc423f0ae049 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:29.693380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7331e3be-9c6f-4d36-852d-cc423f0ae049 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:29.694163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7331e3be-9c6f-4d36-852d-cc423f0ae049 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:29.694607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7331e3be-9c6f-4d36-852d-cc423f0ae049 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:29.725868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7331e3be-9c6f-4d36-852d-cc423f0ae049 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 May 23 13:50:29.726422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 622/1165] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:29.890559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-88d8f14b-6102-4c3a-8110-f53f18b1ffc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:29.891083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-88d8f14b-6102-4c3a-8110-f53f18b1ffc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:29.897152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88d8f14b-6102-4c3a-8110-f53f18b1ffc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:29.897601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88d8f14b-6102-4c3a-8110-f53f18b1ffc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:29.898354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88d8f14b-6102-4c3a-8110-f53f18b1ffc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:29.898780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88d8f14b-6102-4c3a-8110-f53f18b1ffc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:29.961161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-88d8f14b-6102-4c3a-8110-f53f18b1ffc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:29.969064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-88d8f14b-6102-4c3a-8110-f53f18b1ffc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083148 May 23 13:50:29.969632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 544/1166] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:29 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:30.438171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e51d275-028f-4d63-9141-e2ea158e7c58 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:30.439017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e51d275-028f-4d63-9141-e2ea158e7c58 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:30.445444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e51d275-028f-4d63-9141-e2ea158e7c58 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:30.445904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e51d275-028f-4d63-9141-e2ea158e7c58 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:30.446667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e51d275-028f-4d63-9141-e2ea158e7c58 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:30.447113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e51d275-028f-4d63-9141-e2ea158e7c58 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:30.476637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e51d275-028f-4d63-9141-e2ea158e7c58 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 May 23 13:50:30.477188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 623/1167] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:30 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:30.738249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6516457-69e3-4405-b7cc-3b790f1a99c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:30.739079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6516457-69e3-4405-b7cc-3b790f1a99c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:30.745110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6516457-69e3-4405-b7cc-3b790f1a99c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:30.745569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6516457-69e3-4405-b7cc-3b790f1a99c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:30.746333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6516457-69e3-4405-b7cc-3b790f1a99c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:30.746775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6516457-69e3-4405-b7cc-3b790f1a99c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:30.776835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6516457-69e3-4405-b7cc-3b790f1a99c9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042707 May 23 13:50:30.777390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 545/1168] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:30.986288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ac4be859-0bdd-4539-90a7-74c678059601 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:30.986904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ac4be859-0bdd-4539-90a7-74c678059601 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:30.993115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac4be859-0bdd-4539-90a7-74c678059601 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:30.993507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac4be859-0bdd-4539-90a7-74c678059601 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:30.994280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac4be859-0bdd-4539-90a7-74c678059601 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:30.994721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac4be859-0bdd-4539-90a7-74c678059601 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:31.056184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ac4be859-0bdd-4539-90a7-74c678059601 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:31.064585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ac4be859-0bdd-4539-90a7-74c678059601 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082197 May 23 13:50:31.065172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 624/1169] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:30 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:31.488548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e7bfb9d-ee57-465c-834a-fb7a93514bf3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:31.489492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1e7bfb9d-ee57-465c-834a-fb7a93514bf3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:31.496171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e7bfb9d-ee57-465c-834a-fb7a93514bf3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:31.496660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e7bfb9d-ee57-465c-834a-fb7a93514bf3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:31.498516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e7bfb9d-ee57-465c-834a-fb7a93514bf3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:31.498958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e7bfb9d-ee57-465c-834a-fb7a93514bf3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:31.529514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1e7bfb9d-ee57-465c-834a-fb7a93514bf3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 May 23 13:50:31.530100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 546/1170] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:31 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:31.789939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c7fe3c75-31d3-435d-869d-eab481dc5452 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:31.790775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7fe3c75-31d3-435d-869d-eab481dc5452 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:31.798049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7fe3c75-31d3-435d-869d-eab481dc5452 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:31.798492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7fe3c75-31d3-435d-869d-eab481dc5452 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:31.799254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7fe3c75-31d3-435d-869d-eab481dc5452 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:31.799755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7fe3c75-31d3-435d-869d-eab481dc5452 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:31.829634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c7fe3c75-31d3-435d-869d-eab481dc5452 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043748 May 23 13:50:31.830203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 625/1171] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:32.081744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4710483-25bc-4ae0-b889-0a9752e6023e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:32.082370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a4710483-25bc-4ae0-b889-0a9752e6023e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:32.088695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4710483-25bc-4ae0-b889-0a9752e6023e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:32.089423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4710483-25bc-4ae0-b889-0a9752e6023e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:32.090182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4710483-25bc-4ae0-b889-0a9752e6023e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:32.091203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4710483-25bc-4ae0-b889-0a9752e6023e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:32.155337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a4710483-25bc-4ae0-b889-0a9752e6023e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:32.163351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4710483-25bc-4ae0-b889-0a9752e6023e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085585 May 23 13:50:32.163911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 547/1172] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:32 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:50:32.541572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ddd9f59d-8b6c-4f2d-84ec-d27104017bc2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:32.542490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ddd9f59d-8b6c-4f2d-84ec-d27104017bc2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:32.548997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddd9f59d-8b6c-4f2d-84ec-d27104017bc2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:32.549449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddd9f59d-8b6c-4f2d-84ec-d27104017bc2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:32.550372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddd9f59d-8b6c-4f2d-84ec-d27104017bc2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:32.550808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddd9f59d-8b6c-4f2d-84ec-d27104017bc2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:32.581048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ddd9f59d-8b6c-4f2d-84ec-d27104017bc2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 May 23 13:50:32.581627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 626/1173] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:32 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:32.841574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5e482ccd-1675-42a9-b584-8fb18acee538 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:32.842407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5e482ccd-1675-42a9-b584-8fb18acee538 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:32.848883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e482ccd-1675-42a9-b584-8fb18acee538 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:32.849329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e482ccd-1675-42a9-b584-8fb18acee538 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:32.850085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e482ccd-1675-42a9-b584-8fb18acee538 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:32.850517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e482ccd-1675-42a9-b584-8fb18acee538 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:32.883689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5e482ccd-1675-42a9-b584-8fb18acee538 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043065 May 23 13:50:32.884288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 548/1174] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:32 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:33.181171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5b69e015-a56b-4d01-8669-be99e49188ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:33.181784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5b69e015-a56b-4d01-8669-be99e49188ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:33.189684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b69e015-a56b-4d01-8669-be99e49188ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:33.190125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b69e015-a56b-4d01-8669-be99e49188ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:33.190899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b69e015-a56b-4d01-8669-be99e49188ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:33.191458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b69e015-a56b-4d01-8669-be99e49188ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:33.261576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5b69e015-a56b-4d01-8669-be99e49188ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:33.269435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5b69e015-a56b-4d01-8669-be99e49188ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092238 May 23 13:50:33.269995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 627/1175] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:33 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:33.594059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4fc7ee9e-beed-4d61-95d9-be487ca78fe8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:33.595057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4fc7ee9e-beed-4d61-95d9-be487ca78fe8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:33.601374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fc7ee9e-beed-4d61-95d9-be487ca78fe8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:33.601811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fc7ee9e-beed-4d61-95d9-be487ca78fe8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:33.602564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fc7ee9e-beed-4d61-95d9-be487ca78fe8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:33.602999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fc7ee9e-beed-4d61-95d9-be487ca78fe8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:33.633557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4fc7ee9e-beed-4d61-95d9-be487ca78fe8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044656 May 23 13:50:33.634122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 549/1176] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:33 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:33.895638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-86bdb975-0f1b-4aae-8daf-0fe2344abe88 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:33.896609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-86bdb975-0f1b-4aae-8daf-0fe2344abe88 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:33.902592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bdb975-0f1b-4aae-8daf-0fe2344abe88 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:33.903632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bdb975-0f1b-4aae-8daf-0fe2344abe88 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:33.904580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bdb975-0f1b-4aae-8daf-0fe2344abe88 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:33.905021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bdb975-0f1b-4aae-8daf-0fe2344abe88 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:33.929967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:33.934450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-86bdb975-0f1b-4aae-8daf-0fe2344abe88 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042838 May 23 13:50:33.935007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 628/1177] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:34.286297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-df67cfef-1978-46db-9433-da02e469a91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:34.286913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-df67cfef-1978-46db-9433-da02e469a91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:34.293563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df67cfef-1978-46db-9433-da02e469a91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:34.294593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df67cfef-1978-46db-9433-da02e469a91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:34.295359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df67cfef-1978-46db-9433-da02e469a91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:34.295826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df67cfef-1978-46db-9433-da02e469a91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:34.358771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-df67cfef-1978-46db-9433-da02e469a91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:34.366376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-df67cfef-1978-46db-9433-da02e469a91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083942 May 23 13:50:34.366942 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 550/1178] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:34 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:34.646182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b9077b9-8ce4-4c0e-adaa-5b00b95e191d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:34.647140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b9077b9-8ce4-4c0e-adaa-5b00b95e191d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:34.654576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9077b9-8ce4-4c0e-adaa-5b00b95e191d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:34.655033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9077b9-8ce4-4c0e-adaa-5b00b95e191d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:34.655802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9077b9-8ce4-4c0e-adaa-5b00b95e191d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:34.656248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9077b9-8ce4-4c0e-adaa-5b00b95e191d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:34.687080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b9077b9-8ce4-4c0e-adaa-5b00b95e191d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044835 May 23 13:50:34.687648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 629/1179] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:34 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:34.947460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-201de1c3-12bb-40fe-98d6-be44a0ea9006 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:34.948287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-201de1c3-12bb-40fe-98d6-be44a0ea9006 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:34.954752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-201de1c3-12bb-40fe-98d6-be44a0ea9006 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:34.955191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-201de1c3-12bb-40fe-98d6-be44a0ea9006 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:34.955970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-201de1c3-12bb-40fe-98d6-be44a0ea9006 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:34.956399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-201de1c3-12bb-40fe-98d6-be44a0ea9006 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:34.987953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-201de1c3-12bb-40fe-98d6-be44a0ea9006 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044643 May 23 13:50:34.988529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 551/1180] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:35.383567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-217fd18f-41b9-4e76-a3be-d6e0b633ac49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:35.384177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-217fd18f-41b9-4e76-a3be-d6e0b633ac49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:35.390425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-217fd18f-41b9-4e76-a3be-d6e0b633ac49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:35.390869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-217fd18f-41b9-4e76-a3be-d6e0b633ac49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:35.391639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-217fd18f-41b9-4e76-a3be-d6e0b633ac49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:35.392074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-217fd18f-41b9-4e76-a3be-d6e0b633ac49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:35.457870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-217fd18f-41b9-4e76-a3be-d6e0b633ac49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:35.466481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-217fd18f-41b9-4e76-a3be-d6e0b633ac49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087017 May 23 13:50:35.467039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 630/1181] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:35 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:35.699277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46dd2dbe-c764-424c-a44e-685fab15fc4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:35.700799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46dd2dbe-c764-424c-a44e-685fab15fc4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:35.708508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46dd2dbe-c764-424c-a44e-685fab15fc4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:35.709001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46dd2dbe-c764-424c-a44e-685fab15fc4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:35.709876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46dd2dbe-c764-424c-a44e-685fab15fc4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:35.710310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46dd2dbe-c764-424c-a44e-685fab15fc4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:35.742664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:35.747444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46dd2dbe-c764-424c-a44e-685fab15fc4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052188 May 23 13:50:35.753454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 552/1182] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:35 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:50:36.001992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12e39b40-b9d2-4cc8-af63-d5126ab3705d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:36.003437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12e39b40-b9d2-4cc8-af63-d5126ab3705d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:36.010771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12e39b40-b9d2-4cc8-af63-d5126ab3705d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:36.011231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12e39b40-b9d2-4cc8-af63-d5126ab3705d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:36.013127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12e39b40-b9d2-4cc8-af63-d5126ab3705d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:36.013574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12e39b40-b9d2-4cc8-af63-d5126ab3705d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:36.051190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12e39b40-b9d2-4cc8-af63-d5126ab3705d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054547 May 23 13:50:36.051887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 631/1183] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:36.483880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eb543bc7-8d64-493a-bdda-e191dddf7cb3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:36.484731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eb543bc7-8d64-493a-bdda-e191dddf7cb3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:36.491245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb543bc7-8d64-493a-bdda-e191dddf7cb3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:36.491687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb543bc7-8d64-493a-bdda-e191dddf7cb3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:36.492439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb543bc7-8d64-493a-bdda-e191dddf7cb3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:36.492892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb543bc7-8d64-493a-bdda-e191dddf7cb3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:36.559204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eb543bc7-8d64-493a-bdda-e191dddf7cb3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:36.567094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eb543bc7-8d64-493a-bdda-e191dddf7cb3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087585 May 23 13:50:36.567664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 553/1184] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:36 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:36.759007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5b781b01-22e7-4aa9-ae36-99c2961073f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:36.759866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5b781b01-22e7-4aa9-ae36-99c2961073f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:36.766305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b781b01-22e7-4aa9-ae36-99c2961073f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:36.766751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b781b01-22e7-4aa9-ae36-99c2961073f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:36.767590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b781b01-22e7-4aa9-ae36-99c2961073f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:36.768022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b781b01-22e7-4aa9-ae36-99c2961073f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:36.797993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5b781b01-22e7-4aa9-ae36-99c2961073f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043113 May 23 13:50:36.798552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 632/1185] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:36 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:37.063826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-706153bc-6bc9-4259-9d2b-ad9935d07b4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:37.064768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-706153bc-6bc9-4259-9d2b-ad9935d07b4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:37.071268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-706153bc-6bc9-4259-9d2b-ad9935d07b4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:37.071712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-706153bc-6bc9-4259-9d2b-ad9935d07b4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:37.072462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-706153bc-6bc9-4259-9d2b-ad9935d07b4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:37.072914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-706153bc-6bc9-4259-9d2b-ad9935d07b4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:37.104998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-706153bc-6bc9-4259-9d2b-ad9935d07b4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 May 23 13:50:37.105443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 554/1186] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:37.583793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e1728d8-bca2-4d8a-a4c6-daa8d4e8934b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:37.584412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e1728d8-bca2-4d8a-a4c6-daa8d4e8934b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:37.592056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1728d8-bca2-4d8a-a4c6-daa8d4e8934b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:37.592508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1728d8-bca2-4d8a-a4c6-daa8d4e8934b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:37.593303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1728d8-bca2-4d8a-a4c6-daa8d4e8934b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:37.593746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1728d8-bca2-4d8a-a4c6-daa8d4e8934b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:37.657556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e1728d8-bca2-4d8a-a4c6-daa8d4e8934b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:37.665159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2e1728d8-bca2-4d8a-a4c6-daa8d4e8934b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085316 May 23 13:50:37.665726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 633/1187] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:37 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:37.810239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d4b9d04-7aa2-46fb-8e6c-167a52ccc5d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:37.811249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d4b9d04-7aa2-46fb-8e6c-167a52ccc5d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:37.819101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d4b9d04-7aa2-46fb-8e6c-167a52ccc5d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:37.819974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d4b9d04-7aa2-46fb-8e6c-167a52ccc5d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:37.821157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d4b9d04-7aa2-46fb-8e6c-167a52ccc5d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:37.821928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d4b9d04-7aa2-46fb-8e6c-167a52ccc5d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:37.855101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d4b9d04-7aa2-46fb-8e6c-167a52ccc5d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049105 May 23 13:50:37.855687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 555/1188] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:37 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:38.117000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a294dbc-4f4d-4c80-867f-77c26a099a00 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:38.117826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3a294dbc-4f4d-4c80-867f-77c26a099a00 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:38.125056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a294dbc-4f4d-4c80-867f-77c26a099a00 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:38.125503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a294dbc-4f4d-4c80-867f-77c26a099a00 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:38.126269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a294dbc-4f4d-4c80-867f-77c26a099a00 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:38.126702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a294dbc-4f4d-4c80-867f-77c26a099a00 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:38.157099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a294dbc-4f4d-4c80-867f-77c26a099a00 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 May 23 13:50:38.157685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 634/1189] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:38.682757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff4f9b6d-2cf3-4ad2-be87-143fd033a518 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:38.683373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff4f9b6d-2cf3-4ad2-be87-143fd033a518 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:38.690995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff4f9b6d-2cf3-4ad2-be87-143fd033a518 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:38.691451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff4f9b6d-2cf3-4ad2-be87-143fd033a518 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:38.692218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff4f9b6d-2cf3-4ad2-be87-143fd033a518 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:38.692748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff4f9b6d-2cf3-4ad2-be87-143fd033a518 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:38.758029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ff4f9b6d-2cf3-4ad2-be87-143fd033a518 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:38.765777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff4f9b6d-2cf3-4ad2-be87-143fd033a518 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086824 May 23 13:50:38.766369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 556/1190] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:38 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:38.867169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6ad91254-3c02-42b9-978d-cd9e6ee4fd52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:38.868095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6ad91254-3c02-42b9-978d-cd9e6ee4fd52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:38.875509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ad91254-3c02-42b9-978d-cd9e6ee4fd52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:38.875962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ad91254-3c02-42b9-978d-cd9e6ee4fd52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:38.876777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ad91254-3c02-42b9-978d-cd9e6ee4fd52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:38.877219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ad91254-3c02-42b9-978d-cd9e6ee4fd52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:38.909005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6ad91254-3c02-42b9-978d-cd9e6ee4fd52 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 May 23 13:50:38.909586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 635/1191] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:38 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:39.169381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a24d7eb9-57ef-48bc-8092-96b2906baef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:39.170323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a24d7eb9-57ef-48bc-8092-96b2906baef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:39.176628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a24d7eb9-57ef-48bc-8092-96b2906baef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:39.177060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a24d7eb9-57ef-48bc-8092-96b2906baef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:39.177841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a24d7eb9-57ef-48bc-8092-96b2906baef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:39.178276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a24d7eb9-57ef-48bc-8092-96b2906baef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:39.209447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a24d7eb9-57ef-48bc-8092-96b2906baef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 May 23 13:50:39.210013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 557/1192] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:39.782798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31453621-4728-4f88-abb5-aacef8f9024d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:39.783421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-31453621-4728-4f88-abb5-aacef8f9024d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:39.789625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31453621-4728-4f88-abb5-aacef8f9024d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:39.790083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31453621-4728-4f88-abb5-aacef8f9024d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:39.790861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31453621-4728-4f88-abb5-aacef8f9024d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:39.791329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31453621-4728-4f88-abb5-aacef8f9024d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:39.854423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-31453621-4728-4f88-abb5-aacef8f9024d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:39.862857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31453621-4728-4f88-abb5-aacef8f9024d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084072 May 23 13:50:39.863429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 636/1193] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:39 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:39.921598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d09d51ce-b634-4ed1-9fa1-14426afabaa9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:39.922438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d09d51ce-b634-4ed1-9fa1-14426afabaa9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:39.928979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d09d51ce-b634-4ed1-9fa1-14426afabaa9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:39.929431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d09d51ce-b634-4ed1-9fa1-14426afabaa9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:39.930185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d09d51ce-b634-4ed1-9fa1-14426afabaa9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:39.930620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d09d51ce-b634-4ed1-9fa1-14426afabaa9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:39.959992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d09d51ce-b634-4ed1-9fa1-14426afabaa9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042948 May 23 13:50:39.960548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 558/1194] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:39 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:40.222946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8dad97d-b619-408a-808f-3369ef89d402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:40.223853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8dad97d-b619-408a-808f-3369ef89d402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:40.230320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dad97d-b619-408a-808f-3369ef89d402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:40.230867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dad97d-b619-408a-808f-3369ef89d402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:40.231884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dad97d-b619-408a-808f-3369ef89d402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:40.232339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dad97d-b619-408a-808f-3369ef89d402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:40.260883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8dad97d-b619-408a-808f-3369ef89d402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042038 May 23 13:50:40.261440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 637/1195] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:40.880591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a29e7de0-1b71-4ec3-8309-7a88fac07126 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:40.881195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a29e7de0-1b71-4ec3-8309-7a88fac07126 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:40.887367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a29e7de0-1b71-4ec3-8309-7a88fac07126 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:40.887902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a29e7de0-1b71-4ec3-8309-7a88fac07126 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:40.888679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a29e7de0-1b71-4ec3-8309-7a88fac07126 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:40.889114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a29e7de0-1b71-4ec3-8309-7a88fac07126 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:40.952049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a29e7de0-1b71-4ec3-8309-7a88fac07126 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:40.959744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a29e7de0-1b71-4ec3-8309-7a88fac07126 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083028 May 23 13:50:40.960316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 559/1196] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:40 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:40.971517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d93d5417-52c1-4dda-a539-f32878a94b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:40.972510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d93d5417-52c1-4dda-a539-f32878a94b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:40.978789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d93d5417-52c1-4dda-a539-f32878a94b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:40.979250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d93d5417-52c1-4dda-a539-f32878a94b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:40.980039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d93d5417-52c1-4dda-a539-f32878a94b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:40.980481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d93d5417-52c1-4dda-a539-f32878a94b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:41.013401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d93d5417-52c1-4dda-a539-f32878a94b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045989 May 23 13:50:41.013982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 638/1197] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:40 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:41.273240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-291d477b-6a63-4c14-8d4d-94ee33dffc16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:41.274159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-291d477b-6a63-4c14-8d4d-94ee33dffc16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:41.283939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-291d477b-6a63-4c14-8d4d-94ee33dffc16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:41.285445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-291d477b-6a63-4c14-8d4d-94ee33dffc16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:41.286251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-291d477b-6a63-4c14-8d4d-94ee33dffc16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:41.286700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-291d477b-6a63-4c14-8d4d-94ee33dffc16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:41.318919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-291d477b-6a63-4c14-8d4d-94ee33dffc16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049643 May 23 13:50:41.319493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 560/1198] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:41.977898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f3a4e22-e4a8-418b-9bd3-3718c05130fb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:41.978462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f3a4e22-e4a8-418b-9bd3-3718c05130fb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:41.981142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=87 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:41.986155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f3a4e22-e4a8-418b-9bd3-3718c05130fb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:41.986610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f3a4e22-e4a8-418b-9bd3-3718c05130fb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:41.987396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f3a4e22-e4a8-418b-9bd3-3718c05130fb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:41.987841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f3a4e22-e4a8-418b-9bd3-3718c05130fb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:42.024644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f00d0217-5bb7-424a-b10a-246bf2b05bda tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:42.026193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f00d0217-5bb7-424a-b10a-246bf2b05bda tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:42.032857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f00d0217-5bb7-424a-b10a-246bf2b05bda tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:42.033306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f00d0217-5bb7-424a-b10a-246bf2b05bda tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:42.034073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f00d0217-5bb7-424a-b10a-246bf2b05bda tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:42.034509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f00d0217-5bb7-424a-b10a-246bf2b05bda tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:42.056679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f3a4e22-e4a8-418b-9bd3-3718c05130fb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:42.064476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f3a4e22-e4a8-418b-9bd3-3718c05130fb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090472 May 23 13:50:42.065117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 639/1199] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:41 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:42.066283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f00d0217-5bb7-424a-b10a-246bf2b05bda tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045579 May 23 13:50:42.066839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 561/1200] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:42 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:42.330832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-95569c23-f7e2-4a83-bef4-2fdc7be33051 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:42.331741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-95569c23-f7e2-4a83-bef4-2fdc7be33051 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:42.337918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95569c23-f7e2-4a83-bef4-2fdc7be33051 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:42.338633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95569c23-f7e2-4a83-bef4-2fdc7be33051 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:42.339414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95569c23-f7e2-4a83-bef4-2fdc7be33051 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:42.339862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-95569c23-f7e2-4a83-bef4-2fdc7be33051 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:42.370029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-95569c23-f7e2-4a83-bef4-2fdc7be33051 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 May 23 13:50:42.370588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 640/1201] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:43.078081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0481de61-5565-47fa-9826-5be6974e6c04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:43.079009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0481de61-5565-47fa-9826-5be6974e6c04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:43.082865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a671f77-d839-41cb-a91b-82b33ef83a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:43.083743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a671f77-d839-41cb-a91b-82b33ef83a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:43.085751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0481de61-5565-47fa-9826-5be6974e6c04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:43.086211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0481de61-5565-47fa-9826-5be6974e6c04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:43.086988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0481de61-5565-47fa-9826-5be6974e6c04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:43.087426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0481de61-5565-47fa-9826-5be6974e6c04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:43.090774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a671f77-d839-41cb-a91b-82b33ef83a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:43.091233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a671f77-d839-41cb-a91b-82b33ef83a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:43.092896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a671f77-d839-41cb-a91b-82b33ef83a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:43.092896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a671f77-d839-41cb-a91b-82b33ef83a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:43.120252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0481de61-5565-47fa-9826-5be6974e6c04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046214 May 23 13:50:43.121938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 562/1202] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:43 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:43.187038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a671f77-d839-41cb-a91b-82b33ef83a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:43.197906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a671f77-d839-41cb-a91b-82b33ef83a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.118902 May 23 13:50:43.199037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 641/1203] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:43 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:50:43.381697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-907855b0-d4bb-485e-a383-2def48c58242 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:43.382601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-907855b0-d4bb-485e-a383-2def48c58242 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:43.388731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-907855b0-d4bb-485e-a383-2def48c58242 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:43.389193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-907855b0-d4bb-485e-a383-2def48c58242 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:43.389931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-907855b0-d4bb-485e-a383-2def48c58242 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:43.390441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-907855b0-d4bb-485e-a383-2def48c58242 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:43.421335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-907855b0-d4bb-485e-a383-2def48c58242 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 May 23 13:50:43.421899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 563/1204] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:44.131673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b03d7dfa-585c-4f9b-bb86-8eec70092d4d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:44.132687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b03d7dfa-585c-4f9b-bb86-8eec70092d4d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:44.139251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b03d7dfa-585c-4f9b-bb86-8eec70092d4d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:44.139712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b03d7dfa-585c-4f9b-bb86-8eec70092d4d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:44.140490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b03d7dfa-585c-4f9b-bb86-8eec70092d4d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:44.141011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b03d7dfa-585c-4f9b-bb86-8eec70092d4d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:44.174358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b03d7dfa-585c-4f9b-bb86-8eec70092d4d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046945 May 23 13:50:44.174925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 642/1205] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:44 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:44.216462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77f6c458-45f7-4ed0-84ec-879d52ef7f28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:44.217106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-77f6c458-45f7-4ed0-84ec-879d52ef7f28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:44.219471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=88 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:44.224214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77f6c458-45f7-4ed0-84ec-879d52ef7f28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:44.224690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77f6c458-45f7-4ed0-84ec-879d52ef7f28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:44.225444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77f6c458-45f7-4ed0-84ec-879d52ef7f28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:44.225871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77f6c458-45f7-4ed0-84ec-879d52ef7f28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:44.289320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-77f6c458-45f7-4ed0-84ec-879d52ef7f28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:44.297706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-77f6c458-45f7-4ed0-84ec-879d52ef7f28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085789 May 23 13:50:44.298164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 564/1206] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:44 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:44.433067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc5862ac-db7b-4dc6-a95a-3657a11e4916 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:44.434092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc5862ac-db7b-4dc6-a95a-3657a11e4916 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:44.439981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc5862ac-db7b-4dc6-a95a-3657a11e4916 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:44.440433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc5862ac-db7b-4dc6-a95a-3657a11e4916 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:44.441239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc5862ac-db7b-4dc6-a95a-3657a11e4916 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:44.441674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc5862ac-db7b-4dc6-a95a-3657a11e4916 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:44.472753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc5862ac-db7b-4dc6-a95a-3657a11e4916 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043631 May 23 13:50:44.473319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 643/1207] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:45.187074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59c4456f-2289-4703-bb0a-5c824febf42e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:45.188004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59c4456f-2289-4703-bb0a-5c824febf42e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:45.194354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59c4456f-2289-4703-bb0a-5c824febf42e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:45.194795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59c4456f-2289-4703-bb0a-5c824febf42e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:45.195559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59c4456f-2289-4703-bb0a-5c824febf42e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:45.195995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59c4456f-2289-4703-bb0a-5c824febf42e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:45.226687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59c4456f-2289-4703-bb0a-5c824febf42e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044544 May 23 13:50:45.227372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 565/1208] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:45 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:45.314319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-78284412-b299-4413-8a41-45fac1f180e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:45.314931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-78284412-b299-4413-8a41-45fac1f180e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:45.325894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78284412-b299-4413-8a41-45fac1f180e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:45.327868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78284412-b299-4413-8a41-45fac1f180e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:45.328116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78284412-b299-4413-8a41-45fac1f180e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:45.328935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78284412-b299-4413-8a41-45fac1f180e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:45.394468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78284412-b299-4413-8a41-45fac1f180e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:45.402232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-78284412-b299-4413-8a41-45fac1f180e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091731 May 23 13:50:45.403574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 644/1209] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:45 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:45.484475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-05d13738-b3d2-4a05-9673-58e86f143190 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:45.485342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-05d13738-b3d2-4a05-9673-58e86f143190 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:45.491373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d13738-b3d2-4a05-9673-58e86f143190 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:45.505606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d13738-b3d2-4a05-9673-58e86f143190 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:45.505606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d13738-b3d2-4a05-9673-58e86f143190 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:45.505606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d13738-b3d2-4a05-9673-58e86f143190 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:45.523490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-05d13738-b3d2-4a05-9673-58e86f143190 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043072 May 23 13:50:45.524072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 566/1210] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:46.238869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-90d82036-d231-4b2b-89ca-999af254492a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:46.239790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-90d82036-d231-4b2b-89ca-999af254492a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:46.245949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90d82036-d231-4b2b-89ca-999af254492a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:46.247471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90d82036-d231-4b2b-89ca-999af254492a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:46.248274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90d82036-d231-4b2b-89ca-999af254492a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:46.248748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90d82036-d231-4b2b-89ca-999af254492a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:46.265891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:46.279449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-90d82036-d231-4b2b-89ca-999af254492a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 May 23 13:50:46.280021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 645/1211] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:46 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:46.535066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-444a456c-8bb5-4240-8d53-515fa0139e4c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:46.536060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-444a456c-8bb5-4240-8d53-515fa0139e4c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:46.540911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b259582-0ed8-4701-8171-14f49118ea6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:46.541529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b259582-0ed8-4701-8171-14f49118ea6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:46.543633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-444a456c-8bb5-4240-8d53-515fa0139e4c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:46.544267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-444a456c-8bb5-4240-8d53-515fa0139e4c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:46.545098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-444a456c-8bb5-4240-8d53-515fa0139e4c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:46.545535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-444a456c-8bb5-4240-8d53-515fa0139e4c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:46.551304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b259582-0ed8-4701-8171-14f49118ea6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:46.552054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b259582-0ed8-4701-8171-14f49118ea6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:46.553378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b259582-0ed8-4701-8171-14f49118ea6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:46.554117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b259582-0ed8-4701-8171-14f49118ea6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:46.576541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-444a456c-8bb5-4240-8d53-515fa0139e4c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 May 23 13:50:46.580297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 646/1212] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:50:46.622997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b259582-0ed8-4701-8171-14f49118ea6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:46.630867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b259582-0ed8-4701-8171-14f49118ea6c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.210078 May 23 13:50:46.631451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 567/1213] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:46 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:47.291337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab8ed4c2-0184-41e1-bc8f-244edf1ed88b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:47.292270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab8ed4c2-0184-41e1-bc8f-244edf1ed88b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:47.299083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab8ed4c2-0184-41e1-bc8f-244edf1ed88b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:47.299542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab8ed4c2-0184-41e1-bc8f-244edf1ed88b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:47.300322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab8ed4c2-0184-41e1-bc8f-244edf1ed88b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:47.300797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab8ed4c2-0184-41e1-bc8f-244edf1ed88b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:47.332436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab8ed4c2-0184-41e1-bc8f-244edf1ed88b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 May 23 13:50:47.333056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 647/1214] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:47 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:47.588521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65f637d2-1bf8-4579-87aa-b03dc1aba17c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:47.589401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65f637d2-1bf8-4579-87aa-b03dc1aba17c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:47.597569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65f637d2-1bf8-4579-87aa-b03dc1aba17c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:47.598023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65f637d2-1bf8-4579-87aa-b03dc1aba17c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:47.598796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65f637d2-1bf8-4579-87aa-b03dc1aba17c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:47.599231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65f637d2-1bf8-4579-87aa-b03dc1aba17c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:47.631655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65f637d2-1bf8-4579-87aa-b03dc1aba17c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 May 23 13:50:47.632234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 568/1215] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:47.647688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab427800-1ef2-44e4-a34c-dff6928d0bbe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:47.648349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab427800-1ef2-44e4-a34c-dff6928d0bbe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:47.655054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab427800-1ef2-44e4-a34c-dff6928d0bbe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:47.655508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab427800-1ef2-44e4-a34c-dff6928d0bbe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:47.656291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab427800-1ef2-44e4-a34c-dff6928d0bbe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:47.656757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab427800-1ef2-44e4-a34c-dff6928d0bbe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:47.735712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab427800-1ef2-44e4-a34c-dff6928d0bbe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:47.743337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab427800-1ef2-44e4-a34c-dff6928d0bbe tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.099627 May 23 13:50:47.743912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 648/1216] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:47 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:48.346110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-91e59e41-b0e6-4255-ad82-ec62173a4f1e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:48.347024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-91e59e41-b0e6-4255-ad82-ec62173a4f1e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:48.353335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91e59e41-b0e6-4255-ad82-ec62173a4f1e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:48.353783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91e59e41-b0e6-4255-ad82-ec62173a4f1e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:48.354599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91e59e41-b0e6-4255-ad82-ec62173a4f1e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:48.354974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91e59e41-b0e6-4255-ad82-ec62173a4f1e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:48.372180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:48.385298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-91e59e41-b0e6-4255-ad82-ec62173a4f1e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043286 May 23 13:50:48.385872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 569/1217] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:48.644159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e8e16389-04dc-4742-978d-3d70e71fd70a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:48.645017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e8e16389-04dc-4742-978d-3d70e71fd70a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:48.651090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8e16389-04dc-4742-978d-3d70e71fd70a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:48.651739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8e16389-04dc-4742-978d-3d70e71fd70a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:48.652916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8e16389-04dc-4742-978d-3d70e71fd70a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:48.653374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8e16389-04dc-4742-978d-3d70e71fd70a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:48.684132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e8e16389-04dc-4742-978d-3d70e71fd70a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 May 23 13:50:48.684930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 649/1218] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:48.761329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d56cfe2-3d24-470a-babd-f69617f1dacb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:48.762527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d56cfe2-3d24-470a-babd-f69617f1dacb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:48.769304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d56cfe2-3d24-470a-babd-f69617f1dacb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:48.769754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d56cfe2-3d24-470a-babd-f69617f1dacb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:48.770520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d56cfe2-3d24-470a-babd-f69617f1dacb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:48.770957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d56cfe2-3d24-470a-babd-f69617f1dacb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:48.834119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d56cfe2-3d24-470a-babd-f69617f1dacb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:48.842308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d56cfe2-3d24-470a-babd-f69617f1dacb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085172 May 23 13:50:48.842906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 570/1219] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:48 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:49.397673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-53270d6c-4b9f-4928-97f7-eeb628d28cc9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:49.398587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-53270d6c-4b9f-4928-97f7-eeb628d28cc9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:49.405316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53270d6c-4b9f-4928-97f7-eeb628d28cc9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:49.405769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53270d6c-4b9f-4928-97f7-eeb628d28cc9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:49.406532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53270d6c-4b9f-4928-97f7-eeb628d28cc9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:49.406971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53270d6c-4b9f-4928-97f7-eeb628d28cc9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:49.436862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-53270d6c-4b9f-4928-97f7-eeb628d28cc9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 May 23 13:50:49.437340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 650/1220] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:49 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:49.695584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75e90054-c713-485b-922f-c96032d79d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:49.696431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75e90054-c713-485b-922f-c96032d79d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:49.703737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75e90054-c713-485b-922f-c96032d79d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:49.704189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75e90054-c713-485b-922f-c96032d79d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:49.704997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75e90054-c713-485b-922f-c96032d79d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:49.705435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75e90054-c713-485b-922f-c96032d79d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:49.735911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75e90054-c713-485b-922f-c96032d79d38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 May 23 13:50:49.736477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 571/1221] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:49.860102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-472b20fb-306a-4130-ae25-8d81712b4693 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:49.860750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-472b20fb-306a-4130-ae25-8d81712b4693 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:49.867258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-472b20fb-306a-4130-ae25-8d81712b4693 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:49.867713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-472b20fb-306a-4130-ae25-8d81712b4693 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:49.868485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-472b20fb-306a-4130-ae25-8d81712b4693 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:49.868950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-472b20fb-306a-4130-ae25-8d81712b4693 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:49.932891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-472b20fb-306a-4130-ae25-8d81712b4693 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:49.940979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-472b20fb-306a-4130-ae25-8d81712b4693 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085630 May 23 13:50:49.941546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 651/1222] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:49 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:50.448402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19a2d3bd-183e-4317-a5c0-c8528742e231 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:50.449373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19a2d3bd-183e-4317-a5c0-c8528742e231 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:50.456243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19a2d3bd-183e-4317-a5c0-c8528742e231 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:50.456743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19a2d3bd-183e-4317-a5c0-c8528742e231 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:50.457519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19a2d3bd-183e-4317-a5c0-c8528742e231 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:50.457957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19a2d3bd-183e-4317-a5c0-c8528742e231 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:50.488332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19a2d3bd-183e-4317-a5c0-c8528742e231 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 May 23 13:50:50.488926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 572/1223] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:50.748443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fd9090c3-4d27-4537-9655-2a4dd0f81ca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:50.749306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fd9090c3-4d27-4537-9655-2a4dd0f81ca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:50.755360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd9090c3-4d27-4537-9655-2a4dd0f81ca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:50.755819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd9090c3-4d27-4537-9655-2a4dd0f81ca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:50.756649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd9090c3-4d27-4537-9655-2a4dd0f81ca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:50.757096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd9090c3-4d27-4537-9655-2a4dd0f81ca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:50.786652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fd9090c3-4d27-4537-9655-2a4dd0f81ca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 May 23 13:50:50.787214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 652/1224] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:50.957701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7cf0c107-5dfe-4bfe-b748-7477b0cc55f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:50.958307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7cf0c107-5dfe-4bfe-b748-7477b0cc55f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:50.965558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cf0c107-5dfe-4bfe-b748-7477b0cc55f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:50.965713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cf0c107-5dfe-4bfe-b748-7477b0cc55f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:50.966450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cf0c107-5dfe-4bfe-b748-7477b0cc55f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:50.966881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cf0c107-5dfe-4bfe-b748-7477b0cc55f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:51.032141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7cf0c107-5dfe-4bfe-b748-7477b0cc55f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:51.039831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7cf0c107-5dfe-4bfe-b748-7477b0cc55f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086002 May 23 13:50:51.040388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 573/1225] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:50 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:51.499492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-83072d00-0623-4708-9f2a-640c22ca5c3b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:51.500413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-83072d00-0623-4708-9f2a-640c22ca5c3b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:51.507026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83072d00-0623-4708-9f2a-640c22ca5c3b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:51.507478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83072d00-0623-4708-9f2a-640c22ca5c3b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:51.508246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83072d00-0623-4708-9f2a-640c22ca5c3b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:51.508712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83072d00-0623-4708-9f2a-640c22ca5c3b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:51.538471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-83072d00-0623-4708-9f2a-640c22ca5c3b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 May 23 13:50:51.539024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 653/1226] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:51 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:51.798554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a720e5c5-06b6-4a14-b89b-ca566afce7a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:51.799391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a720e5c5-06b6-4a14-b89b-ca566afce7a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:51.805836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a720e5c5-06b6-4a14-b89b-ca566afce7a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:51.806275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a720e5c5-06b6-4a14-b89b-ca566afce7a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:51.807024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a720e5c5-06b6-4a14-b89b-ca566afce7a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:51.807452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a720e5c5-06b6-4a14-b89b-ca566afce7a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:51.839301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a720e5c5-06b6-4a14-b89b-ca566afce7a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044857 May 23 13:50:51.839956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 574/1227] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:52.059802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c6508cc5-d06e-4e1b-8c61-306f156a61bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:52.060439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c6508cc5-d06e-4e1b-8c61-306f156a61bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:52.067027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6508cc5-d06e-4e1b-8c61-306f156a61bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:52.067474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6508cc5-d06e-4e1b-8c61-306f156a61bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:52.068252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6508cc5-d06e-4e1b-8c61-306f156a61bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:52.068716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6508cc5-d06e-4e1b-8c61-306f156a61bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:52.132265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c6508cc5-d06e-4e1b-8c61-306f156a61bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:52.140031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c6508cc5-d06e-4e1b-8c61-306f156a61bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086422 May 23 13:50:52.140624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 654/1228] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:52 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:52.550202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-960f3c69-c2c1-47b9-a532-de0f58af102b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:52.551200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-960f3c69-c2c1-47b9-a532-de0f58af102b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:52.557363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-960f3c69-c2c1-47b9-a532-de0f58af102b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:52.557814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-960f3c69-c2c1-47b9-a532-de0f58af102b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:52.559712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-960f3c69-c2c1-47b9-a532-de0f58af102b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:52.560153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-960f3c69-c2c1-47b9-a532-de0f58af102b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:52.592128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-960f3c69-c2c1-47b9-a532-de0f58af102b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045910 May 23 13:50:52.592781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 575/1229] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:52 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:52.851351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9292b44a-92a6-4cbd-9263-e8b32b4bc846 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:52.852199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9292b44a-92a6-4cbd-9263-e8b32b4bc846 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:52.860378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9292b44a-92a6-4cbd-9263-e8b32b4bc846 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:52.860872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9292b44a-92a6-4cbd-9263-e8b32b4bc846 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:52.861657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9292b44a-92a6-4cbd-9263-e8b32b4bc846 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:52.862103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9292b44a-92a6-4cbd-9263-e8b32b4bc846 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:52.893997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9292b44a-92a6-4cbd-9263-e8b32b4bc846 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046692 May 23 13:50:52.894561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 655/1230] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:53.157723 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e0083d6-659c-4d9a-b8b6-1a7ef9ac07ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:53.158338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e0083d6-659c-4d9a-b8b6-1a7ef9ac07ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:53.165026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0083d6-659c-4d9a-b8b6-1a7ef9ac07ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:53.165479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0083d6-659c-4d9a-b8b6-1a7ef9ac07ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:53.166321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0083d6-659c-4d9a-b8b6-1a7ef9ac07ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:53.167130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0083d6-659c-4d9a-b8b6-1a7ef9ac07ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:53.234595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e0083d6-659c-4d9a-b8b6-1a7ef9ac07ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:53.242322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e0083d6-659c-4d9a-b8b6-1a7ef9ac07ed tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088579 May 23 13:50:53.242893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 576/1231] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:53 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:50:53.603593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d94bdaf-765e-446e-8117-e7baefc6ea68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:53.604629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5d94bdaf-765e-446e-8117-e7baefc6ea68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:53.611999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d94bdaf-765e-446e-8117-e7baefc6ea68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:53.612514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d94bdaf-765e-446e-8117-e7baefc6ea68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:53.613442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d94bdaf-765e-446e-8117-e7baefc6ea68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:53.613880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d94bdaf-765e-446e-8117-e7baefc6ea68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:53.645968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d94bdaf-765e-446e-8117-e7baefc6ea68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046309 May 23 13:50:53.646586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 656/1232] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:53 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:53.905691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a47c8929-b110-43a8-b7d6-4dee602fab26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:53.906550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a47c8929-b110-43a8-b7d6-4dee602fab26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:53.912529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a47c8929-b110-43a8-b7d6-4dee602fab26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:53.913002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a47c8929-b110-43a8-b7d6-4dee602fab26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:53.913756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a47c8929-b110-43a8-b7d6-4dee602fab26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:53.914185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a47c8929-b110-43a8-b7d6-4dee602fab26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:53.947866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a47c8929-b110-43a8-b7d6-4dee602fab26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046175 May 23 13:50:53.948439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 577/1233] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:54.259699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dcf29868-a006-42c2-b4e1-39ae15d89ca5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:54.260318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dcf29868-a006-42c2-b4e1-39ae15d89ca5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:54.267449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dcf29868-a006-42c2-b4e1-39ae15d89ca5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:54.267901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dcf29868-a006-42c2-b4e1-39ae15d89ca5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:54.268725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dcf29868-a006-42c2-b4e1-39ae15d89ca5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:54.269162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dcf29868-a006-42c2-b4e1-39ae15d89ca5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:54.333766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dcf29868-a006-42c2-b4e1-39ae15d89ca5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:54.341895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dcf29868-a006-42c2-b4e1-39ae15d89ca5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086028 May 23 13:50:54.342473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 657/1234] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:54 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:50:54.658356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2b1bd065-794b-4795-9890-cb0bda2676a2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:54.659281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2b1bd065-794b-4795-9890-cb0bda2676a2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:54.666844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b1bd065-794b-4795-9890-cb0bda2676a2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:54.667331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b1bd065-794b-4795-9890-cb0bda2676a2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:54.668888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b1bd065-794b-4795-9890-cb0bda2676a2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:54.669321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b1bd065-794b-4795-9890-cb0bda2676a2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:54.699620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2b1bd065-794b-4795-9890-cb0bda2676a2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 May 23 13:50:54.708242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 578/1235] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:54 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:54.960372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4994e86c-7f1c-47d0-a582-c31a47c8f286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:54.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4994e86c-7f1c-47d0-a582-c31a47c8f286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:54.967586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4994e86c-7f1c-47d0-a582-c31a47c8f286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:54.970812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4994e86c-7f1c-47d0-a582-c31a47c8f286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:54.970812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4994e86c-7f1c-47d0-a582-c31a47c8f286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:54.970812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4994e86c-7f1c-47d0-a582-c31a47c8f286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:55.001660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4994e86c-7f1c-47d0-a582-c31a47c8f286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 May 23 13:50:55.002219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 658/1236] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:55.359967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d7d23ffc-b1f4-41c2-84e9-acdd31c115f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:55.360634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d7d23ffc-b1f4-41c2-84e9-acdd31c115f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:55.366847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7d23ffc-b1f4-41c2-84e9-acdd31c115f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:55.367295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7d23ffc-b1f4-41c2-84e9-acdd31c115f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:55.368059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7d23ffc-b1f4-41c2-84e9-acdd31c115f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:55.368494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7d23ffc-b1f4-41c2-84e9-acdd31c115f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:55.436762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d7d23ffc-b1f4-41c2-84e9-acdd31c115f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:55.445337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d7d23ffc-b1f4-41c2-84e9-acdd31c115f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.089935 May 23 13:50:55.445902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 579/1237] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:55 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:55.711615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f52df8b8-5b2e-4fc0-b9c3-5721b2393e82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:55.712586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f52df8b8-5b2e-4fc0-b9c3-5721b2393e82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:55.720264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f52df8b8-5b2e-4fc0-b9c3-5721b2393e82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:55.720758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f52df8b8-5b2e-4fc0-b9c3-5721b2393e82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:55.721528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f52df8b8-5b2e-4fc0-b9c3-5721b2393e82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:55.721967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f52df8b8-5b2e-4fc0-b9c3-5721b2393e82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:55.751249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f52df8b8-5b2e-4fc0-b9c3-5721b2393e82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 May 23 13:50:55.751831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 659/1238] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:55 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:56.014107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b0bb54e0-b453-49db-babb-41809dbf1279 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:56.014954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b0bb54e0-b453-49db-babb-41809dbf1279 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:56.021632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0bb54e0-b453-49db-babb-41809dbf1279 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:56.022085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0bb54e0-b453-49db-babb-41809dbf1279 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:56.022844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0bb54e0-b453-49db-babb-41809dbf1279 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:56.023277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0bb54e0-b453-49db-babb-41809dbf1279 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:56.061442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b0bb54e0-b453-49db-babb-41809dbf1279 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051913 May 23 13:50:56.062030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 580/1239] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:56.462262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7a227ab-35cc-4d56-ae33-540d948242eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:56.463141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7a227ab-35cc-4d56-ae33-540d948242eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:56.469421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7a227ab-35cc-4d56-ae33-540d948242eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:56.469882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7a227ab-35cc-4d56-ae33-540d948242eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:56.470657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7a227ab-35cc-4d56-ae33-540d948242eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:56.471102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7a227ab-35cc-4d56-ae33-540d948242eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:56.534466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7a227ab-35cc-4d56-ae33-540d948242eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:56.542048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7a227ab-35cc-4d56-ae33-540d948242eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083715 May 23 13:50:56.543615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 660/1240] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:56 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:56.763520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75bac535-a06c-4056-9bac-39c9f35ad8bf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:56.764328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75bac535-a06c-4056-9bac-39c9f35ad8bf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:56.770644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75bac535-a06c-4056-9bac-39c9f35ad8bf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:56.771091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75bac535-a06c-4056-9bac-39c9f35ad8bf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:56.771859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75bac535-a06c-4056-9bac-39c9f35ad8bf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:56.772288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75bac535-a06c-4056-9bac-39c9f35ad8bf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:56.803102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75bac535-a06c-4056-9bac-39c9f35ad8bf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043770 May 23 13:50:56.803665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 581/1241] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:56 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:57.073720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17525245-e038-4e77-8964-1597e1e6e90b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:57.074645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17525245-e038-4e77-8964-1597e1e6e90b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:57.081631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17525245-e038-4e77-8964-1597e1e6e90b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:57.082076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17525245-e038-4e77-8964-1597e1e6e90b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:57.083007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17525245-e038-4e77-8964-1597e1e6e90b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:57.083540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17525245-e038-4e77-8964-1597e1e6e90b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:57.115929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17525245-e038-4e77-8964-1597e1e6e90b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046445 May 23 13:50:57.116501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 661/1242] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:57.560476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9dcf5ef9-722a-45a4-bfde-e5086b7a23ac tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:57.561420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9dcf5ef9-722a-45a4-bfde-e5086b7a23ac tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:57.567746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9dcf5ef9-722a-45a4-bfde-e5086b7a23ac tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:57.568188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9dcf5ef9-722a-45a4-bfde-e5086b7a23ac tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:57.568965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9dcf5ef9-722a-45a4-bfde-e5086b7a23ac tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:57.569437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9dcf5ef9-722a-45a4-bfde-e5086b7a23ac tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:57.635455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9dcf5ef9-722a-45a4-bfde-e5086b7a23ac tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:57.650471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9dcf5ef9-722a-45a4-bfde-e5086b7a23ac tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.094047 May 23 13:50:57.651857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 582/1243] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:57 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:57.815476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5f7c4f5c-5e50-4566-a614-4c91df329ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:57.816470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5f7c4f5c-5e50-4566-a614-4c91df329ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:57.822888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f7c4f5c-5e50-4566-a614-4c91df329ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:57.823346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f7c4f5c-5e50-4566-a614-4c91df329ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:57.825382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f7c4f5c-5e50-4566-a614-4c91df329ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:57.825833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f7c4f5c-5e50-4566-a614-4c91df329ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:57.829752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:50:57.856405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5f7c4f5c-5e50-4566-a614-4c91df329ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 May 23 13:50:57.857009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 662/1244] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:57 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:58.127666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4856129f-a632-489b-942f-9cf82af7576f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:58.128723 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4856129f-a632-489b-942f-9cf82af7576f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:58.135227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4856129f-a632-489b-942f-9cf82af7576f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:58.135679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4856129f-a632-489b-942f-9cf82af7576f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:58.136539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4856129f-a632-489b-942f-9cf82af7576f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:58.137010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4856129f-a632-489b-942f-9cf82af7576f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:58.168710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4856129f-a632-489b-942f-9cf82af7576f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 May 23 13:50:58.169284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 583/1245] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:58 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:58.669645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1bd60de7-d4cc-4ad9-a4c2-2368643d23a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:58.670247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1bd60de7-d4cc-4ad9-a4c2-2368643d23a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:58.677235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bd60de7-d4cc-4ad9-a4c2-2368643d23a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:58.677692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bd60de7-d4cc-4ad9-a4c2-2368643d23a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:58.678488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bd60de7-d4cc-4ad9-a4c2-2368643d23a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:58.678908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bd60de7-d4cc-4ad9-a4c2-2368643d23a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:58.744974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bd60de7-d4cc-4ad9-a4c2-2368643d23a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:58.753965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1bd60de7-d4cc-4ad9-a4c2-2368643d23a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088840 May 23 13:50:58.754671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 663/1246] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:58 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:58.867746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2162ca56-36ca-4344-a8d1-30476d2c0828 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:58.868806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2162ca56-36ca-4344-a8d1-30476d2c0828 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:58.876285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2162ca56-36ca-4344-a8d1-30476d2c0828 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:58.876781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2162ca56-36ca-4344-a8d1-30476d2c0828 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:58.877570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2162ca56-36ca-4344-a8d1-30476d2c0828 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:58.878013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2162ca56-36ca-4344-a8d1-30476d2c0828 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:58.911703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2162ca56-36ca-4344-a8d1-30476d2c0828 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047950 May 23 13:50:58.912282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 584/1247] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:58 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:59.184710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-512202f3-adb7-4035-8ff8-6e3021da70f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:59.185642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-512202f3-adb7-4035-8ff8-6e3021da70f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:59.196227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-512202f3-adb7-4035-8ff8-6e3021da70f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:59.196719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-512202f3-adb7-4035-8ff8-6e3021da70f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:59.197493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-512202f3-adb7-4035-8ff8-6e3021da70f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:59.198002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-512202f3-adb7-4035-8ff8-6e3021da70f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:59.227852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-512202f3-adb7-4035-8ff8-6e3021da70f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051045 May 23 13:50:59.228417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 664/1248] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:50:59.771971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d019d222-c3ad-49ea-8a17-4d361f9e88a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:59.772609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d019d222-c3ad-49ea-8a17-4d361f9e88a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:59.780021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d019d222-c3ad-49ea-8a17-4d361f9e88a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:59.780507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d019d222-c3ad-49ea-8a17-4d361f9e88a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:59.781312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d019d222-c3ad-49ea-8a17-4d361f9e88a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:59.781751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d019d222-c3ad-49ea-8a17-4d361f9e88a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:59.845826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d019d222-c3ad-49ea-8a17-4d361f9e88a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:50:59.853791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d019d222-c3ad-49ea-8a17-4d361f9e88a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085828 May 23 13:50:59.854362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 585/1249] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:50:59 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:50:59.924247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eac760a3-1169-4fb9-94d5-3adda769eb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:50:59.925152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eac760a3-1169-4fb9-94d5-3adda769eb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:50:59.931540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eac760a3-1169-4fb9-94d5-3adda769eb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:59.931989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eac760a3-1169-4fb9-94d5-3adda769eb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:59.932837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eac760a3-1169-4fb9-94d5-3adda769eb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:50:59.933277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eac760a3-1169-4fb9-94d5-3adda769eb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:50:59.962052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eac760a3-1169-4fb9-94d5-3adda769eb17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041954 May 23 13:50:59.962861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 665/1250] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:50:59 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:00.239540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb3e7277-f1bc-4bb1-a175-1dded5a79b3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:00.240472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb3e7277-f1bc-4bb1-a175-1dded5a79b3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:00.247203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb3e7277-f1bc-4bb1-a175-1dded5a79b3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:00.247663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb3e7277-f1bc-4bb1-a175-1dded5a79b3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:00.248427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb3e7277-f1bc-4bb1-a175-1dded5a79b3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:00.248890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb3e7277-f1bc-4bb1-a175-1dded5a79b3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:00.252660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:00.280087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb3e7277-f1bc-4bb1-a175-1dded5a79b3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 May 23 13:51:00.280722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 586/1251] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:00.872069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6fcf8f5f-ce2b-4fad-bc54-251bf6dfd9d8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:00.872723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6fcf8f5f-ce2b-4fad-bc54-251bf6dfd9d8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:00.878907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fcf8f5f-ce2b-4fad-bc54-251bf6dfd9d8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:00.879363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fcf8f5f-ce2b-4fad-bc54-251bf6dfd9d8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:00.880142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fcf8f5f-ce2b-4fad-bc54-251bf6dfd9d8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:00.880616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fcf8f5f-ce2b-4fad-bc54-251bf6dfd9d8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:00.945059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6fcf8f5f-ce2b-4fad-bc54-251bf6dfd9d8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:00.952897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6fcf8f5f-ce2b-4fad-bc54-251bf6dfd9d8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085337 May 23 13:51:00.953475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 666/1252] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:00 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:00.973886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8828435c-c4fa-4718-9a36-146cd202b4a9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:00.974791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8828435c-c4fa-4718-9a36-146cd202b4a9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:00.982614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8828435c-c4fa-4718-9a36-146cd202b4a9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:00.983069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8828435c-c4fa-4718-9a36-146cd202b4a9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:00.983842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8828435c-c4fa-4718-9a36-146cd202b4a9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:00.984280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8828435c-c4fa-4718-9a36-146cd202b4a9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:01.015592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8828435c-c4fa-4718-9a36-146cd202b4a9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 May 23 13:51:01.016160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 587/1253] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:00 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:01.291428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2ce4a98f-d8f7-4622-84fe-3b2c04edb3e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:01.292548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2ce4a98f-d8f7-4622-84fe-3b2c04edb3e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:01.298688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ce4a98f-d8f7-4622-84fe-3b2c04edb3e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:01.299137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ce4a98f-d8f7-4622-84fe-3b2c04edb3e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:01.299898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ce4a98f-d8f7-4622-84fe-3b2c04edb3e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:01.300341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ce4a98f-d8f7-4622-84fe-3b2c04edb3e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:01.338326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2ce4a98f-d8f7-4622-84fe-3b2c04edb3e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050831 May 23 13:51:01.338905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 667/1254] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:01.971621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5fe2b2ad-398f-4f86-b4f3-676788831d98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:01.972176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5fe2b2ad-398f-4f86-b4f3-676788831d98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:01.978924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fe2b2ad-398f-4f86-b4f3-676788831d98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:01.979411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fe2b2ad-398f-4f86-b4f3-676788831d98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:01.980474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fe2b2ad-398f-4f86-b4f3-676788831d98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:01.980937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fe2b2ad-398f-4f86-b4f3-676788831d98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:02.028266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d5c0a9ef-8bb8-4971-b0f1-46859dcd9371 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:02.029258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d5c0a9ef-8bb8-4971-b0f1-46859dcd9371 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:02.036295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5c0a9ef-8bb8-4971-b0f1-46859dcd9371 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:02.036781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5c0a9ef-8bb8-4971-b0f1-46859dcd9371 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:02.037568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5c0a9ef-8bb8-4971-b0f1-46859dcd9371 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:02.037996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5c0a9ef-8bb8-4971-b0f1-46859dcd9371 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:02.050970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5fe2b2ad-398f-4f86-b4f3-676788831d98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:02.059158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5fe2b2ad-398f-4f86-b4f3-676788831d98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091482 May 23 13:51:02.059748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 588/1255] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:01 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:02.073167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d5c0a9ef-8bb8-4971-b0f1-46859dcd9371 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049578 May 23 13:51:02.074263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 668/1256] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:02 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:02.350528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ad577963-fbfd-4a0e-afee-69bbf6f082ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:02.351360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ad577963-fbfd-4a0e-afee-69bbf6f082ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:02.358223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad577963-fbfd-4a0e-afee-69bbf6f082ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:02.358676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad577963-fbfd-4a0e-afee-69bbf6f082ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:02.359442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad577963-fbfd-4a0e-afee-69bbf6f082ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:02.359878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad577963-fbfd-4a0e-afee-69bbf6f082ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:02.390218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ad577963-fbfd-4a0e-afee-69bbf6f082ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 May 23 13:51:02.390773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 589/1257] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:03.076935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-721eeca0-8ce4-41a0-8665-98185ae2e867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:03.077558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-721eeca0-8ce4-41a0-8665-98185ae2e867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:03.084305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-721eeca0-8ce4-41a0-8665-98185ae2e867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:03.084785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-721eeca0-8ce4-41a0-8665-98185ae2e867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:03.085582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-721eeca0-8ce4-41a0-8665-98185ae2e867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:03.086336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-721eeca0-8ce4-41a0-8665-98185ae2e867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:03.087323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9275ed9f-bca2-4bd8-88d4-103d5780b8fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:03.088541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9275ed9f-bca2-4bd8-88d4-103d5780b8fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:03.095516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9275ed9f-bca2-4bd8-88d4-103d5780b8fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:03.096114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9275ed9f-bca2-4bd8-88d4-103d5780b8fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:03.096923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9275ed9f-bca2-4bd8-88d4-103d5780b8fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:03.097356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9275ed9f-bca2-4bd8-88d4-103d5780b8fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:03.128494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9275ed9f-bca2-4bd8-88d4-103d5780b8fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045562 May 23 13:51:03.129108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 590/1258] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:03 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:03.163919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-721eeca0-8ce4-41a0-8665-98185ae2e867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:03.172446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-721eeca0-8ce4-41a0-8665-98185ae2e867 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.100142 May 23 13:51:03.173060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 669/1259] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:03 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:03.402073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-808c4094-caf6-43ca-912c-9cfff1550b1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:03.403029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-808c4094-caf6-43ca-912c-9cfff1550b1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:03.409225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-808c4094-caf6-43ca-912c-9cfff1550b1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:03.409682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-808c4094-caf6-43ca-912c-9cfff1550b1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:03.410464 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-808c4094-caf6-43ca-912c-9cfff1550b1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:03.410907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-808c4094-caf6-43ca-912c-9cfff1550b1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:03.447698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-808c4094-caf6-43ca-912c-9cfff1550b1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049192 May 23 13:51:03.448827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 591/1260] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:04.140045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6919fabc-2bb3-4e9d-b205-d59ec4378a6b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:04.141024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6919fabc-2bb3-4e9d-b205-d59ec4378a6b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:04.146998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6919fabc-2bb3-4e9d-b205-d59ec4378a6b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:04.147445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6919fabc-2bb3-4e9d-b205-d59ec4378a6b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:04.148209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6919fabc-2bb3-4e9d-b205-d59ec4378a6b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:04.148679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6919fabc-2bb3-4e9d-b205-d59ec4378a6b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:04.179020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6919fabc-2bb3-4e9d-b205-d59ec4378a6b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042147 May 23 13:51:04.181831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 670/1261] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:04 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:04.189711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-df2b5fdc-af06-4177-b334-23f8f93e1fa3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:04.190323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-df2b5fdc-af06-4177-b334-23f8f93e1fa3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:04.196885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df2b5fdc-af06-4177-b334-23f8f93e1fa3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:04.197333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df2b5fdc-af06-4177-b334-23f8f93e1fa3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:04.198105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df2b5fdc-af06-4177-b334-23f8f93e1fa3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:04.198529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df2b5fdc-af06-4177-b334-23f8f93e1fa3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:04.265617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-df2b5fdc-af06-4177-b334-23f8f93e1fa3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:04.273199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-df2b5fdc-af06-4177-b334-23f8f93e1fa3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087361 May 23 13:51:04.273766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 592/1262] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:04 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:04.460363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7c4bb1b5-35c5-4a5d-81e8-ee359fe6e76c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:04.461254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7c4bb1b5-35c5-4a5d-81e8-ee359fe6e76c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:04.468984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c4bb1b5-35c5-4a5d-81e8-ee359fe6e76c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:04.469444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c4bb1b5-35c5-4a5d-81e8-ee359fe6e76c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:04.470226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c4bb1b5-35c5-4a5d-81e8-ee359fe6e76c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:04.470668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c4bb1b5-35c5-4a5d-81e8-ee359fe6e76c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:04.501775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7c4bb1b5-35c5-4a5d-81e8-ee359fe6e76c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 May 23 13:51:04.502350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 671/1263] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:05.190440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e1e11f4c-612a-4a7d-840f-158d7b2ade13 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:05.191459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e1e11f4c-612a-4a7d-840f-158d7b2ade13 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:05.198072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1e11f4c-612a-4a7d-840f-158d7b2ade13 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:05.198523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1e11f4c-612a-4a7d-840f-158d7b2ade13 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:05.199443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1e11f4c-612a-4a7d-840f-158d7b2ade13 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:05.199823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1e11f4c-612a-4a7d-840f-158d7b2ade13 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:05.231692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e1e11f4c-612a-4a7d-840f-158d7b2ade13 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045175 May 23 13:51:05.232270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 593/1264] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:05 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:05.291387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1e3eabe-3a0d-4c0f-b16a-6b72d2d5223d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:05.292796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1e3eabe-3a0d-4c0f-b16a-6b72d2d5223d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:05.299175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1e3eabe-3a0d-4c0f-b16a-6b72d2d5223d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:05.299631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1e3eabe-3a0d-4c0f-b16a-6b72d2d5223d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:05.300401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1e3eabe-3a0d-4c0f-b16a-6b72d2d5223d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:05.300880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1e3eabe-3a0d-4c0f-b16a-6b72d2d5223d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:05.363204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1e3eabe-3a0d-4c0f-b16a-6b72d2d5223d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:05.371099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1e3eabe-3a0d-4c0f-b16a-6b72d2d5223d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083571 May 23 13:51:05.372680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 672/1265] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:05 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:05.517188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c76c0cd4-2078-401a-99bf-4ead70f281aa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:05.518083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c76c0cd4-2078-401a-99bf-4ead70f281aa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:05.524601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c76c0cd4-2078-401a-99bf-4ead70f281aa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:05.525064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c76c0cd4-2078-401a-99bf-4ead70f281aa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:05.525843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c76c0cd4-2078-401a-99bf-4ead70f281aa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:05.527086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c76c0cd4-2078-401a-99bf-4ead70f281aa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:05.557984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c76c0cd4-2078-401a-99bf-4ead70f281aa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047721 May 23 13:51:05.558765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 594/1266] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:06.243449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a825cf3d-c2c3-4151-a644-294396284872 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:06.244372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a825cf3d-c2c3-4151-a644-294396284872 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:06.250581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a825cf3d-c2c3-4151-a644-294396284872 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:06.251035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a825cf3d-c2c3-4151-a644-294396284872 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:06.251800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a825cf3d-c2c3-4151-a644-294396284872 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:06.252239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a825cf3d-c2c3-4151-a644-294396284872 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:06.281419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a825cf3d-c2c3-4151-a644-294396284872 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041897 May 23 13:51:06.281967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 673/1267] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:06 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:06.388931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-66e6e4e2-6903-46de-a539-cd961d4fafd3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:06.389536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-66e6e4e2-6903-46de-a539-cd961d4fafd3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:06.396161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66e6e4e2-6903-46de-a539-cd961d4fafd3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:06.396640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66e6e4e2-6903-46de-a539-cd961d4fafd3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:06.397418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66e6e4e2-6903-46de-a539-cd961d4fafd3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:06.397851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66e6e4e2-6903-46de-a539-cd961d4fafd3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:06.461223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-66e6e4e2-6903-46de-a539-cd961d4fafd3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:06.469654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-66e6e4e2-6903-46de-a539-cd961d4fafd3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085304 May 23 13:51:06.470224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 595/1268] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:06 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:06.569971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-979d059b-c478-4cb1-9dc7-549d44a3a9c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:06.570886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-979d059b-c478-4cb1-9dc7-549d44a3a9c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:06.578840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-979d059b-c478-4cb1-9dc7-549d44a3a9c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:06.579300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-979d059b-c478-4cb1-9dc7-549d44a3a9c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:06.580084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-979d059b-c478-4cb1-9dc7-549d44a3a9c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:06.580534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-979d059b-c478-4cb1-9dc7-549d44a3a9c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:06.610326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-979d059b-c478-4cb1-9dc7-549d44a3a9c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 May 23 13:51:06.610887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 674/1269] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:07.293310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7122a2b-e274-416f-b75d-1fa4625e68f1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:07.294254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7122a2b-e274-416f-b75d-1fa4625e68f1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:07.300259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7122a2b-e274-416f-b75d-1fa4625e68f1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:07.300734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7122a2b-e274-416f-b75d-1fa4625e68f1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:07.301498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7122a2b-e274-416f-b75d-1fa4625e68f1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:07.301934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7122a2b-e274-416f-b75d-1fa4625e68f1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:07.332814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7122a2b-e274-416f-b75d-1fa4625e68f1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043442 May 23 13:51:07.333291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 596/1270] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:07 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:07.489952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a5c9fa0c-1382-49b1-b5ef-7fc300988a84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:07.491067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a5c9fa0c-1382-49b1-b5ef-7fc300988a84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:07.502371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5c9fa0c-1382-49b1-b5ef-7fc300988a84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:07.503402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5c9fa0c-1382-49b1-b5ef-7fc300988a84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:07.504847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5c9fa0c-1382-49b1-b5ef-7fc300988a84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:07.505639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5c9fa0c-1382-49b1-b5ef-7fc300988a84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:07.583884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a5c9fa0c-1382-49b1-b5ef-7fc300988a84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:07.592309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a5c9fa0c-1382-49b1-b5ef-7fc300988a84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.109306 May 23 13:51:07.592935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 675/1271] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:07 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:07.622420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b0eb90a8-1b95-4f44-9556-12e86551de76 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:07.623333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b0eb90a8-1b95-4f44-9556-12e86551de76 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:07.629876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0eb90a8-1b95-4f44-9556-12e86551de76 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:07.630316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0eb90a8-1b95-4f44-9556-12e86551de76 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:07.631067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0eb90a8-1b95-4f44-9556-12e86551de76 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:07.631495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0eb90a8-1b95-4f44-9556-12e86551de76 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:07.661447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b0eb90a8-1b95-4f44-9556-12e86551de76 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 May 23 13:51:07.662012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 597/1272] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:08.348095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e6003cbf-bbab-4889-92eb-de91d82b7369 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:08.349364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e6003cbf-bbab-4889-92eb-de91d82b7369 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:08.357123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6003cbf-bbab-4889-92eb-de91d82b7369 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:08.357568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6003cbf-bbab-4889-92eb-de91d82b7369 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:08.358372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6003cbf-bbab-4889-92eb-de91d82b7369 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:08.358806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6003cbf-bbab-4889-92eb-de91d82b7369 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:08.389867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e6003cbf-bbab-4889-92eb-de91d82b7369 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048016 May 23 13:51:08.390439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 676/1273] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:08 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:08.609616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94907ac1-5c2f-4921-a13c-5b61bf89f04a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:08.610232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94907ac1-5c2f-4921-a13c-5b61bf89f04a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:08.616359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94907ac1-5c2f-4921-a13c-5b61bf89f04a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:08.616838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94907ac1-5c2f-4921-a13c-5b61bf89f04a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:08.617617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94907ac1-5c2f-4921-a13c-5b61bf89f04a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:08.618045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94907ac1-5c2f-4921-a13c-5b61bf89f04a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:08.673972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37fe0340-ce12-42b8-80f5-afe9cedc436e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:08.674905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37fe0340-ce12-42b8-80f5-afe9cedc436e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:08.683038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94907ac1-5c2f-4921-a13c-5b61bf89f04a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:08.684643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37fe0340-ce12-42b8-80f5-afe9cedc436e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:08.685191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37fe0340-ce12-42b8-80f5-afe9cedc436e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:08.686085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37fe0340-ce12-42b8-80f5-afe9cedc436e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:08.686534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37fe0340-ce12-42b8-80f5-afe9cedc436e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:08.691531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94907ac1-5c2f-4921-a13c-5b61bf89f04a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085409 May 23 13:51:08.691794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 598/1274] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:08 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:51:08.719393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37fe0340-ce12-42b8-80f5-afe9cedc436e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049340 May 23 13:51:08.719960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 677/1275] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:09.402234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-51bf00a1-1b7e-4b09-b155-f2dc637a304f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:09.403153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-51bf00a1-1b7e-4b09-b155-f2dc637a304f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:09.409314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51bf00a1-1b7e-4b09-b155-f2dc637a304f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:09.409757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51bf00a1-1b7e-4b09-b155-f2dc637a304f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:09.410513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51bf00a1-1b7e-4b09-b155-f2dc637a304f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:09.410940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51bf00a1-1b7e-4b09-b155-f2dc637a304f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:09.439892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-51bf00a1-1b7e-4b09-b155-f2dc637a304f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 May 23 13:51:09.440358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 599/1276] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:09 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:09.708897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e202f991-cbd8-423c-bdd7-55371fc9b22f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:09.709423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e202f991-cbd8-423c-bdd7-55371fc9b22f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:09.716252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e202f991-cbd8-423c-bdd7-55371fc9b22f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:09.716780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e202f991-cbd8-423c-bdd7-55371fc9b22f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:09.717568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e202f991-cbd8-423c-bdd7-55371fc9b22f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:09.718017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e202f991-cbd8-423c-bdd7-55371fc9b22f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:09.730796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-44c32621-f563-4495-8d2a-cd7f92f5f29b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:09.731990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-44c32621-f563-4495-8d2a-cd7f92f5f29b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:09.738324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44c32621-f563-4495-8d2a-cd7f92f5f29b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:09.738773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44c32621-f563-4495-8d2a-cd7f92f5f29b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:09.739547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44c32621-f563-4495-8d2a-cd7f92f5f29b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:09.739981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44c32621-f563-4495-8d2a-cd7f92f5f29b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:09.771331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-44c32621-f563-4495-8d2a-cd7f92f5f29b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 May 23 13:51:09.771899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 600/1277] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:09.781526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e202f991-cbd8-423c-bdd7-55371fc9b22f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:09.785034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:09.789326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e202f991-cbd8-423c-bdd7-55371fc9b22f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084474 May 23 13:51:09.789897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 678/1278] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:09 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:10.451593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-abc1db5e-9710-4e5c-b8eb-fbb1938ab342 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:10.452420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-abc1db5e-9710-4e5c-b8eb-fbb1938ab342 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:10.458375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abc1db5e-9710-4e5c-b8eb-fbb1938ab342 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:10.458818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abc1db5e-9710-4e5c-b8eb-fbb1938ab342 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:10.459559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abc1db5e-9710-4e5c-b8eb-fbb1938ab342 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:10.459986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abc1db5e-9710-4e5c-b8eb-fbb1938ab342 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:10.489554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-abc1db5e-9710-4e5c-b8eb-fbb1938ab342 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 May 23 13:51:10.490097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 601/1279] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:10 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:10.783258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b007a058-5088-4208-a378-1768887a6bc6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:10.784101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b007a058-5088-4208-a378-1768887a6bc6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:10.791125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b007a058-5088-4208-a378-1768887a6bc6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:10.791608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b007a058-5088-4208-a378-1768887a6bc6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:10.792384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b007a058-5088-4208-a378-1768887a6bc6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:10.792855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b007a058-5088-4208-a378-1768887a6bc6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:10.812168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-723baa4d-b954-414c-bef9-39a00fc9b857 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:10.812807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-723baa4d-b954-414c-bef9-39a00fc9b857 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:10.819312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-723baa4d-b954-414c-bef9-39a00fc9b857 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:10.819758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-723baa4d-b954-414c-bef9-39a00fc9b857 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:10.820511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-723baa4d-b954-414c-bef9-39a00fc9b857 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:10.820975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-723baa4d-b954-414c-bef9-39a00fc9b857 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:10.823718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b007a058-5088-4208-a378-1768887a6bc6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 May 23 13:51:10.824289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 679/1280] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:10.882641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-723baa4d-b954-414c-bef9-39a00fc9b857 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:10.886735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:10.891054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-723baa4d-b954-414c-bef9-39a00fc9b857 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082705 May 23 13:51:10.891621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 602/1281] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:10 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:51:11.510220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d90d34d-feb8-4242-b1b9-c57ce96a8965 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:11.511067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d90d34d-feb8-4242-b1b9-c57ce96a8965 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:11.517155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d90d34d-feb8-4242-b1b9-c57ce96a8965 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:11.517638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d90d34d-feb8-4242-b1b9-c57ce96a8965 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:11.518402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d90d34d-feb8-4242-b1b9-c57ce96a8965 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:11.518838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d90d34d-feb8-4242-b1b9-c57ce96a8965 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:11.547621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d90d34d-feb8-4242-b1b9-c57ce96a8965 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049083 May 23 13:51:11.548179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 680/1282] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:11 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:11.835730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-86258424-1256-4baf-99f7-69b735812573 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:11.836559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-86258424-1256-4baf-99f7-69b735812573 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:11.843309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86258424-1256-4baf-99f7-69b735812573 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:11.843755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86258424-1256-4baf-99f7-69b735812573 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:11.844500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86258424-1256-4baf-99f7-69b735812573 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:11.844963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86258424-1256-4baf-99f7-69b735812573 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:11.873599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-86258424-1256-4baf-99f7-69b735812573 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 May 23 13:51:11.874175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 603/1283] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:11.907312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ea3c751-e803-4b54-bd51-38af5fdebd24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:11.907933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ea3c751-e803-4b54-bd51-38af5fdebd24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:11.914373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ea3c751-e803-4b54-bd51-38af5fdebd24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:11.914860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ea3c751-e803-4b54-bd51-38af5fdebd24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:11.915626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ea3c751-e803-4b54-bd51-38af5fdebd24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:11.916072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ea3c751-e803-4b54-bd51-38af5fdebd24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:11.979464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0ea3c751-e803-4b54-bd51-38af5fdebd24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:11.987331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ea3c751-e803-4b54-bd51-38af5fdebd24 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083824 May 23 13:51:11.987902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 681/1284] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:11 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:12.559616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b24274bf-b828-4ae6-a05d-ee041dbd60b9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:12.560449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b24274bf-b828-4ae6-a05d-ee041dbd60b9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:12.566480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b24274bf-b828-4ae6-a05d-ee041dbd60b9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:12.566932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b24274bf-b828-4ae6-a05d-ee041dbd60b9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:12.567686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b24274bf-b828-4ae6-a05d-ee041dbd60b9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:12.568118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b24274bf-b828-4ae6-a05d-ee041dbd60b9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:12.599241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b24274bf-b828-4ae6-a05d-ee041dbd60b9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 May 23 13:51:12.599798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 604/1285] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:12 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:12.884496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02fa1bb2-c54f-4bf2-a1ac-d8ccc858f678 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:12.885654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02fa1bb2-c54f-4bf2-a1ac-d8ccc858f678 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:12.887597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=86 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:12.892751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fa1bb2-c54f-4bf2-a1ac-d8ccc858f678 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:12.893208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fa1bb2-c54f-4bf2-a1ac-d8ccc858f678 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:12.894021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fa1bb2-c54f-4bf2-a1ac-d8ccc858f678 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:12.894464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fa1bb2-c54f-4bf2-a1ac-d8ccc858f678 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:12.924556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02fa1bb2-c54f-4bf2-a1ac-d8ccc858f678 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 May 23 13:51:12.925233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 682/1286] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:13.005241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0935091f-f9a1-43cb-9855-5106a02cce8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:13.005853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0935091f-f9a1-43cb-9855-5106a02cce8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:13.013366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0935091f-f9a1-43cb-9855-5106a02cce8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:13.013815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0935091f-f9a1-43cb-9855-5106a02cce8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:13.014582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0935091f-f9a1-43cb-9855-5106a02cce8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:13.015019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0935091f-f9a1-43cb-9855-5106a02cce8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:13.080086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0935091f-f9a1-43cb-9855-5106a02cce8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:13.088106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0935091f-f9a1-43cb-9855-5106a02cce8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086626 May 23 13:51:13.089310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 605/1287] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:13 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:13.611395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-90b1fb59-1b18-44e3-b864-bb181e8f7233 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:13.612327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-90b1fb59-1b18-44e3-b864-bb181e8f7233 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:13.618735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90b1fb59-1b18-44e3-b864-bb181e8f7233 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:13.619725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90b1fb59-1b18-44e3-b864-bb181e8f7233 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:13.620516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90b1fb59-1b18-44e3-b864-bb181e8f7233 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:13.621152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90b1fb59-1b18-44e3-b864-bb181e8f7233 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:13.651749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-90b1fb59-1b18-44e3-b864-bb181e8f7233 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 May 23 13:51:13.652310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 683/1288] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:13 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:13.936280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3dc5a8ea-da41-4cf5-816d-650b94fb0035 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:13.937135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3dc5a8ea-da41-4cf5-816d-650b94fb0035 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:13.943116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dc5a8ea-da41-4cf5-816d-650b94fb0035 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:13.943561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dc5a8ea-da41-4cf5-816d-650b94fb0035 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:13.944316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dc5a8ea-da41-4cf5-816d-650b94fb0035 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:13.944778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dc5a8ea-da41-4cf5-816d-650b94fb0035 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:13.975594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3dc5a8ea-da41-4cf5-816d-650b94fb0035 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 May 23 13:51:13.976156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 606/1289] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:14.105894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fd657edf-3117-4be7-b937-3bb39211032a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:14.106510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fd657edf-3117-4be7-b937-3bb39211032a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:14.113106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd657edf-3117-4be7-b937-3bb39211032a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:14.113557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd657edf-3117-4be7-b937-3bb39211032a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:14.114319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd657edf-3117-4be7-b937-3bb39211032a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:14.114755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd657edf-3117-4be7-b937-3bb39211032a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:14.180945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fd657edf-3117-4be7-b937-3bb39211032a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:14.197456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fd657edf-3117-4be7-b937-3bb39211032a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.095275 May 23 13:51:14.198645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 684/1290] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:14 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:14.663416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0680052f-22d3-4269-bd09-eabdcc71061e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:14.664336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0680052f-22d3-4269-bd09-eabdcc71061e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:14.667423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=86 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:14.672210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0680052f-22d3-4269-bd09-eabdcc71061e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:14.681133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0680052f-22d3-4269-bd09-eabdcc71061e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:14.681133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0680052f-22d3-4269-bd09-eabdcc71061e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:14.681133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0680052f-22d3-4269-bd09-eabdcc71061e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:14.703931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0680052f-22d3-4269-bd09-eabdcc71061e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044430 May 23 13:51:14.704499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 607/1291] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:14 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:14.987808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-884ee8df-6fb9-4063-a881-9054554777b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:14.988665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-884ee8df-6fb9-4063-a881-9054554777b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:14.995666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-884ee8df-6fb9-4063-a881-9054554777b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:14.996113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-884ee8df-6fb9-4063-a881-9054554777b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:14.996946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-884ee8df-6fb9-4063-a881-9054554777b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:14.997385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-884ee8df-6fb9-4063-a881-9054554777b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:15.026849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-884ee8df-6fb9-4063-a881-9054554777b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043254 May 23 13:51:15.027416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 685/1292] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:15.216411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2744d91-af2a-4174-a31a-3d24237d3e3d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:15.217055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2744d91-af2a-4174-a31a-3d24237d3e3d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:15.223362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2744d91-af2a-4174-a31a-3d24237d3e3d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:15.223811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2744d91-af2a-4174-a31a-3d24237d3e3d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:15.224590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2744d91-af2a-4174-a31a-3d24237d3e3d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:15.225025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2744d91-af2a-4174-a31a-3d24237d3e3d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:15.286372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2744d91-af2a-4174-a31a-3d24237d3e3d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:15.294319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2744d91-af2a-4174-a31a-3d24237d3e3d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082360 May 23 13:51:15.294870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 608/1293] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:15 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:15.715919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-29e6011c-81fe-408f-9499-19dcdfad2dd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:15.716870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-29e6011c-81fe-408f-9499-19dcdfad2dd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:15.722921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29e6011c-81fe-408f-9499-19dcdfad2dd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:15.723372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29e6011c-81fe-408f-9499-19dcdfad2dd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:15.724129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29e6011c-81fe-408f-9499-19dcdfad2dd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:15.724591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29e6011c-81fe-408f-9499-19dcdfad2dd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:15.755027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-29e6011c-81fe-408f-9499-19dcdfad2dd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 May 23 13:51:15.755589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 686/1294] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:15 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:16.038675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8fe7d6e-60cc-40be-b22c-6d0bb1e43679 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:16.039521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8fe7d6e-60cc-40be-b22c-6d0bb1e43679 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:16.046619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8fe7d6e-60cc-40be-b22c-6d0bb1e43679 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:16.047068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8fe7d6e-60cc-40be-b22c-6d0bb1e43679 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:16.047839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8fe7d6e-60cc-40be-b22c-6d0bb1e43679 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:16.048309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8fe7d6e-60cc-40be-b22c-6d0bb1e43679 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:16.078056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8fe7d6e-60cc-40be-b22c-6d0bb1e43679 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 May 23 13:51:16.078619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 609/1295] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:16 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:16.311979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fc5f0904-1c0b-4a92-a05a-da297f0adca0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:16.312501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fc5f0904-1c0b-4a92-a05a-da297f0adca0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:16.318995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc5f0904-1c0b-4a92-a05a-da297f0adca0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:16.319438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc5f0904-1c0b-4a92-a05a-da297f0adca0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:16.320193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc5f0904-1c0b-4a92-a05a-da297f0adca0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:16.320655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc5f0904-1c0b-4a92-a05a-da297f0adca0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:16.384616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fc5f0904-1c0b-4a92-a05a-da297f0adca0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:16.392754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fc5f0904-1c0b-4a92-a05a-da297f0adca0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084898 May 23 13:51:16.393313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 687/1296] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:16 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:16.766573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ee85150a-4c62-41e4-83e5-dfe4628b01de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:16.767489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ee85150a-4c62-41e4-83e5-dfe4628b01de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:16.773735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee85150a-4c62-41e4-83e5-dfe4628b01de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:16.774843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee85150a-4c62-41e4-83e5-dfe4628b01de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:16.775646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee85150a-4c62-41e4-83e5-dfe4628b01de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:16.776197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee85150a-4c62-41e4-83e5-dfe4628b01de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:16.805729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ee85150a-4c62-41e4-83e5-dfe4628b01de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043220 May 23 13:51:16.806299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 610/1297] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:16 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:17.090733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ce37461-842f-4432-ac47-4cdd33ac3cd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:17.091561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ce37461-842f-4432-ac47-4cdd33ac3cd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:17.097642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ce37461-842f-4432-ac47-4cdd33ac3cd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:17.098091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ce37461-842f-4432-ac47-4cdd33ac3cd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:17.098850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ce37461-842f-4432-ac47-4cdd33ac3cd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:17.099280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ce37461-842f-4432-ac47-4cdd33ac3cd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:17.132355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ce37461-842f-4432-ac47-4cdd33ac3cd8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046506 May 23 13:51:17.132933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 688/1298] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:17.409338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8d007c15-55c5-42a0-9c9d-2594ffe53f37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:17.409954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8d007c15-55c5-42a0-9c9d-2594ffe53f37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:17.417229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d007c15-55c5-42a0-9c9d-2594ffe53f37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:17.417676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d007c15-55c5-42a0-9c9d-2594ffe53f37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:17.418433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d007c15-55c5-42a0-9c9d-2594ffe53f37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:17.418857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d007c15-55c5-42a0-9c9d-2594ffe53f37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:17.480004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8d007c15-55c5-42a0-9c9d-2594ffe53f37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:17.487480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8d007c15-55c5-42a0-9c9d-2594ffe53f37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082033 May 23 13:51:17.488037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 611/1299] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:17 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:17.818119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eecdb752-bbe6-4328-b63d-cba19f9a9918 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:17.819029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eecdb752-bbe6-4328-b63d-cba19f9a9918 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:17.826171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eecdb752-bbe6-4328-b63d-cba19f9a9918 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:17.826621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eecdb752-bbe6-4328-b63d-cba19f9a9918 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:17.827379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eecdb752-bbe6-4328-b63d-cba19f9a9918 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:17.827812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eecdb752-bbe6-4328-b63d-cba19f9a9918 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:17.856242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eecdb752-bbe6-4328-b63d-cba19f9a9918 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042074 May 23 13:51:17.856823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 689/1300] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:17 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:18.143972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8026317b-e0d5-4ea7-8235-616869a4aac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:18.144921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8026317b-e0d5-4ea7-8235-616869a4aac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:18.151080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8026317b-e0d5-4ea7-8235-616869a4aac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:18.151535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8026317b-e0d5-4ea7-8235-616869a4aac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:18.152295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8026317b-e0d5-4ea7-8235-616869a4aac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:18.152840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8026317b-e0d5-4ea7-8235-616869a4aac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:18.183624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8026317b-e0d5-4ea7-8235-616869a4aac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 May 23 13:51:18.183814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 612/1301] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:18.505062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-285c846a-7e19-4de8-8297-aedc969a6d0a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:18.505580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-285c846a-7e19-4de8-8297-aedc969a6d0a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:18.511874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-285c846a-7e19-4de8-8297-aedc969a6d0a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:18.512325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-285c846a-7e19-4de8-8297-aedc969a6d0a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:18.513121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-285c846a-7e19-4de8-8297-aedc969a6d0a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:18.513561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-285c846a-7e19-4de8-8297-aedc969a6d0a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:18.574153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-285c846a-7e19-4de8-8297-aedc969a6d0a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:18.581688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-285c846a-7e19-4de8-8297-aedc969a6d0a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.080583 May 23 13:51:18.582256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 690/1302] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:18 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:18.867441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-79dd3d00-1813-41e7-8a22-810afaaaee06 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:18.868480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-79dd3d00-1813-41e7-8a22-810afaaaee06 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:18.875380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79dd3d00-1813-41e7-8a22-810afaaaee06 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:18.875819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79dd3d00-1813-41e7-8a22-810afaaaee06 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:18.876603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79dd3d00-1813-41e7-8a22-810afaaaee06 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:18.877104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79dd3d00-1813-41e7-8a22-810afaaaee06 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:18.906067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-79dd3d00-1813-41e7-8a22-810afaaaee06 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042559 May 23 13:51:18.906621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 613/1303] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:18 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:19.195292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7af20570-ef0f-4b45-9efd-bddd89eb48a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:19.196313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7af20570-ef0f-4b45-9efd-bddd89eb48a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:19.203698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7af20570-ef0f-4b45-9efd-bddd89eb48a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:19.204147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7af20570-ef0f-4b45-9efd-bddd89eb48a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:19.204950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7af20570-ef0f-4b45-9efd-bddd89eb48a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:19.205390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7af20570-ef0f-4b45-9efd-bddd89eb48a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:19.235706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7af20570-ef0f-4b45-9efd-bddd89eb48a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 May 23 13:51:19.236274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 691/1304] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:19.599359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7248ff4-1155-4423-bcd3-f0ac5751d01e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:19.599890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7248ff4-1155-4423-bcd3-f0ac5751d01e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:19.606256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7248ff4-1155-4423-bcd3-f0ac5751d01e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:19.606706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7248ff4-1155-4423-bcd3-f0ac5751d01e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:19.607468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7248ff4-1155-4423-bcd3-f0ac5751d01e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:19.607902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7248ff4-1155-4423-bcd3-f0ac5751d01e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:19.680072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7248ff4-1155-4423-bcd3-f0ac5751d01e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:19.689043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7248ff4-1155-4423-bcd3-f0ac5751d01e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093558 May 23 13:51:19.689610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 614/1305] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:19 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:51:19.918384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d1e99b20-887c-4bd3-b8ab-d4e14e90d94d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:19.919353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d1e99b20-887c-4bd3-b8ab-d4e14e90d94d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:19.925392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1e99b20-887c-4bd3-b8ab-d4e14e90d94d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:19.925839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1e99b20-887c-4bd3-b8ab-d4e14e90d94d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:19.926594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1e99b20-887c-4bd3-b8ab-d4e14e90d94d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:19.927069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1e99b20-887c-4bd3-b8ab-d4e14e90d94d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:19.955783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d1e99b20-887c-4bd3-b8ab-d4e14e90d94d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041977 May 23 13:51:19.956340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 692/1306] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:19 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:20.247378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8200ef5c-cb0b-4c68-a496-e3e7dbecfda2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:20.248331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8200ef5c-cb0b-4c68-a496-e3e7dbecfda2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:20.255054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8200ef5c-cb0b-4c68-a496-e3e7dbecfda2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:20.255499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8200ef5c-cb0b-4c68-a496-e3e7dbecfda2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:20.256254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8200ef5c-cb0b-4c68-a496-e3e7dbecfda2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:20.256726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8200ef5c-cb0b-4c68-a496-e3e7dbecfda2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:20.287784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8200ef5c-cb0b-4c68-a496-e3e7dbecfda2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 May 23 13:51:20.288342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 615/1307] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:20.706835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7209de42-f3c0-41dc-9c61-16d803e68c10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:20.707454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7209de42-f3c0-41dc-9c61-16d803e68c10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:20.714889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7209de42-f3c0-41dc-9c61-16d803e68c10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:20.715344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7209de42-f3c0-41dc-9c61-16d803e68c10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:20.716116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7209de42-f3c0-41dc-9c61-16d803e68c10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:20.716581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7209de42-f3c0-41dc-9c61-16d803e68c10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:20.778354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7209de42-f3c0-41dc-9c61-16d803e68c10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:20.786198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7209de42-f3c0-41dc-9c61-16d803e68c10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083181 May 23 13:51:20.786803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 693/1308] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:20 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:20.967989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89006754-c596-445b-9da6-a54c26cf1dc8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:20.968926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-89006754-c596-445b-9da6-a54c26cf1dc8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:20.975273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89006754-c596-445b-9da6-a54c26cf1dc8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:20.975716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89006754-c596-445b-9da6-a54c26cf1dc8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:20.976470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89006754-c596-445b-9da6-a54c26cf1dc8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:20.976933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89006754-c596-445b-9da6-a54c26cf1dc8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:21.007875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89006754-c596-445b-9da6-a54c26cf1dc8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 May 23 13:51:21.008441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 616/1309] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:20 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:21.299571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d5af881f-9056-4102-85e3-e309f7698489 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:21.300516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d5af881f-9056-4102-85e3-e309f7698489 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:21.306700 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5af881f-9056-4102-85e3-e309f7698489 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:21.307155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5af881f-9056-4102-85e3-e309f7698489 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:21.307927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5af881f-9056-4102-85e3-e309f7698489 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:21.308364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5af881f-9056-4102-85e3-e309f7698489 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:21.339000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d5af881f-9056-4102-85e3-e309f7698489 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 May 23 13:51:21.339566 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 694/1310] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:21.804220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89f2f760-0b63-4eff-b9f5-2cf60ab455db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:21.804861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-89f2f760-0b63-4eff-b9f5-2cf60ab455db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:21.812477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89f2f760-0b63-4eff-b9f5-2cf60ab455db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:21.812960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89f2f760-0b63-4eff-b9f5-2cf60ab455db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:21.813733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89f2f760-0b63-4eff-b9f5-2cf60ab455db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:21.814175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89f2f760-0b63-4eff-b9f5-2cf60ab455db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:21.883557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89f2f760-0b63-4eff-b9f5-2cf60ab455db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:21.893568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89f2f760-0b63-4eff-b9f5-2cf60ab455db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093915 May 23 13:51:21.894081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 617/1311] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:21 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:22.019688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-98311481-683e-4ed0-a691-7f1b2feda234 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:22.020619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-98311481-683e-4ed0-a691-7f1b2feda234 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:22.027211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98311481-683e-4ed0-a691-7f1b2feda234 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:22.027657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98311481-683e-4ed0-a691-7f1b2feda234 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:22.028416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98311481-683e-4ed0-a691-7f1b2feda234 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:22.028873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98311481-683e-4ed0-a691-7f1b2feda234 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:22.045525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:22.058367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-98311481-683e-4ed0-a691-7f1b2feda234 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 May 23 13:51:22.060891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 695/1312] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:22 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:22.350714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-21aa9d08-b19a-4efb-b902-9c4139ba4b43 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:22.351578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-21aa9d08-b19a-4efb-b902-9c4139ba4b43 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:22.358113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21aa9d08-b19a-4efb-b902-9c4139ba4b43 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:22.358560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21aa9d08-b19a-4efb-b902-9c4139ba4b43 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:22.359315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21aa9d08-b19a-4efb-b902-9c4139ba4b43 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:22.359778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21aa9d08-b19a-4efb-b902-9c4139ba4b43 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:22.388004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-21aa9d08-b19a-4efb-b902-9c4139ba4b43 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 May 23 13:51:22.388551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 618/1313] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:22.911107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9fc1ddd4-80ab-446d-b261-ab0a768c9e87 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:22.911729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9fc1ddd4-80ab-446d-b261-ab0a768c9e87 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:22.918108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fc1ddd4-80ab-446d-b261-ab0a768c9e87 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:22.918567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fc1ddd4-80ab-446d-b261-ab0a768c9e87 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:22.919333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fc1ddd4-80ab-446d-b261-ab0a768c9e87 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:22.919776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fc1ddd4-80ab-446d-b261-ab0a768c9e87 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:22.980820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9fc1ddd4-80ab-446d-b261-ab0a768c9e87 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:22.988334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9fc1ddd4-80ab-446d-b261-ab0a768c9e87 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.081465 May 23 13:51:22.988927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 696/1314] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:22 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:23.070764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-70e8d7b8-1aaa-4925-8807-a10e9fb377cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:23.072724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-70e8d7b8-1aaa-4925-8807-a10e9fb377cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:23.079321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70e8d7b8-1aaa-4925-8807-a10e9fb377cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:23.079795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70e8d7b8-1aaa-4925-8807-a10e9fb377cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:23.080595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70e8d7b8-1aaa-4925-8807-a10e9fb377cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:23.081019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70e8d7b8-1aaa-4925-8807-a10e9fb377cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:23.098301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:23.111305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-70e8d7b8-1aaa-4925-8807-a10e9fb377cc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 May 23 13:51:23.112666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 619/1315] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:23 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:23.399432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15453c15-20af-45d8-ab9f-10eada4de106 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:23.400420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15453c15-20af-45d8-ab9f-10eada4de106 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:23.406974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15453c15-20af-45d8-ab9f-10eada4de106 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:23.407431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15453c15-20af-45d8-ab9f-10eada4de106 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:23.408207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15453c15-20af-45d8-ab9f-10eada4de106 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:23.408685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15453c15-20af-45d8-ab9f-10eada4de106 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:23.438717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15453c15-20af-45d8-ab9f-10eada4de106 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043229 May 23 13:51:23.439279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 697/1316] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:24.005495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf7b44e4-ce67-471d-b858-b0338fc7965b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:24.006054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf7b44e4-ce67-471d-b858-b0338fc7965b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:24.013765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf7b44e4-ce67-471d-b858-b0338fc7965b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:24.014218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf7b44e4-ce67-471d-b858-b0338fc7965b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:24.014985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf7b44e4-ce67-471d-b858-b0338fc7965b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:24.015419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf7b44e4-ce67-471d-b858-b0338fc7965b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:24.078783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bf7b44e4-ce67-471d-b858-b0338fc7965b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:24.086318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf7b44e4-ce67-471d-b858-b0338fc7965b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084883 May 23 13:51:24.087174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 620/1317] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:24 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:24.123633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c978759b-dec9-497c-bba9-1e0d3a5d76f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:24.124557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c978759b-dec9-497c-bba9-1e0d3a5d76f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:24.130622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c978759b-dec9-497c-bba9-1e0d3a5d76f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:24.131077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c978759b-dec9-497c-bba9-1e0d3a5d76f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:24.131842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c978759b-dec9-497c-bba9-1e0d3a5d76f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:24.132279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c978759b-dec9-497c-bba9-1e0d3a5d76f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:24.161238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c978759b-dec9-497c-bba9-1e0d3a5d76f8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 May 23 13:51:24.161797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 698/1318] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:24 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:24.451142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb993e23-6d09-423a-b05d-c90a8e42f534 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:24.452064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb993e23-6d09-423a-b05d-c90a8e42f534 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:24.458101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb993e23-6d09-423a-b05d-c90a8e42f534 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:24.458544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb993e23-6d09-423a-b05d-c90a8e42f534 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:24.459305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb993e23-6d09-423a-b05d-c90a8e42f534 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:24.459740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb993e23-6d09-423a-b05d-c90a8e42f534 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:24.490041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb993e23-6d09-423a-b05d-c90a8e42f534 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043026 May 23 13:51:24.490602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 621/1319] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:25.104790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ad63d06-f19f-4b15-a341-740f8e38a47b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:25.105439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3ad63d06-f19f-4b15-a341-740f8e38a47b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:25.111903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ad63d06-f19f-4b15-a341-740f8e38a47b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:25.112358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ad63d06-f19f-4b15-a341-740f8e38a47b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:25.113159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ad63d06-f19f-4b15-a341-740f8e38a47b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:25.113601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ad63d06-f19f-4b15-a341-740f8e38a47b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:25.173341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3ff170bd-3a0f-4325-91b3-711479c84409 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:25.174384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3ff170bd-3a0f-4325-91b3-711479c84409 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:25.181102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ad63d06-f19f-4b15-a341-740f8e38a47b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:25.182027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ff170bd-3a0f-4325-91b3-711479c84409 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:25.182321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ff170bd-3a0f-4325-91b3-711479c84409 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:25.183842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ff170bd-3a0f-4325-91b3-711479c84409 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:25.183842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ff170bd-3a0f-4325-91b3-711479c84409 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:25.190420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ad63d06-f19f-4b15-a341-740f8e38a47b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090028 May 23 13:51:25.191013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 699/1320] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:25 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:25.213934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3ff170bd-3a0f-4325-91b3-711479c84409 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 May 23 13:51:25.214487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 622/1321] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:25 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:25.502110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d76d4849-07ef-40e1-836c-3a7c860080cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:25.503034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d76d4849-07ef-40e1-836c-3a7c860080cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:25.509036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d76d4849-07ef-40e1-836c-3a7c860080cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:25.509681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d76d4849-07ef-40e1-836c-3a7c860080cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:25.510265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d76d4849-07ef-40e1-836c-3a7c860080cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:25.510706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d76d4849-07ef-40e1-836c-3a7c860080cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:25.539778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d76d4849-07ef-40e1-836c-3a7c860080cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041646 May 23 13:51:25.540338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 700/1322] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:26.207210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-24a67375-30c2-4518-81ad-d7cc68ee6742 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:26.207824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-24a67375-30c2-4518-81ad-d7cc68ee6742 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:26.214872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24a67375-30c2-4518-81ad-d7cc68ee6742 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:26.218049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24a67375-30c2-4518-81ad-d7cc68ee6742 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:26.218049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24a67375-30c2-4518-81ad-d7cc68ee6742 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:26.218049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24a67375-30c2-4518-81ad-d7cc68ee6742 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:26.225494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a485ffb4-f5fe-4935-b985-514cfb90cea5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:26.226490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a485ffb4-f5fe-4935-b985-514cfb90cea5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:26.233032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a485ffb4-f5fe-4935-b985-514cfb90cea5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:26.233479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a485ffb4-f5fe-4935-b985-514cfb90cea5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:26.234285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a485ffb4-f5fe-4935-b985-514cfb90cea5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:26.234716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a485ffb4-f5fe-4935-b985-514cfb90cea5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:26.265112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a485ffb4-f5fe-4935-b985-514cfb90cea5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 May 23 13:51:26.265678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 701/1323] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:26 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:26.280371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-24a67375-30c2-4518-81ad-d7cc68ee6742 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:26.287893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-24a67375-30c2-4518-81ad-d7cc68ee6742 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084572 May 23 13:51:26.288452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 623/1324] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:26 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:26.557395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-adf0cd3e-ae05-43de-9e4d-a2179ed6a092 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:26.558724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-adf0cd3e-ae05-43de-9e4d-a2179ed6a092 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:26.565591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adf0cd3e-ae05-43de-9e4d-a2179ed6a092 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:26.566043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adf0cd3e-ae05-43de-9e4d-a2179ed6a092 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:26.566844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adf0cd3e-ae05-43de-9e4d-a2179ed6a092 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:26.567284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adf0cd3e-ae05-43de-9e4d-a2179ed6a092 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:26.597508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-adf0cd3e-ae05-43de-9e4d-a2179ed6a092 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 May 23 13:51:26.599212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 702/1325] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:27.277294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-746eea36-1c8d-4347-98c7-bae13d9adba9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:27.278200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-746eea36-1c8d-4347-98c7-bae13d9adba9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:27.284590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-746eea36-1c8d-4347-98c7-bae13d9adba9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:27.285049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-746eea36-1c8d-4347-98c7-bae13d9adba9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:27.285800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-746eea36-1c8d-4347-98c7-bae13d9adba9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:27.286224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-746eea36-1c8d-4347-98c7-bae13d9adba9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:27.304843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fecdf2e7-ba14-4f1b-8855-a9dfae77e2f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:27.305469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fecdf2e7-ba14-4f1b-8855-a9dfae77e2f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:27.312534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fecdf2e7-ba14-4f1b-8855-a9dfae77e2f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:27.313024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fecdf2e7-ba14-4f1b-8855-a9dfae77e2f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:27.313828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fecdf2e7-ba14-4f1b-8855-a9dfae77e2f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:27.314271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fecdf2e7-ba14-4f1b-8855-a9dfae77e2f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:27.316915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-746eea36-1c8d-4347-98c7-bae13d9adba9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 May 23 13:51:27.317483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 624/1326] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:27 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:27.380210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fecdf2e7-ba14-4f1b-8855-a9dfae77e2f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:27.388485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fecdf2e7-ba14-4f1b-8855-a9dfae77e2f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087664 May 23 13:51:27.389071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 703/1327] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:27 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:51:27.608478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-292a4eb2-90ee-40d2-84b6-d325d6d6bf9f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:27.609426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-292a4eb2-90ee-40d2-84b6-d325d6d6bf9f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:27.622594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-292a4eb2-90ee-40d2-84b6-d325d6d6bf9f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:27.622594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-292a4eb2-90ee-40d2-84b6-d325d6d6bf9f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:27.622594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-292a4eb2-90ee-40d2-84b6-d325d6d6bf9f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:27.622594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-292a4eb2-90ee-40d2-84b6-d325d6d6bf9f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:27.647871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-292a4eb2-90ee-40d2-84b6-d325d6d6bf9f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 May 23 13:51:27.648444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 625/1328] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:28.329038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-219264da-b146-4164-8651-6adf2e1ba7b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:28.329964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-219264da-b146-4164-8651-6adf2e1ba7b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:28.336894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-219264da-b146-4164-8651-6adf2e1ba7b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:28.337365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-219264da-b146-4164-8651-6adf2e1ba7b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:28.338099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-219264da-b146-4164-8651-6adf2e1ba7b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:28.338543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-219264da-b146-4164-8651-6adf2e1ba7b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:28.367421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-219264da-b146-4164-8651-6adf2e1ba7b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042327 May 23 13:51:28.368024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 704/1329] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:28 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:28.405840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c01cfd9-42c1-444e-ab4e-4de1b0aad836 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:28.406594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c01cfd9-42c1-444e-ab4e-4de1b0aad836 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:28.413083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c01cfd9-42c1-444e-ab4e-4de1b0aad836 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:28.413527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c01cfd9-42c1-444e-ab4e-4de1b0aad836 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:28.414292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c01cfd9-42c1-444e-ab4e-4de1b0aad836 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:28.414722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c01cfd9-42c1-444e-ab4e-4de1b0aad836 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:28.477675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c01cfd9-42c1-444e-ab4e-4de1b0aad836 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:28.485190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c01cfd9-42c1-444e-ab4e-4de1b0aad836 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083226 May 23 13:51:28.485751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 626/1330] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:28 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:28.660298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-22c9b0d8-e204-4d9c-b0f6-ba62db1b70fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:28.661258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-22c9b0d8-e204-4d9c-b0f6-ba62db1b70fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:28.667970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22c9b0d8-e204-4d9c-b0f6-ba62db1b70fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:28.668420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22c9b0d8-e204-4d9c-b0f6-ba62db1b70fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:28.669221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22c9b0d8-e204-4d9c-b0f6-ba62db1b70fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:28.669656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22c9b0d8-e204-4d9c-b0f6-ba62db1b70fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:28.699708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-22c9b0d8-e204-4d9c-b0f6-ba62db1b70fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 May 23 13:51:28.700280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 705/1331] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:29.379989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e8f8fef-68d8-4b61-9aa9-e4b9a43ae6fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:29.380942 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e8f8fef-68d8-4b61-9aa9-e4b9a43ae6fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:29.386950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e8f8fef-68d8-4b61-9aa9-e4b9a43ae6fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:29.387397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e8f8fef-68d8-4b61-9aa9-e4b9a43ae6fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:29.388153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e8f8fef-68d8-4b61-9aa9-e4b9a43ae6fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:29.388602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e8f8fef-68d8-4b61-9aa9-e4b9a43ae6fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:29.418865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e8f8fef-68d8-4b61-9aa9-e4b9a43ae6fb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042793 May 23 13:51:29.419548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 627/1332] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:29 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:29.502891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f542612-6de1-49e7-a243-252773bcfab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:29.503419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f542612-6de1-49e7-a243-252773bcfab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:29.510336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f542612-6de1-49e7-a243-252773bcfab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:29.510778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f542612-6de1-49e7-a243-252773bcfab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:29.511533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f542612-6de1-49e7-a243-252773bcfab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:29.511961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f542612-6de1-49e7-a243-252773bcfab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:29.582922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f542612-6de1-49e7-a243-252773bcfab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:29.594622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f542612-6de1-49e7-a243-252773bcfab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.095422 May 23 13:51:29.595479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 706/1333] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:29 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:29.711843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb97e57d-7c90-485b-80d9-6c63852e48cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:29.713419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb97e57d-7c90-485b-80d9-6c63852e48cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:29.719611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb97e57d-7c90-485b-80d9-6c63852e48cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:29.720062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb97e57d-7c90-485b-80d9-6c63852e48cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:29.720840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb97e57d-7c90-485b-80d9-6c63852e48cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:29.721276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb97e57d-7c90-485b-80d9-6c63852e48cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:29.752062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb97e57d-7c90-485b-80d9-6c63852e48cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 May 23 13:51:29.752639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 628/1334] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:30.430557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-664b3799-ff0c-4e0e-af86-1a6b4c1608be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:30.432079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-664b3799-ff0c-4e0e-af86-1a6b4c1608be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:30.438175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-664b3799-ff0c-4e0e-af86-1a6b4c1608be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:30.438567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-664b3799-ff0c-4e0e-af86-1a6b4c1608be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:30.439330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-664b3799-ff0c-4e0e-af86-1a6b4c1608be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:30.439769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-664b3799-ff0c-4e0e-af86-1a6b4c1608be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:30.468272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-664b3799-ff0c-4e0e-af86-1a6b4c1608be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041660 May 23 13:51:30.468929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 707/1335] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:30 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:30.616426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3d58b316-0823-49ec-9783-37a64bed530b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:30.617098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3d58b316-0823-49ec-9783-37a64bed530b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:30.623246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d58b316-0823-49ec-9783-37a64bed530b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:30.623721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d58b316-0823-49ec-9783-37a64bed530b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:30.624484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d58b316-0823-49ec-9783-37a64bed530b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:30.624949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d58b316-0823-49ec-9783-37a64bed530b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:30.690285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3d58b316-0823-49ec-9783-37a64bed530b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:30.697920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3d58b316-0823-49ec-9783-37a64bed530b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085334 May 23 13:51:30.698484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 629/1336] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:30 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:30.764485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efdfa544-b1e5-4efb-a4aa-ef1bbc10462b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:30.765458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efdfa544-b1e5-4efb-a4aa-ef1bbc10462b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:30.772068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efdfa544-b1e5-4efb-a4aa-ef1bbc10462b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:30.772516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efdfa544-b1e5-4efb-a4aa-ef1bbc10462b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:30.773303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efdfa544-b1e5-4efb-a4aa-ef1bbc10462b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:30.773745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efdfa544-b1e5-4efb-a4aa-ef1bbc10462b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:30.803579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efdfa544-b1e5-4efb-a4aa-ef1bbc10462b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043046 May 23 13:51:30.804135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 708/1337] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:31.480070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1ce9a53b-2bdd-4c7a-8d97-9448c96350d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:31.480926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1ce9a53b-2bdd-4c7a-8d97-9448c96350d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:31.487361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ce9a53b-2bdd-4c7a-8d97-9448c96350d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:31.487798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ce9a53b-2bdd-4c7a-8d97-9448c96350d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:31.488545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ce9a53b-2bdd-4c7a-8d97-9448c96350d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:31.488996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ce9a53b-2bdd-4c7a-8d97-9448c96350d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:31.517623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1ce9a53b-2bdd-4c7a-8d97-9448c96350d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042088 May 23 13:51:31.518167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 630/1338] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:31 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:31.715823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b98392bd-2ed1-43cd-b433-a299a9e9f5e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:31.716432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b98392bd-2ed1-43cd-b433-a299a9e9f5e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:31.722450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98392bd-2ed1-43cd-b433-a299a9e9f5e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:31.722894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98392bd-2ed1-43cd-b433-a299a9e9f5e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:31.723648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98392bd-2ed1-43cd-b433-a299a9e9f5e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:31.724085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98392bd-2ed1-43cd-b433-a299a9e9f5e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:31.784446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b98392bd-2ed1-43cd-b433-a299a9e9f5e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:31.791888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b98392bd-2ed1-43cd-b433-a299a9e9f5e6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.080988 May 23 13:51:31.792442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 709/1339] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:31 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:31.815182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-601303c1-1b5b-4dca-ac3e-3ca1270b3fa4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:31.816101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-601303c1-1b5b-4dca-ac3e-3ca1270b3fa4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:31.823105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-601303c1-1b5b-4dca-ac3e-3ca1270b3fa4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:31.823542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-601303c1-1b5b-4dca-ac3e-3ca1270b3fa4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:31.824299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-601303c1-1b5b-4dca-ac3e-3ca1270b3fa4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:31.824758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-601303c1-1b5b-4dca-ac3e-3ca1270b3fa4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:31.854239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-601303c1-1b5b-4dca-ac3e-3ca1270b3fa4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042783 May 23 13:51:31.854817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 631/1340] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:32.529773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f554c4ef-af53-4985-8a21-50373c313156 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:32.530604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f554c4ef-af53-4985-8a21-50373c313156 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:32.536530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f554c4ef-af53-4985-8a21-50373c313156 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:32.537004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f554c4ef-af53-4985-8a21-50373c313156 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:32.537755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f554c4ef-af53-4985-8a21-50373c313156 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:32.538186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f554c4ef-af53-4985-8a21-50373c313156 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:32.568531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f554c4ef-af53-4985-8a21-50373c313156 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 May 23 13:51:32.569129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 710/1341] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:32 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:32.808151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d566f80-4792-4b21-800e-62fb09d381ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:32.808731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d566f80-4792-4b21-800e-62fb09d381ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:32.815330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d566f80-4792-4b21-800e-62fb09d381ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:32.815935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d566f80-4792-4b21-800e-62fb09d381ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:32.816524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d566f80-4792-4b21-800e-62fb09d381ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:32.817436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d566f80-4792-4b21-800e-62fb09d381ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:32.865860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff03c8b6-484f-4e11-95ce-9b454b72fa04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:32.866831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff03c8b6-484f-4e11-95ce-9b454b72fa04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:32.873651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff03c8b6-484f-4e11-95ce-9b454b72fa04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:32.874095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff03c8b6-484f-4e11-95ce-9b454b72fa04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:32.874884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff03c8b6-484f-4e11-95ce-9b454b72fa04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:32.875326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff03c8b6-484f-4e11-95ce-9b454b72fa04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:32.879654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d566f80-4792-4b21-800e-62fb09d381ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:32.887284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d566f80-4792-4b21-800e-62fb09d381ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083250 May 23 13:51:32.887878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 632/1342] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:32 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:32.906032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff03c8b6-484f-4e11-95ce-9b454b72fa04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 May 23 13:51:32.906593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 711/1343] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:32 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:33.582152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9c66382-58d6-4921-a435-07b614d7d344 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:33.582980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9c66382-58d6-4921-a435-07b614d7d344 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:33.589540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9c66382-58d6-4921-a435-07b614d7d344 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:33.589984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9c66382-58d6-4921-a435-07b614d7d344 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:33.590735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9c66382-58d6-4921-a435-07b614d7d344 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:33.591189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9c66382-58d6-4921-a435-07b614d7d344 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:33.621608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9c66382-58d6-4921-a435-07b614d7d344 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 May 23 13:51:33.622200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 633/1344] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:33 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:33.903981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2755e2d8-292c-4ed5-b26c-71fac85b1740 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:33.904612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2755e2d8-292c-4ed5-b26c-71fac85b1740 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:33.911266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2755e2d8-292c-4ed5-b26c-71fac85b1740 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:33.911706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2755e2d8-292c-4ed5-b26c-71fac85b1740 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:33.912466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2755e2d8-292c-4ed5-b26c-71fac85b1740 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:33.912928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2755e2d8-292c-4ed5-b26c-71fac85b1740 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:33.917518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:33.918820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-608b3de7-882c-40bb-92b3-0eaf0fb676f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:33.919754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-608b3de7-882c-40bb-92b3-0eaf0fb676f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:33.926264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-608b3de7-882c-40bb-92b3-0eaf0fb676f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:33.926724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-608b3de7-882c-40bb-92b3-0eaf0fb676f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:33.927590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-608b3de7-882c-40bb-92b3-0eaf0fb676f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:33.928031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-608b3de7-882c-40bb-92b3-0eaf0fb676f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:33.960281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-608b3de7-882c-40bb-92b3-0eaf0fb676f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046694 May 23 13:51:33.960878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 634/1345] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:33.979275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2755e2d8-292c-4ed5-b26c-71fac85b1740 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:33.987071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2755e2d8-292c-4ed5-b26c-71fac85b1740 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087057 May 23 13:51:33.987657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 712/1346] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:33 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:34.632799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36454760-5f93-4e26-9c29-bc12eb316cba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:34.634301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36454760-5f93-4e26-9c29-bc12eb316cba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:34.640327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36454760-5f93-4e26-9c29-bc12eb316cba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:34.640819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36454760-5f93-4e26-9c29-bc12eb316cba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:34.641580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36454760-5f93-4e26-9c29-bc12eb316cba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:34.642016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36454760-5f93-4e26-9c29-bc12eb316cba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:34.672400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36454760-5f93-4e26-9c29-bc12eb316cba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 May 23 13:51:34.672991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 635/1347] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:34 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:34.973152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4373ede5-69d7-40be-b47f-b7675b881b40 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:34.974047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4373ede5-69d7-40be-b47f-b7675b881b40 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:34.981570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4373ede5-69d7-40be-b47f-b7675b881b40 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:34.982024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4373ede5-69d7-40be-b47f-b7675b881b40 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:34.982798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4373ede5-69d7-40be-b47f-b7675b881b40 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:34.983235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4373ede5-69d7-40be-b47f-b7675b881b40 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:35.004837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-29b5aec4-0312-49b9-ae14-9e41dc217bbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:35.005524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-29b5aec4-0312-49b9-ae14-9e41dc217bbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:35.012499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29b5aec4-0312-49b9-ae14-9e41dc217bbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:35.012982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29b5aec4-0312-49b9-ae14-9e41dc217bbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:35.013820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29b5aec4-0312-49b9-ae14-9e41dc217bbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:35.014265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29b5aec4-0312-49b9-ae14-9e41dc217bbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:35.014414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4373ede5-69d7-40be-b47f-b7675b881b40 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 May 23 13:51:35.014883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 713/1348] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:35.018456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:35.077129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-29b5aec4-0312-49b9-ae14-9e41dc217bbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:35.084809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-29b5aec4-0312-49b9-ae14-9e41dc217bbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083897 May 23 13:51:35.085389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 636/1349] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:34 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:51:35.685678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31b23af0-707c-4680-a9ea-156453ab7fbe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:35.687106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-31b23af0-707c-4680-a9ea-156453ab7fbe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:35.694891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b23af0-707c-4680-a9ea-156453ab7fbe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:35.695395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b23af0-707c-4680-a9ea-156453ab7fbe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:35.696199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b23af0-707c-4680-a9ea-156453ab7fbe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:35.696665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31b23af0-707c-4680-a9ea-156453ab7fbe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:35.732301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31b23af0-707c-4680-a9ea-156453ab7fbe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051839 May 23 13:51:35.732972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 714/1350] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:35 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:36.027626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b87eae43-74d3-45cb-a1b4-ecb0e55703f3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:36.029158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b87eae43-74d3-45cb-a1b4-ecb0e55703f3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:36.038296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b87eae43-74d3-45cb-a1b4-ecb0e55703f3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:36.038296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b87eae43-74d3-45cb-a1b4-ecb0e55703f3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:36.038821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b87eae43-74d3-45cb-a1b4-ecb0e55703f3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:36.039257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b87eae43-74d3-45cb-a1b4-ecb0e55703f3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:36.073250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b87eae43-74d3-45cb-a1b4-ecb0e55703f3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050960 May 23 13:51:36.074329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 637/1351] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:36.103795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eca69659-89f6-4850-9f89-962f20b41d5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:36.104421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eca69659-89f6-4850-9f89-962f20b41d5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:36.114539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eca69659-89f6-4850-9f89-962f20b41d5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:36.115141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eca69659-89f6-4850-9f89-962f20b41d5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:36.115935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eca69659-89f6-4850-9f89-962f20b41d5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:36.117616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eca69659-89f6-4850-9f89-962f20b41d5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:36.195105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eca69659-89f6-4850-9f89-962f20b41d5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:36.202927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eca69659-89f6-4850-9f89-962f20b41d5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.103988 May 23 13:51:36.204416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 715/1352] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:36 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:36.746309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-628a92b0-e5a4-463c-ba87-a0933cdbdedd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:36.747267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-628a92b0-e5a4-463c-ba87-a0933cdbdedd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:36.753394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-628a92b0-e5a4-463c-ba87-a0933cdbdedd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:36.753852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-628a92b0-e5a4-463c-ba87-a0933cdbdedd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:36.754617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-628a92b0-e5a4-463c-ba87-a0933cdbdedd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:36.755055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-628a92b0-e5a4-463c-ba87-a0933cdbdedd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:36.784624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-628a92b0-e5a4-463c-ba87-a0933cdbdedd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043413 May 23 13:51:36.785178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 638/1353] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:36 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:37.085613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d082e3ce-cd57-4819-bc1d-22b1e14ed28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:37.086689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d082e3ce-cd57-4819-bc1d-22b1e14ed28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:37.092847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d082e3ce-cd57-4819-bc1d-22b1e14ed28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:37.093296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d082e3ce-cd57-4819-bc1d-22b1e14ed28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:37.094056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d082e3ce-cd57-4819-bc1d-22b1e14ed28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:37.094490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d082e3ce-cd57-4819-bc1d-22b1e14ed28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:37.124294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d082e3ce-cd57-4819-bc1d-22b1e14ed28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042695 May 23 13:51:37.124978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 716/1354] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:37.221118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da8649eb-d1de-4d79-85ea-a10f4f6c9b50 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:37.221731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da8649eb-d1de-4d79-85ea-a10f4f6c9b50 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:37.229110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da8649eb-d1de-4d79-85ea-a10f4f6c9b50 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:37.229559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da8649eb-d1de-4d79-85ea-a10f4f6c9b50 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:37.230335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da8649eb-d1de-4d79-85ea-a10f4f6c9b50 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:37.230770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da8649eb-d1de-4d79-85ea-a10f4f6c9b50 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:37.295270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da8649eb-d1de-4d79-85ea-a10f4f6c9b50 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:37.302858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da8649eb-d1de-4d79-85ea-a10f4f6c9b50 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085572 May 23 13:51:37.303425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 639/1355] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:37 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:37.797329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-655ed3a6-5c7b-4067-82e6-e135bc53e51f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:37.798258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-655ed3a6-5c7b-4067-82e6-e135bc53e51f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:37.804331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-655ed3a6-5c7b-4067-82e6-e135bc53e51f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:37.804822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-655ed3a6-5c7b-4067-82e6-e135bc53e51f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:37.805929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-655ed3a6-5c7b-4067-82e6-e135bc53e51f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:37.806120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-655ed3a6-5c7b-4067-82e6-e135bc53e51f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:37.836685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-655ed3a6-5c7b-4067-82e6-e135bc53e51f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043205 May 23 13:51:37.837393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 717/1356] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:37 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:38.136277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0a1fb6b-59dc-4280-917b-baa257d91672 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:38.137426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0a1fb6b-59dc-4280-917b-baa257d91672 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:38.143878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0a1fb6b-59dc-4280-917b-baa257d91672 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:38.144329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0a1fb6b-59dc-4280-917b-baa257d91672 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:38.145181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0a1fb6b-59dc-4280-917b-baa257d91672 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:38.145619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0a1fb6b-59dc-4280-917b-baa257d91672 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:38.178848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0a1fb6b-59dc-4280-917b-baa257d91672 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046702 May 23 13:51:38.179444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 640/1357] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:38.319581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68a3dec0-91b8-42ec-8d01-009c36dc96aa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:38.320199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-68a3dec0-91b8-42ec-8d01-009c36dc96aa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:38.326886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68a3dec0-91b8-42ec-8d01-009c36dc96aa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:38.327276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68a3dec0-91b8-42ec-8d01-009c36dc96aa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:38.328049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68a3dec0-91b8-42ec-8d01-009c36dc96aa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:38.328488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68a3dec0-91b8-42ec-8d01-009c36dc96aa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:38.393050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68a3dec0-91b8-42ec-8d01-009c36dc96aa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:38.401518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68a3dec0-91b8-42ec-8d01-009c36dc96aa tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085809 May 23 13:51:38.402086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 718/1358] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:38 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:38.847529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f53a795-6f61-42dc-99f9-0b37b86519eb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:38.848509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f53a795-6f61-42dc-99f9-0b37b86519eb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:38.855232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f53a795-6f61-42dc-99f9-0b37b86519eb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:38.855684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f53a795-6f61-42dc-99f9-0b37b86519eb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:38.856446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f53a795-6f61-42dc-99f9-0b37b86519eb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:38.856905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f53a795-6f61-42dc-99f9-0b37b86519eb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:38.888086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f53a795-6f61-42dc-99f9-0b37b86519eb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 May 23 13:51:38.888677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 641/1359] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:38 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:39.191281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a9df18f9-772c-4d2b-8477-4f000316fdfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:39.192218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a9df18f9-772c-4d2b-8477-4f000316fdfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:39.199223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9df18f9-772c-4d2b-8477-4f000316fdfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:39.199679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9df18f9-772c-4d2b-8477-4f000316fdfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:39.200503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9df18f9-772c-4d2b-8477-4f000316fdfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:39.200984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9df18f9-772c-4d2b-8477-4f000316fdfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:39.232352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a9df18f9-772c-4d2b-8477-4f000316fdfd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 May 23 13:51:39.232949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 719/1360] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:39.419383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bbd88a43-faf4-47a5-8ef0-9a86a76bd6c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:39.420049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bbd88a43-faf4-47a5-8ef0-9a86a76bd6c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:39.426158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbd88a43-faf4-47a5-8ef0-9a86a76bd6c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:39.426616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbd88a43-faf4-47a5-8ef0-9a86a76bd6c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:39.427375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbd88a43-faf4-47a5-8ef0-9a86a76bd6c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:39.427813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbd88a43-faf4-47a5-8ef0-9a86a76bd6c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:39.493964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbd88a43-faf4-47a5-8ef0-9a86a76bd6c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:39.501670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bbd88a43-faf4-47a5-8ef0-9a86a76bd6c3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086187 May 23 13:51:39.502237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 642/1361] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:39 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:39.900403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-69fac2c8-a4fa-403a-970f-4bd2dbbd602c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:39.901344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-69fac2c8-a4fa-403a-970f-4bd2dbbd602c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:39.907805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69fac2c8-a4fa-403a-970f-4bd2dbbd602c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:39.908251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69fac2c8-a4fa-403a-970f-4bd2dbbd602c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:39.909046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69fac2c8-a4fa-403a-970f-4bd2dbbd602c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:39.909483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69fac2c8-a4fa-403a-970f-4bd2dbbd602c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:39.939262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-69fac2c8-a4fa-403a-970f-4bd2dbbd602c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 May 23 13:51:39.939855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 720/1362] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:39 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:40.244322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-33db6626-86c0-4779-90ce-51424af71e19 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:40.245344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-33db6626-86c0-4779-90ce-51424af71e19 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:40.251830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33db6626-86c0-4779-90ce-51424af71e19 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:40.252306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33db6626-86c0-4779-90ce-51424af71e19 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:40.253089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33db6626-86c0-4779-90ce-51424af71e19 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:40.253528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33db6626-86c0-4779-90ce-51424af71e19 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:40.282810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-33db6626-86c0-4779-90ce-51424af71e19 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043228 May 23 13:51:40.283360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 643/1363] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:40.518733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f3bfedd9-bc71-4893-983b-ab232f4e0cee tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:40.519306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f3bfedd9-bc71-4893-983b-ab232f4e0cee tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:40.526027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3bfedd9-bc71-4893-983b-ab232f4e0cee tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:40.526481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3bfedd9-bc71-4893-983b-ab232f4e0cee tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:40.527245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3bfedd9-bc71-4893-983b-ab232f4e0cee tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:40.527685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3bfedd9-bc71-4893-983b-ab232f4e0cee tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:40.589189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f3bfedd9-bc71-4893-983b-ab232f4e0cee tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:40.596905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f3bfedd9-bc71-4893-983b-ab232f4e0cee tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082175 May 23 13:51:40.597488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 721/1364] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:40 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:40.953332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d6dfc63-001d-40e5-8a9c-7462553955b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:40.954255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d6dfc63-001d-40e5-8a9c-7462553955b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:40.960882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d6dfc63-001d-40e5-8a9c-7462553955b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:40.962056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d6dfc63-001d-40e5-8a9c-7462553955b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:40.962900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d6dfc63-001d-40e5-8a9c-7462553955b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:40.963332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d6dfc63-001d-40e5-8a9c-7462553955b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:40.994834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d6dfc63-001d-40e5-8a9c-7462553955b3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045428 May 23 13:51:40.995406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 644/1365] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:40 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:41.294400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-23161e77-c4d6-42be-8980-3e3d61cb711a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:41.295231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-23161e77-c4d6-42be-8980-3e3d61cb711a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:41.302030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23161e77-c4d6-42be-8980-3e3d61cb711a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:41.302492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23161e77-c4d6-42be-8980-3e3d61cb711a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:41.303272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23161e77-c4d6-42be-8980-3e3d61cb711a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:41.303754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23161e77-c4d6-42be-8980-3e3d61cb711a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:41.335440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-23161e77-c4d6-42be-8980-3e3d61cb711a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044995 May 23 13:51:41.336788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 722/1366] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:41.615903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a420c358-f801-4a9d-aa57-5ae1b9b4fb7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:41.616520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a420c358-f801-4a9d-aa57-5ae1b9b4fb7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:41.623780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a420c358-f801-4a9d-aa57-5ae1b9b4fb7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:41.624225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a420c358-f801-4a9d-aa57-5ae1b9b4fb7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:41.625014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a420c358-f801-4a9d-aa57-5ae1b9b4fb7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:41.625450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a420c358-f801-4a9d-aa57-5ae1b9b4fb7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:41.687119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a420c358-f801-4a9d-aa57-5ae1b9b4fb7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:41.694775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a420c358-f801-4a9d-aa57-5ae1b9b4fb7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082762 May 23 13:51:41.695340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 645/1367] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:41 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:51:42.006910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d829e159-74fc-4331-bb05-f73487a418cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:42.007810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d829e159-74fc-4331-bb05-f73487a418cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:42.015028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d829e159-74fc-4331-bb05-f73487a418cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:42.015483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d829e159-74fc-4331-bb05-f73487a418cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:42.016254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d829e159-74fc-4331-bb05-f73487a418cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:42.016723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d829e159-74fc-4331-bb05-f73487a418cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:42.046584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d829e159-74fc-4331-bb05-f73487a418cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 May 23 13:51:42.047138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 723/1368] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:42 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:42.347722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3734871-92e0-44c9-a006-40af8ced7d7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:42.348558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3734871-92e0-44c9-a006-40af8ced7d7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:42.354659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3734871-92e0-44c9-a006-40af8ced7d7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:42.355109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3734871-92e0-44c9-a006-40af8ced7d7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:42.355868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3734871-92e0-44c9-a006-40af8ced7d7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:42.356301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3734871-92e0-44c9-a006-40af8ced7d7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:42.385287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3734871-92e0-44c9-a006-40af8ced7d7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 May 23 13:51:42.385856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 646/1369] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:42.479223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:51:42.479449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:51:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:51:42.711574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-412b7cd4-6072-4a95-b3b1-a8b983798a40 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:42.712194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-412b7cd4-6072-4a95-b3b1-a8b983798a40 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:42.718790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-412b7cd4-6072-4a95-b3b1-a8b983798a40 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:42.719241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-412b7cd4-6072-4a95-b3b1-a8b983798a40 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:42.720041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-412b7cd4-6072-4a95-b3b1-a8b983798a40 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:42.720487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-412b7cd4-6072-4a95-b3b1-a8b983798a40 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:42.788843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-412b7cd4-6072-4a95-b3b1-a8b983798a40 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:42.796472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-412b7cd4-6072-4a95-b3b1-a8b983798a40 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.089077 May 23 13:51:42.797041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 724/1370] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:42 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:43.059386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dedfc844-8add-42e0-bb3c-eb65348872de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:43.060319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dedfc844-8add-42e0-bb3c-eb65348872de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:43.066840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dedfc844-8add-42e0-bb3c-eb65348872de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:43.067272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dedfc844-8add-42e0-bb3c-eb65348872de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:43.068035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dedfc844-8add-42e0-bb3c-eb65348872de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:43.068469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dedfc844-8add-42e0-bb3c-eb65348872de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:43.099401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dedfc844-8add-42e0-bb3c-eb65348872de tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044995 May 23 13:51:43.099962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 647/1371] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:43 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:43.396890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-abb4e4d3-75b7-4f8d-8e88-84d0ff767579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:43.397819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-abb4e4d3-75b7-4f8d-8e88-84d0ff767579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:43.404810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abb4e4d3-75b7-4f8d-8e88-84d0ff767579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:43.405269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abb4e4d3-75b7-4f8d-8e88-84d0ff767579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:43.406034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abb4e4d3-75b7-4f8d-8e88-84d0ff767579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:43.406476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abb4e4d3-75b7-4f8d-8e88-84d0ff767579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:43.435606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-abb4e4d3-75b7-4f8d-8e88-84d0ff767579 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042663 May 23 13:51:43.436084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 725/1372] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:43.814034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-271d4c50-6844-4810-a5cf-976b37c4f75e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:43.814569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-271d4c50-6844-4810-a5cf-976b37c4f75e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:43.821519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-271d4c50-6844-4810-a5cf-976b37c4f75e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:43.821792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-271d4c50-6844-4810-a5cf-976b37c4f75e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:43.822540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-271d4c50-6844-4810-a5cf-976b37c4f75e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:43.822976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-271d4c50-6844-4810-a5cf-976b37c4f75e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:43.887378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-271d4c50-6844-4810-a5cf-976b37c4f75e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:43.896297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-271d4c50-6844-4810-a5cf-976b37c4f75e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086123 May 23 13:51:43.896921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 648/1373] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:43 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:44.111396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4cbd1199-cf94-4948-b472-6ac30b705659 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:44.112331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4cbd1199-cf94-4948-b472-6ac30b705659 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:44.114801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=88 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:44.120256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cbd1199-cf94-4948-b472-6ac30b705659 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:44.120759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cbd1199-cf94-4948-b472-6ac30b705659 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:44.121552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cbd1199-cf94-4948-b472-6ac30b705659 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:44.122000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cbd1199-cf94-4948-b472-6ac30b705659 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:44.154289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4cbd1199-cf94-4948-b472-6ac30b705659 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 May 23 13:51:44.154856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 726/1374] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:44 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:44.448027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-968f33a0-3682-49e8-920f-d3f34733b33a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:44.448877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-968f33a0-3682-49e8-920f-d3f34733b33a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:44.455498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-968f33a0-3682-49e8-920f-d3f34733b33a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:44.456316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-968f33a0-3682-49e8-920f-d3f34733b33a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:44.456621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-968f33a0-3682-49e8-920f-d3f34733b33a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:44.457052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-968f33a0-3682-49e8-920f-d3f34733b33a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:44.488069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-968f33a0-3682-49e8-920f-d3f34733b33a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 May 23 13:51:44.488660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 649/1375] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:44.915129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d1c8633c-8f61-4503-9db7-4e363c363bf8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:44.915888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d1c8633c-8f61-4503-9db7-4e363c363bf8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:44.922204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1c8633c-8f61-4503-9db7-4e363c363bf8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:44.922663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1c8633c-8f61-4503-9db7-4e363c363bf8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:44.923457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1c8633c-8f61-4503-9db7-4e363c363bf8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:44.923903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1c8633c-8f61-4503-9db7-4e363c363bf8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:45.166861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1185a0c-5908-4678-91f6-fd069943bef5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:45.167820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1185a0c-5908-4678-91f6-fd069943bef5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:45.174115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1185a0c-5908-4678-91f6-fd069943bef5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:45.175295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1185a0c-5908-4678-91f6-fd069943bef5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:45.176094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1185a0c-5908-4678-91f6-fd069943bef5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:45.176540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1185a0c-5908-4678-91f6-fd069943bef5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:45.210676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d1c8633c-8f61-4503-9db7-4e363c363bf8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:45.214373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1185a0c-5908-4678-91f6-fd069943bef5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052273 May 23 13:51:45.214972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 650/1376] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:45 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:45.221136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d1c8633c-8f61-4503-9db7-4e363c363bf8 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.310499 May 23 13:51:45.221712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 727/1377] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:44 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:51:45.501187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e6528c8-41d1-425f-90b4-1c4506bffe91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:45.502004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e6528c8-41d1-425f-90b4-1c4506bffe91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:45.503892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=88 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:45.509922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e6528c8-41d1-425f-90b4-1c4506bffe91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:45.517070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e6528c8-41d1-425f-90b4-1c4506bffe91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:45.517070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e6528c8-41d1-425f-90b4-1c4506bffe91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:45.517070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e6528c8-41d1-425f-90b4-1c4506bffe91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:45.543584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e6528c8-41d1-425f-90b4-1c4506bffe91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047959 May 23 13:51:45.544363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 651/1378] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:46.225954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e3601fd-cec4-48ed-b6ed-2e7cc4f76e0f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:51:46.227521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e3601fd-cec4-48ed-b6ed-2e7cc4f76e0f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:46.234207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3601fd-cec4-48ed-b6ed-2e7cc4f76e0f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:46.234657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3601fd-cec4-48ed-b6ed-2e7cc4f76e0f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:46.235429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3601fd-cec4-48ed-b6ed-2e7cc4f76e0f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:46.235860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3601fd-cec4-48ed-b6ed-2e7cc4f76e0f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:46.238349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4feda06e-9e9f-45dd-8af2-0387aa2c6ee7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:46.238965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4feda06e-9e9f-45dd-8af2-0387aa2c6ee7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:46.247009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4feda06e-9e9f-45dd-8af2-0387aa2c6ee7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:46.247457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4feda06e-9e9f-45dd-8af2-0387aa2c6ee7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:46.248232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4feda06e-9e9f-45dd-8af2-0387aa2c6ee7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:46.248704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4feda06e-9e9f-45dd-8af2-0387aa2c6ee7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:46.319146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4feda06e-9e9f-45dd-8af2-0387aa2c6ee7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:46.323384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:46.328828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4feda06e-9e9f-45dd-8af2-0387aa2c6ee7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.094100 May 23 13:51:46.334476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 652/1379] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:46 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:51:46.349437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e3601fd-cec4-48ed-b6ed-2e7cc4f76e0f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "POST /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/action" status: 200 len: 75562 microversion: 2.1 time: 0.127045 May 23 13:51:46.350224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 728/1380] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:51:46 2022] POST /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3/action => generated 75562 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:51:46.556737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-094701c4-62a1-409b-b30a-2216a10141b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:46.557669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-094701c4-62a1-409b-b30a-2216a10141b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:46.564884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-094701c4-62a1-409b-b30a-2216a10141b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:46.565337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-094701c4-62a1-409b-b30a-2216a10141b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:46.566106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-094701c4-62a1-409b-b30a-2216a10141b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:46.566538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-094701c4-62a1-409b-b30a-2216a10141b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:46.598234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-094701c4-62a1-409b-b30a-2216a10141b5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 May 23 13:51:46.598810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 653/1381] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:47.350631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d59cc74-2956-439d-8f2a-bf538ab16ae3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:47.351357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5d59cc74-2956-439d-8f2a-bf538ab16ae3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:47.358750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d59cc74-2956-439d-8f2a-bf538ab16ae3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:47.359115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d59cc74-2956-439d-8f2a-bf538ab16ae3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:47.359855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d59cc74-2956-439d-8f2a-bf538ab16ae3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:47.360288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d59cc74-2956-439d-8f2a-bf538ab16ae3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:47.366689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:51:47.431429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d59cc74-2956-439d-8f2a-bf538ab16ae3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:47.439526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d59cc74-2956-439d-8f2a-bf538ab16ae3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093288 May 23 13:51:47.440018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 729/1382] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:47 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:47.610515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-42de67e4-bd7e-4cd7-8382-760afc034b7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:47.611441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-42de67e4-bd7e-4cd7-8382-760afc034b7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:47.618278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42de67e4-bd7e-4cd7-8382-760afc034b7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:47.618726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42de67e4-bd7e-4cd7-8382-760afc034b7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:47.619488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42de67e4-bd7e-4cd7-8382-760afc034b7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:47.619919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42de67e4-bd7e-4cd7-8382-760afc034b7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:47.655989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-42de67e4-bd7e-4cd7-8382-760afc034b7f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049601 May 23 13:51:47.657072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 654/1383] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:48.457267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-513d6d61-f69c-4658-bb10-c6b6b71046f3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:48.457909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-513d6d61-f69c-4658-bb10-c6b6b71046f3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:48.465426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-513d6d61-f69c-4658-bb10-c6b6b71046f3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:48.465873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-513d6d61-f69c-4658-bb10-c6b6b71046f3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:48.466647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-513d6d61-f69c-4658-bb10-c6b6b71046f3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:48.467082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-513d6d61-f69c-4658-bb10-c6b6b71046f3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:48.530445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-513d6d61-f69c-4658-bb10-c6b6b71046f3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:48.538126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-513d6d61-f69c-4658-bb10-c6b6b71046f3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084677 May 23 13:51:48.538697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 730/1384] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:48 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:48.667483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6bc11f2f-667a-4cd4-950f-d2188bd50957 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:48.668398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6bc11f2f-667a-4cd4-950f-d2188bd50957 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:48.674919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bc11f2f-667a-4cd4-950f-d2188bd50957 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:48.675370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bc11f2f-667a-4cd4-950f-d2188bd50957 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:48.676127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bc11f2f-667a-4cd4-950f-d2188bd50957 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:48.676585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bc11f2f-667a-4cd4-950f-d2188bd50957 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:48.708017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6bc11f2f-667a-4cd4-950f-d2188bd50957 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 May 23 13:51:48.708556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 655/1385] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:49.556510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-238b1405-2973-4b04-98b3-0f5c65c28fb7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:49.557069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-238b1405-2973-4b04-98b3-0f5c65c28fb7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:49.563608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238b1405-2973-4b04-98b3-0f5c65c28fb7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:49.564066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238b1405-2973-4b04-98b3-0f5c65c28fb7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:49.564909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238b1405-2973-4b04-98b3-0f5c65c28fb7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:49.565315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238b1405-2973-4b04-98b3-0f5c65c28fb7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:49.631594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-238b1405-2973-4b04-98b3-0f5c65c28fb7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:49.640051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-238b1405-2973-4b04-98b3-0f5c65c28fb7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088565 May 23 13:51:49.640644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 731/1386] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:49 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:49.719498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f34dce08-7197-42f5-ac0f-d66e8437acf7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:49.720409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f34dce08-7197-42f5-ac0f-d66e8437acf7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:49.727396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f34dce08-7197-42f5-ac0f-d66e8437acf7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:49.727836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f34dce08-7197-42f5-ac0f-d66e8437acf7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:49.728587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f34dce08-7197-42f5-ac0f-d66e8437acf7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:49.729030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f34dce08-7197-42f5-ac0f-d66e8437acf7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:49.757565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f34dce08-7197-42f5-ac0f-d66e8437acf7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042019 May 23 13:51:49.758133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 656/1387] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:50.656395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31958d8c-186e-4e54-b215-55595ca314b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:50.657046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-31958d8c-186e-4e54-b215-55595ca314b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:50.663592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31958d8c-186e-4e54-b215-55595ca314b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:50.664505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31958d8c-186e-4e54-b215-55595ca314b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:50.664875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31958d8c-186e-4e54-b215-55595ca314b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:50.665307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31958d8c-186e-4e54-b215-55595ca314b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:50.732617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-31958d8c-186e-4e54-b215-55595ca314b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:50.740288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31958d8c-186e-4e54-b215-55595ca314b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087675 May 23 13:51:50.740934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 732/1388] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:50 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:50.769600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b566ee60-3216-46e8-8f4f-716cfaad58f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:50.770524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b566ee60-3216-46e8-8f4f-716cfaad58f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:50.779494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b566ee60-3216-46e8-8f4f-716cfaad58f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:50.779955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b566ee60-3216-46e8-8f4f-716cfaad58f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:50.780771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b566ee60-3216-46e8-8f4f-716cfaad58f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:50.781214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b566ee60-3216-46e8-8f4f-716cfaad58f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:50.814153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b566ee60-3216-46e8-8f4f-716cfaad58f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048433 May 23 13:51:50.814735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 657/1389] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:51.758874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be4a49ef-d59c-4de4-b4e3-8a4f5bc05c8c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:51.759667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be4a49ef-d59c-4de4-b4e3-8a4f5bc05c8c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:51.766457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be4a49ef-d59c-4de4-b4e3-8a4f5bc05c8c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:51.766907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be4a49ef-d59c-4de4-b4e3-8a4f5bc05c8c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:51.767681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be4a49ef-d59c-4de4-b4e3-8a4f5bc05c8c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:51.768116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be4a49ef-d59c-4de4-b4e3-8a4f5bc05c8c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:51.826290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d813d906-27f6-4616-b5cf-76f5af2c423a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:51.827203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d813d906-27f6-4616-b5cf-76f5af2c423a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:51.833963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d813d906-27f6-4616-b5cf-76f5af2c423a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:51.834406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d813d906-27f6-4616-b5cf-76f5af2c423a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:51.835419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d813d906-27f6-4616-b5cf-76f5af2c423a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:51.836498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d813d906-27f6-4616-b5cf-76f5af2c423a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:51.838258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be4a49ef-d59c-4de4-b4e3-8a4f5bc05c8c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:51.845861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be4a49ef-d59c-4de4-b4e3-8a4f5bc05c8c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091778 May 23 13:51:51.846549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 733/1390] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:51 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:51.867642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d813d906-27f6-4616-b5cf-76f5af2c423a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 May 23 13:51:51.868179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 658/1391] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:52.477372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:51:52.477864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:51:52.863265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0673a383-69ad-46ee-be9d-cc5cfe3cb91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:52.863917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0673a383-69ad-46ee-be9d-cc5cfe3cb91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:52.871440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0673a383-69ad-46ee-be9d-cc5cfe3cb91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:52.871901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0673a383-69ad-46ee-be9d-cc5cfe3cb91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:52.872715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0673a383-69ad-46ee-be9d-cc5cfe3cb91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:52.873162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0673a383-69ad-46ee-be9d-cc5cfe3cb91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:52.885793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-71154543-4a3f-4e91-9997-bee5b3bd9501 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:52.885793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-71154543-4a3f-4e91-9997-bee5b3bd9501 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:52.888099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71154543-4a3f-4e91-9997-bee5b3bd9501 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:52.888560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71154543-4a3f-4e91-9997-bee5b3bd9501 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:52.889372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71154543-4a3f-4e91-9997-bee5b3bd9501 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:52.889814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71154543-4a3f-4e91-9997-bee5b3bd9501 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:52.923382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-71154543-4a3f-4e91-9997-bee5b3bd9501 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048266 May 23 13:51:52.924154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 659/1392] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:52.946940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0673a383-69ad-46ee-be9d-cc5cfe3cb91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:52.954852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0673a383-69ad-46ee-be9d-cc5cfe3cb91a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.095445 May 23 13:51:52.955425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 734/1393] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:52 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:53.936422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75d0610b-cde6-411b-b5a4-9bedebfc623c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:53.937309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75d0610b-cde6-411b-b5a4-9bedebfc623c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:53.944175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75d0610b-cde6-411b-b5a4-9bedebfc623c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:53.944658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75d0610b-cde6-411b-b5a4-9bedebfc623c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:53.945439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75d0610b-cde6-411b-b5a4-9bedebfc623c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:53.945874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75d0610b-cde6-411b-b5a4-9bedebfc623c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:53.974695 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92c58a90-5664-4a5e-8564-afd199545e78 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:53.975769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92c58a90-5664-4a5e-8564-afd199545e78 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:53.983933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75d0610b-cde6-411b-b5a4-9bedebfc623c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051460 May 23 13:51:53.984170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c58a90-5664-4a5e-8564-afd199545e78 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:53.984715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c58a90-5664-4a5e-8564-afd199545e78 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:53.984885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 660/1394] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:53.985707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c58a90-5664-4a5e-8564-afd199545e78 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:53.986294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c58a90-5664-4a5e-8564-afd199545e78 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:54.069705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92c58a90-5664-4a5e-8564-afd199545e78 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:54.078665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92c58a90-5664-4a5e-8564-afd199545e78 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.110336 May 23 13:51:54.079241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 735/1395] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:53 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:54.996296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d590644c-7fc0-4e3d-9127-80e9ba9137ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:54.997202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d590644c-7fc0-4e3d-9127-80e9ba9137ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:55.004603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d590644c-7fc0-4e3d-9127-80e9ba9137ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:55.005053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d590644c-7fc0-4e3d-9127-80e9ba9137ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:55.005867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d590644c-7fc0-4e3d-9127-80e9ba9137ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:55.006301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d590644c-7fc0-4e3d-9127-80e9ba9137ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:55.041189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d590644c-7fc0-4e3d-9127-80e9ba9137ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049137 May 23 13:51:55.041780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 661/1396] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:55.095408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-151b0fa4-8f6c-41d4-b217-11787ac81492 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:55.096041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-151b0fa4-8f6c-41d4-b217-11787ac81492 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:55.103503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-151b0fa4-8f6c-41d4-b217-11787ac81492 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:55.103963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-151b0fa4-8f6c-41d4-b217-11787ac81492 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:55.104772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-151b0fa4-8f6c-41d4-b217-11787ac81492 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:55.105214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-151b0fa4-8f6c-41d4-b217-11787ac81492 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:55.170151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-151b0fa4-8f6c-41d4-b217-11787ac81492 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:55.177928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-151b0fa4-8f6c-41d4-b217-11787ac81492 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086334 May 23 13:51:55.178519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 736/1397] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:55 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:56.053273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e5fca50b-2da7-49bc-a8cf-448a6fe2c4a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:56.054107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e5fca50b-2da7-49bc-a8cf-448a6fe2c4a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:56.061535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5fca50b-2da7-49bc-a8cf-448a6fe2c4a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:56.061981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5fca50b-2da7-49bc-a8cf-448a6fe2c4a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:56.062740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5fca50b-2da7-49bc-a8cf-448a6fe2c4a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:56.063166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5fca50b-2da7-49bc-a8cf-448a6fe2c4a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:56.093759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e5fca50b-2da7-49bc-a8cf-448a6fe2c4a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 May 23 13:51:56.094318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 662/1398] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:51:56.196727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b25a752-1a09-4517-8811-d14d8c11fd7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:56.197600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b25a752-1a09-4517-8811-d14d8c11fd7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:56.204296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b25a752-1a09-4517-8811-d14d8c11fd7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:56.204787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b25a752-1a09-4517-8811-d14d8c11fd7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:56.205984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b25a752-1a09-4517-8811-d14d8c11fd7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:56.206512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b25a752-1a09-4517-8811-d14d8c11fd7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:56.271181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b25a752-1a09-4517-8811-d14d8c11fd7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:56.279362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b25a752-1a09-4517-8811-d14d8c11fd7c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087817 May 23 13:51:56.279949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 737/1399] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:56 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:56.853967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:51:56.854218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:51:57.106274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2f5a86a1-24c1-479c-a90f-08d4d5beb322 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:57.107130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2f5a86a1-24c1-479c-a90f-08d4d5beb322 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:57.113725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f5a86a1-24c1-479c-a90f-08d4d5beb322 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:57.114170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f5a86a1-24c1-479c-a90f-08d4d5beb322 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:57.114944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f5a86a1-24c1-479c-a90f-08d4d5beb322 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:57.115430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2f5a86a1-24c1-479c-a90f-08d4d5beb322 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:57.146181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2f5a86a1-24c1-479c-a90f-08d4d5beb322 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 May 23 13:51:57.147020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 663/1400] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:57.297473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b5ffd3e9-0e66-4ff5-a4a4-72453b3e6e98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:57.298254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b5ffd3e9-0e66-4ff5-a4a4-72453b3e6e98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:57.305000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ffd3e9-0e66-4ff5-a4a4-72453b3e6e98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:57.306066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ffd3e9-0e66-4ff5-a4a4-72453b3e6e98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:57.307087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ffd3e9-0e66-4ff5-a4a4-72453b3e6e98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:57.307531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ffd3e9-0e66-4ff5-a4a4-72453b3e6e98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:57.372343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5ffd3e9-0e66-4ff5-a4a4-72453b3e6e98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:57.380068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b5ffd3e9-0e66-4ff5-a4a4-72453b3e6e98 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086720 May 23 13:51:57.380677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 738/1401] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:57 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:58.158743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-910be7cc-73a6-431c-acb4-e93be4f5d7df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:58.159676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-910be7cc-73a6-431c-acb4-e93be4f5d7df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:58.166922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-910be7cc-73a6-431c-acb4-e93be4f5d7df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:58.167363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-910be7cc-73a6-431c-acb4-e93be4f5d7df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:58.168132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-910be7cc-73a6-431c-acb4-e93be4f5d7df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:58.168589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-910be7cc-73a6-431c-acb4-e93be4f5d7df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:58.201981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-910be7cc-73a6-431c-acb4-e93be4f5d7df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047091 May 23 13:51:58.202555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 664/1402] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:58 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:58.401977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-de7a69d9-3d15-4f35-b325-72cf7d4d0885 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:58.402598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-de7a69d9-3d15-4f35-b325-72cf7d4d0885 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:58.409281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de7a69d9-3d15-4f35-b325-72cf7d4d0885 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:58.409668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de7a69d9-3d15-4f35-b325-72cf7d4d0885 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:58.410438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de7a69d9-3d15-4f35-b325-72cf7d4d0885 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:58.410873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de7a69d9-3d15-4f35-b325-72cf7d4d0885 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:58.476389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de7a69d9-3d15-4f35-b325-72cf7d4d0885 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:58.484030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-de7a69d9-3d15-4f35-b325-72cf7d4d0885 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086218 May 23 13:51:58.484615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 739/1403] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:58 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:51:59.215065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b486a13-c3fd-436e-b458-1ba2620ec4fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:59.216004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b486a13-c3fd-436e-b458-1ba2620ec4fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:59.222931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b486a13-c3fd-436e-b458-1ba2620ec4fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:59.223392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b486a13-c3fd-436e-b458-1ba2620ec4fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:59.224175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b486a13-c3fd-436e-b458-1ba2620ec4fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:59.224636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b486a13-c3fd-436e-b458-1ba2620ec4fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:59.256647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b486a13-c3fd-436e-b458-1ba2620ec4fa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 May 23 13:51:59.257411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 665/1404] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:51:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:51:59.502326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b33c3687-4616-4baf-8a17-373d111f7a6a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:51:59.502872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b33c3687-4616-4baf-8a17-373d111f7a6a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:51:59.510113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b33c3687-4616-4baf-8a17-373d111f7a6a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:59.510568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b33c3687-4616-4baf-8a17-373d111f7a6a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:59.511346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b33c3687-4616-4baf-8a17-373d111f7a6a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:51:59.511785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b33c3687-4616-4baf-8a17-373d111f7a6a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:51:59.575932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b33c3687-4616-4baf-8a17-373d111f7a6a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:51:59.583659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b33c3687-4616-4baf-8a17-373d111f7a6a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085333 May 23 13:51:59.584224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 740/1405] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:51:59 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:00.268869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3de4db7b-910e-4aec-8138-ccc309d37178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:00.269803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3de4db7b-910e-4aec-8138-ccc309d37178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:00.277013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3de4db7b-910e-4aec-8138-ccc309d37178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:00.277468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3de4db7b-910e-4aec-8138-ccc309d37178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:00.278257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3de4db7b-910e-4aec-8138-ccc309d37178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:00.278702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3de4db7b-910e-4aec-8138-ccc309d37178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:00.312158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3de4db7b-910e-4aec-8138-ccc309d37178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047250 May 23 13:52:00.312771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 666/1406] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:00.601376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2f8b66d-44d1-41a0-a1a5-25a6d6d0ffb0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:00.602642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c2f8b66d-44d1-41a0-a1a5-25a6d6d0ffb0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:00.615293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2f8b66d-44d1-41a0-a1a5-25a6d6d0ffb0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:00.617851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2f8b66d-44d1-41a0-a1a5-25a6d6d0ffb0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:00.617851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2f8b66d-44d1-41a0-a1a5-25a6d6d0ffb0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:00.617851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2f8b66d-44d1-41a0-a1a5-25a6d6d0ffb0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:00.686039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c2f8b66d-44d1-41a0-a1a5-25a6d6d0ffb0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:00.694430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2f8b66d-44d1-41a0-a1a5-25a6d6d0ffb0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.096756 May 23 13:52:00.695182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 741/1407] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:00 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:01.328377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d9da148-d63e-4c8a-95ef-397d3e25dc02 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:01.329558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d9da148-d63e-4c8a-95ef-397d3e25dc02 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:01.338174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d9da148-d63e-4c8a-95ef-397d3e25dc02 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:01.338661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d9da148-d63e-4c8a-95ef-397d3e25dc02 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:01.339453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d9da148-d63e-4c8a-95ef-397d3e25dc02 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:01.339900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d9da148-d63e-4c8a-95ef-397d3e25dc02 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:01.372332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d9da148-d63e-4c8a-95ef-397d3e25dc02 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049052 May 23 13:52:01.372945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 667/1408] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:01.720589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c55cc4e-4ce8-4b1e-8192-5d826969abad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:01.721228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c55cc4e-4ce8-4b1e-8192-5d826969abad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:01.730991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c55cc4e-4ce8-4b1e-8192-5d826969abad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:01.731454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c55cc4e-4ce8-4b1e-8192-5d826969abad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:01.733446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c55cc4e-4ce8-4b1e-8192-5d826969abad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:01.733900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c55cc4e-4ce8-4b1e-8192-5d826969abad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:01.802904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c55cc4e-4ce8-4b1e-8192-5d826969abad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:01.812005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c55cc4e-4ce8-4b1e-8192-5d826969abad tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.095211 May 23 13:52:01.812951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 742/1409] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:01 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:02.384059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2d67951-ba90-4180-be09-4f3ae9753004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:02.385042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c2d67951-ba90-4180-be09-4f3ae9753004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:02.391879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2d67951-ba90-4180-be09-4f3ae9753004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:02.392337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2d67951-ba90-4180-be09-4f3ae9753004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:02.393162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2d67951-ba90-4180-be09-4f3ae9753004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:02.393601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2d67951-ba90-4180-be09-4f3ae9753004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:02.427525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c2d67951-ba90-4180-be09-4f3ae9753004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047627 May 23 13:52:02.428119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 668/1410] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:02.835347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e65fd6bb-2614-49d0-b68c-0194d9adcd84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:02.835906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e65fd6bb-2614-49d0-b68c-0194d9adcd84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:02.844066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e65fd6bb-2614-49d0-b68c-0194d9adcd84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:02.844523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e65fd6bb-2614-49d0-b68c-0194d9adcd84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:02.845345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e65fd6bb-2614-49d0-b68c-0194d9adcd84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:02.845798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e65fd6bb-2614-49d0-b68c-0194d9adcd84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:02.916095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e65fd6bb-2614-49d0-b68c-0194d9adcd84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:02.924045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e65fd6bb-2614-49d0-b68c-0194d9adcd84 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092939 May 23 13:52:02.924651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 743/1411] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:02 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:03.440822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f38383b-8eb5-4922-afee-1dd7c2cbacf0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:03.441555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f38383b-8eb5-4922-afee-1dd7c2cbacf0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:03.449063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f38383b-8eb5-4922-afee-1dd7c2cbacf0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:03.449518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f38383b-8eb5-4922-afee-1dd7c2cbacf0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:03.450312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f38383b-8eb5-4922-afee-1dd7c2cbacf0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:03.450758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f38383b-8eb5-4922-afee-1dd7c2cbacf0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:03.470611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:03.485394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f38383b-8eb5-4922-afee-1dd7c2cbacf0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048925 May 23 13:52:03.486268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 669/1412] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:03.942134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-da942fd8-065f-459c-8d91-c29de60409b3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:03.942774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-da942fd8-065f-459c-8d91-c29de60409b3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:03.950118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da942fd8-065f-459c-8d91-c29de60409b3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:03.950564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da942fd8-065f-459c-8d91-c29de60409b3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:03.951360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da942fd8-065f-459c-8d91-c29de60409b3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:03.951795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da942fd8-065f-459c-8d91-c29de60409b3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:04.018780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-da942fd8-065f-459c-8d91-c29de60409b3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:04.026953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-da942fd8-065f-459c-8d91-c29de60409b3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088852 May 23 13:52:04.027534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 744/1413] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:03 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:04.498523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-018c846f-8166-4f4d-b1af-c9bead13316a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:04.499465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-018c846f-8166-4f4d-b1af-c9bead13316a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:04.506905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-018c846f-8166-4f4d-b1af-c9bead13316a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:04.507358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-018c846f-8166-4f4d-b1af-c9bead13316a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:04.508262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-018c846f-8166-4f4d-b1af-c9bead13316a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:04.508654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-018c846f-8166-4f4d-b1af-c9bead13316a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:04.543559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-018c846f-8166-4f4d-b1af-c9bead13316a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049061 May 23 13:52:04.544159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 670/1414] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:05.050397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2a16092-974b-4302-ac08-2ddc7dd2c9bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:05.051537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2a16092-974b-4302-ac08-2ddc7dd2c9bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:05.063340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2a16092-974b-4302-ac08-2ddc7dd2c9bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:05.064130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2a16092-974b-4302-ac08-2ddc7dd2c9bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:05.065581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2a16092-974b-4302-ac08-2ddc7dd2c9bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:05.066371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2a16092-974b-4302-ac08-2ddc7dd2c9bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:05.162499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2a16092-974b-4302-ac08-2ddc7dd2c9bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:05.166864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:05.171564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2a16092-974b-4302-ac08-2ddc7dd2c9bf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.128593 May 23 13:52:05.172261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 745/1415] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:05 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:05.556773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4f3acae8-0b7d-4f7d-a1ed-1d19e938aded tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:05.557731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4f3acae8-0b7d-4f7d-a1ed-1d19e938aded tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:05.564843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f3acae8-0b7d-4f7d-a1ed-1d19e938aded tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:05.565297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f3acae8-0b7d-4f7d-a1ed-1d19e938aded tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:05.566089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f3acae8-0b7d-4f7d-a1ed-1d19e938aded tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:05.566528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f3acae8-0b7d-4f7d-a1ed-1d19e938aded tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:05.600592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4f3acae8-0b7d-4f7d-a1ed-1d19e938aded tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048898 May 23 13:52:05.601193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 671/1416] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:06.194870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9cbb36a4-93dd-47cb-b3a0-6281ff6292e7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:06.195644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9cbb36a4-93dd-47cb-b3a0-6281ff6292e7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:06.202561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cbb36a4-93dd-47cb-b3a0-6281ff6292e7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:06.203014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cbb36a4-93dd-47cb-b3a0-6281ff6292e7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:06.203787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cbb36a4-93dd-47cb-b3a0-6281ff6292e7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:06.204223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cbb36a4-93dd-47cb-b3a0-6281ff6292e7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:06.268805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9cbb36a4-93dd-47cb-b3a0-6281ff6292e7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:06.276719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9cbb36a4-93dd-47cb-b3a0-6281ff6292e7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085610 May 23 13:52:06.277427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 746/1417] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:06 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:06.613382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cc6cc298-a61d-4ca3-bc57-e703f8c298e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:06.614348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cc6cc298-a61d-4ca3-bc57-e703f8c298e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:06.622869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc6cc298-a61d-4ca3-bc57-e703f8c298e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:06.626374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc6cc298-a61d-4ca3-bc57-e703f8c298e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:06.626374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc6cc298-a61d-4ca3-bc57-e703f8c298e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:06.626374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc6cc298-a61d-4ca3-bc57-e703f8c298e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:06.684290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cc6cc298-a61d-4ca3-bc57-e703f8c298e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074492 May 23 13:52:06.685421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 672/1418] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:07.294980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-036906a1-643d-450b-ab81-a7b3ead17e13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:07.295664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-036906a1-643d-450b-ab81-a7b3ead17e13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:07.302510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-036906a1-643d-450b-ab81-a7b3ead17e13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:07.302959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-036906a1-643d-450b-ab81-a7b3ead17e13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:07.303745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-036906a1-643d-450b-ab81-a7b3ead17e13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:07.304181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-036906a1-643d-450b-ab81-a7b3ead17e13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:07.376522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-036906a1-643d-450b-ab81-a7b3ead17e13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:07.385168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-036906a1-643d-450b-ab81-a7b3ead17e13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.094391 May 23 13:52:07.385755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 747/1419] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:07 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:07.696778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-42572ba8-e949-4055-9c80-31d450c4485a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:07.697983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-42572ba8-e949-4055-9c80-31d450c4485a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:07.704962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42572ba8-e949-4055-9c80-31d450c4485a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:07.705407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42572ba8-e949-4055-9c80-31d450c4485a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:07.706173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42572ba8-e949-4055-9c80-31d450c4485a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:07.706601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42572ba8-e949-4055-9c80-31d450c4485a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:07.741342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-42572ba8-e949-4055-9c80-31d450c4485a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048620 May 23 13:52:07.742814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 673/1420] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:08.403385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a57ab5f8-3bb8-474e-b70f-894dacf48fca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:08.404213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a57ab5f8-3bb8-474e-b70f-894dacf48fca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:08.411159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a57ab5f8-3bb8-474e-b70f-894dacf48fca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:08.411613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a57ab5f8-3bb8-474e-b70f-894dacf48fca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:08.412405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a57ab5f8-3bb8-474e-b70f-894dacf48fca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:08.412887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a57ab5f8-3bb8-474e-b70f-894dacf48fca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:08.480438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a57ab5f8-3bb8-474e-b70f-894dacf48fca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:08.498079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a57ab5f8-3bb8-474e-b70f-894dacf48fca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.098962 May 23 13:52:08.498676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 748/1421] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:08 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:08.754867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ac7038b8-abb1-4342-9b4f-7e891d8b3300 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:08.755707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ac7038b8-abb1-4342-9b4f-7e891d8b3300 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:08.763419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac7038b8-abb1-4342-9b4f-7e891d8b3300 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:08.764269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac7038b8-abb1-4342-9b4f-7e891d8b3300 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:08.765494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac7038b8-abb1-4342-9b4f-7e891d8b3300 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:08.766244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac7038b8-abb1-4342-9b4f-7e891d8b3300 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:08.803728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ac7038b8-abb1-4342-9b4f-7e891d8b3300 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052938 May 23 13:52:08.804316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 674/1422] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:09.516161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3183dc60-7c2e-4eb4-8da3-8d6a03f33069 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:09.516765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3183dc60-7c2e-4eb4-8da3-8d6a03f33069 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:09.526172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3183dc60-7c2e-4eb4-8da3-8d6a03f33069 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:09.526673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3183dc60-7c2e-4eb4-8da3-8d6a03f33069 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:09.527753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3183dc60-7c2e-4eb4-8da3-8d6a03f33069 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:09.528282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3183dc60-7c2e-4eb4-8da3-8d6a03f33069 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:09.596651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3183dc60-7c2e-4eb4-8da3-8d6a03f33069 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:09.604900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3183dc60-7c2e-4eb4-8da3-8d6a03f33069 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092834 May 23 13:52:09.605492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 749/1423] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:09 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:52:09.766293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:52:09.766538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:52:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:52:09.816213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f5c4c83-2276-43b7-b849-25f812c72cba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:09.817194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f5c4c83-2276-43b7-b849-25f812c72cba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:09.824803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c83-2276-43b7-b849-25f812c72cba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:09.825266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c83-2276-43b7-b849-25f812c72cba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:09.826189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c83-2276-43b7-b849-25f812c72cba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:09.826969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f5c4c83-2276-43b7-b849-25f812c72cba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:09.858549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f5c4c83-2276-43b7-b849-25f812c72cba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046335 May 23 13:52:09.859108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 675/1424] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:10.622518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-867b9015-adb5-4fc8-bf90-1d80cbd8efa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:10.623192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-867b9015-adb5-4fc8-bf90-1d80cbd8efa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:10.629814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-867b9015-adb5-4fc8-bf90-1d80cbd8efa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:10.630268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-867b9015-adb5-4fc8-bf90-1d80cbd8efa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:10.631055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-867b9015-adb5-4fc8-bf90-1d80cbd8efa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:10.631492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-867b9015-adb5-4fc8-bf90-1d80cbd8efa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:10.701945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-867b9015-adb5-4fc8-bf90-1d80cbd8efa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:10.716932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-867b9015-adb5-4fc8-bf90-1d80cbd8efa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.097906 May 23 13:52:10.718014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 750/1425] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:10 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:52:10.870446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e05324d6-0bf0-45b9-92c7-d7ffd4ccd9f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:10.871393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e05324d6-0bf0-45b9-92c7-d7ffd4ccd9f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:10.878231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e05324d6-0bf0-45b9-92c7-d7ffd4ccd9f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:10.878601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e05324d6-0bf0-45b9-92c7-d7ffd4ccd9f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:10.879376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e05324d6-0bf0-45b9-92c7-d7ffd4ccd9f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:10.879815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e05324d6-0bf0-45b9-92c7-d7ffd4ccd9f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:10.912414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e05324d6-0bf0-45b9-92c7-d7ffd4ccd9f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046405 May 23 13:52:10.913023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 676/1426] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:11.734979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ad527f57-f2fa-470a-8a92-f44668f74d9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:11.735609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ad527f57-f2fa-470a-8a92-f44668f74d9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:11.742902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad527f57-f2fa-470a-8a92-f44668f74d9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:11.743379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad527f57-f2fa-470a-8a92-f44668f74d9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:11.744218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad527f57-f2fa-470a-8a92-f44668f74d9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:11.744691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ad527f57-f2fa-470a-8a92-f44668f74d9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:11.811556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ad527f57-f2fa-470a-8a92-f44668f74d9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:11.819666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ad527f57-f2fa-470a-8a92-f44668f74d9a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088547 May 23 13:52:11.821917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 751/1427] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:11 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:11.925303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b3ac48ab-2440-4536-a58a-0e5d751909ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:11.926268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b3ac48ab-2440-4536-a58a-0e5d751909ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:11.934613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3ac48ab-2440-4536-a58a-0e5d751909ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:11.934983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3ac48ab-2440-4536-a58a-0e5d751909ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:11.935760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3ac48ab-2440-4536-a58a-0e5d751909ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:11.936199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3ac48ab-2440-4536-a58a-0e5d751909ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:11.969647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b3ac48ab-2440-4536-a58a-0e5d751909ee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048222 May 23 13:52:11.970238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 677/1428] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:12.840851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9346e722-7c3d-4b6f-a6cb-f4f90cab6d85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:12.841494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9346e722-7c3d-4b6f-a6cb-f4f90cab6d85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:12.851276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9346e722-7c3d-4b6f-a6cb-f4f90cab6d85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:12.852487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9346e722-7c3d-4b6f-a6cb-f4f90cab6d85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:12.853384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9346e722-7c3d-4b6f-a6cb-f4f90cab6d85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:12.853962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9346e722-7c3d-4b6f-a6cb-f4f90cab6d85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:12.921780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9346e722-7c3d-4b6f-a6cb-f4f90cab6d85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:12.929445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9346e722-7c3d-4b6f-a6cb-f4f90cab6d85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.095243 May 23 13:52:12.930762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 752/1429] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:12 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:12.981769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d7d1d517-c325-4d1c-b9a8-3acad65f2522 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:12.982707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d7d1d517-c325-4d1c-b9a8-3acad65f2522 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:12.989832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7d1d517-c325-4d1c-b9a8-3acad65f2522 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:12.990278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7d1d517-c325-4d1c-b9a8-3acad65f2522 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:12.991058 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7d1d517-c325-4d1c-b9a8-3acad65f2522 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:12.991491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d7d1d517-c325-4d1c-b9a8-3acad65f2522 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:13.024028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d7d1d517-c325-4d1c-b9a8-3acad65f2522 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 May 23 13:52:13.024726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 678/1430] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:13.948964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a1455b1-0632-4d79-bcd7-e27510b85a66 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:13.949545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3a1455b1-0632-4d79-bcd7-e27510b85a66 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:13.956955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a1455b1-0632-4d79-bcd7-e27510b85a66 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:13.957403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a1455b1-0632-4d79-bcd7-e27510b85a66 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:13.958209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a1455b1-0632-4d79-bcd7-e27510b85a66 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:13.958650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a1455b1-0632-4d79-bcd7-e27510b85a66 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:14.026814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a1455b1-0632-4d79-bcd7-e27510b85a66 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:14.035665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a1455b1-0632-4d79-bcd7-e27510b85a66 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091536 May 23 13:52:14.036435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 753/1431] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:13 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:14.038326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-852a5c9a-90ec-470e-9dd0-75d914b71bc9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:14.040126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-852a5c9a-90ec-470e-9dd0-75d914b71bc9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:14.053006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-852a5c9a-90ec-470e-9dd0-75d914b71bc9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:14.053802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-852a5c9a-90ec-470e-9dd0-75d914b71bc9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:14.054854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-852a5c9a-90ec-470e-9dd0-75d914b71bc9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:14.055337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-852a5c9a-90ec-470e-9dd0-75d914b71bc9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:14.091186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-852a5c9a-90ec-470e-9dd0-75d914b71bc9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058967 May 23 13:52:14.091779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 679/1432] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:15.062888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a58e4db0-0205-4684-9803-22ec5de38df7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:15.063494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a58e4db0-0205-4684-9803-22ec5de38df7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:15.065897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=56 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:15.071133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a58e4db0-0205-4684-9803-22ec5de38df7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:15.071602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a58e4db0-0205-4684-9803-22ec5de38df7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:15.072388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a58e4db0-0205-4684-9803-22ec5de38df7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:15.072871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a58e4db0-0205-4684-9803-22ec5de38df7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:15.103983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1c044fff-7b4d-4d7d-a6a7-e7bca0856382 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:15.104985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1c044fff-7b4d-4d7d-a6a7-e7bca0856382 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:15.122193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c044fff-7b4d-4d7d-a6a7-e7bca0856382 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:15.122991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c044fff-7b4d-4d7d-a6a7-e7bca0856382 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:15.124348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c044fff-7b4d-4d7d-a6a7-e7bca0856382 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:15.125144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c044fff-7b4d-4d7d-a6a7-e7bca0856382 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:15.147735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a58e4db0-0205-4684-9803-22ec5de38df7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:15.161669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a58e4db0-0205-4684-9803-22ec5de38df7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.102673 May 23 13:52:15.162401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 754/1433] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:15 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:15.163244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1c044fff-7b4d-4d7d-a6a7-e7bca0856382 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064062 May 23 13:52:15.164429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 680/1434] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:16.175884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5bd7a679-5fd8-4679-b974-33720eee4fa7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:16.176906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5bd7a679-5fd8-4679-b974-33720eee4fa7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:16.182084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f42ed21-b7b0-46e9-a33f-2d52bfd3487f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:16.182918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f42ed21-b7b0-46e9-a33f-2d52bfd3487f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:16.185118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bd7a679-5fd8-4679-b974-33720eee4fa7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:16.185571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bd7a679-5fd8-4679-b974-33720eee4fa7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:16.186358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bd7a679-5fd8-4679-b974-33720eee4fa7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:16.186797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bd7a679-5fd8-4679-b974-33720eee4fa7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:16.190560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f42ed21-b7b0-46e9-a33f-2d52bfd3487f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:16.191015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f42ed21-b7b0-46e9-a33f-2d52bfd3487f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:16.191823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f42ed21-b7b0-46e9-a33f-2d52bfd3487f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:16.192259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f42ed21-b7b0-46e9-a33f-2d52bfd3487f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:16.217310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5bd7a679-5fd8-4679-b974-33720eee4fa7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045546 May 23 13:52:16.217891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 755/1435] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:16 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:16.260797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f42ed21-b7b0-46e9-a33f-2d52bfd3487f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:16.268744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f42ed21-b7b0-46e9-a33f-2d52bfd3487f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092192 May 23 13:52:16.269332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 681/1436] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:16 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:17.229471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-146311a7-425d-4903-8d74-c5f1daa7e5f9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:17.231682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-146311a7-425d-4903-8d74-c5f1daa7e5f9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:17.238558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-146311a7-425d-4903-8d74-c5f1daa7e5f9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:17.239012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-146311a7-425d-4903-8d74-c5f1daa7e5f9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:17.239785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-146311a7-425d-4903-8d74-c5f1daa7e5f9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:17.240222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-146311a7-425d-4903-8d74-c5f1daa7e5f9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:17.273297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-146311a7-425d-4903-8d74-c5f1daa7e5f9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047802 May 23 13:52:17.273878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 756/1437] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:17.286699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c551f82a-8aa6-4853-8671-edaf9703e375 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:17.287314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c551f82a-8aa6-4853-8671-edaf9703e375 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:17.290337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=62 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:17.295260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c551f82a-8aa6-4853-8671-edaf9703e375 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:17.295708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c551f82a-8aa6-4853-8671-edaf9703e375 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:17.296485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c551f82a-8aa6-4853-8671-edaf9703e375 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:17.296945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c551f82a-8aa6-4853-8671-edaf9703e375 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:17.362351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c551f82a-8aa6-4853-8671-edaf9703e375 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:17.370597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c551f82a-8aa6-4853-8671-edaf9703e375 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087889 May 23 13:52:17.371168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 682/1438] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:17 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:18.285601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-371ebb1f-4f57-4b87-b5f3-f86f41e24b1b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:18.286569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-371ebb1f-4f57-4b87-b5f3-f86f41e24b1b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:18.293542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371ebb1f-4f57-4b87-b5f3-f86f41e24b1b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:18.293995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371ebb1f-4f57-4b87-b5f3-f86f41e24b1b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:18.294770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371ebb1f-4f57-4b87-b5f3-f86f41e24b1b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:18.295207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-371ebb1f-4f57-4b87-b5f3-f86f41e24b1b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:18.326839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-371ebb1f-4f57-4b87-b5f3-f86f41e24b1b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045407 May 23 13:52:18.327407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 757/1439] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:18.390676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-915309b8-3dbb-4b1c-b4bd-8b8654a0183d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:18.391288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-915309b8-3dbb-4b1c-b4bd-8b8654a0183d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:18.398917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-915309b8-3dbb-4b1c-b4bd-8b8654a0183d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:18.399378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-915309b8-3dbb-4b1c-b4bd-8b8654a0183d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:18.400160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-915309b8-3dbb-4b1c-b4bd-8b8654a0183d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:18.400629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-915309b8-3dbb-4b1c-b4bd-8b8654a0183d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:18.464788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-915309b8-3dbb-4b1c-b4bd-8b8654a0183d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:18.472325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-915309b8-3dbb-4b1c-b4bd-8b8654a0183d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085550 May 23 13:52:18.472912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 683/1440] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:18 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:19.339333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-44cc2ac9-fdb1-4253-af0d-fb3aa7a14c4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:19.340272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-44cc2ac9-fdb1-4253-af0d-fb3aa7a14c4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:19.346940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44cc2ac9-fdb1-4253-af0d-fb3aa7a14c4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:19.347412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44cc2ac9-fdb1-4253-af0d-fb3aa7a14c4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:19.348152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44cc2ac9-fdb1-4253-af0d-fb3aa7a14c4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:19.348605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44cc2ac9-fdb1-4253-af0d-fb3aa7a14c4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:19.377490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-44cc2ac9-fdb1-4253-af0d-fb3aa7a14c4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042577 May 23 13:52:19.377973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 758/1441] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:19.488643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72a1fbd8-415a-400a-b9cc-b8523262a8ea tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:19.489256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72a1fbd8-415a-400a-b9cc-b8523262a8ea tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:19.496173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72a1fbd8-415a-400a-b9cc-b8523262a8ea tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:19.496652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72a1fbd8-415a-400a-b9cc-b8523262a8ea tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:19.497418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72a1fbd8-415a-400a-b9cc-b8523262a8ea tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:19.497854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72a1fbd8-415a-400a-b9cc-b8523262a8ea tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:19.562271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72a1fbd8-415a-400a-b9cc-b8523262a8ea tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:19.570647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72a1fbd8-415a-400a-b9cc-b8523262a8ea tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085733 May 23 13:52:19.571221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 684/1442] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:19 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:20.389741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-72677184-e1b4-4bc8-a241-4cf43243a848 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:20.390672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-72677184-e1b4-4bc8-a241-4cf43243a848 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:20.397693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72677184-e1b4-4bc8-a241-4cf43243a848 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:20.398764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72677184-e1b4-4bc8-a241-4cf43243a848 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:20.399557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72677184-e1b4-4bc8-a241-4cf43243a848 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:20.400003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72677184-e1b4-4bc8-a241-4cf43243a848 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:20.432286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-72677184-e1b4-4bc8-a241-4cf43243a848 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046502 May 23 13:52:20.432911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 759/1443] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:20.587702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1235a8c8-a4a7-4dda-8681-588d6089685f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:20.588366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1235a8c8-a4a7-4dda-8681-588d6089685f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:20.595129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1235a8c8-a4a7-4dda-8681-588d6089685f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:20.595575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1235a8c8-a4a7-4dda-8681-588d6089685f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:20.596341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1235a8c8-a4a7-4dda-8681-588d6089685f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:20.596803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1235a8c8-a4a7-4dda-8681-588d6089685f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:20.674440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1235a8c8-a4a7-4dda-8681-588d6089685f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:20.683414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1235a8c8-a4a7-4dda-8681-588d6089685f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.099938 May 23 13:52:20.683995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 685/1444] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:20 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:21.446252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5fdd73d0-08d3-4f1c-805c-2d3b0108f420 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:21.447101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5fdd73d0-08d3-4f1c-805c-2d3b0108f420 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:21.454223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5fdd73d0-08d3-4f1c-805c-2d3b0108f420 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:21.454671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5fdd73d0-08d3-4f1c-805c-2d3b0108f420 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:21.455647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5fdd73d0-08d3-4f1c-805c-2d3b0108f420 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:21.456101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5fdd73d0-08d3-4f1c-805c-2d3b0108f420 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:21.490604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5fdd73d0-08d3-4f1c-805c-2d3b0108f420 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048782 May 23 13:52:21.491228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 760/1445] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:21.701561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7b488be-be31-4270-b50d-c6159161e9f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:21.702102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7b488be-be31-4270-b50d-c6159161e9f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:21.709614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7b488be-be31-4270-b50d-c6159161e9f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:21.710706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7b488be-be31-4270-b50d-c6159161e9f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:21.711722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7b488be-be31-4270-b50d-c6159161e9f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:21.712161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7b488be-be31-4270-b50d-c6159161e9f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:21.717027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:21.785756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7b488be-be31-4270-b50d-c6159161e9f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:21.799432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7b488be-be31-4270-b50d-c6159161e9f2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.101433 May 23 13:52:21.800485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 686/1446] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:21 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:22.502528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efd07c40-cc69-4da3-afc4-6b79eceb9694 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:22.503457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efd07c40-cc69-4da3-afc4-6b79eceb9694 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:22.510565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efd07c40-cc69-4da3-afc4-6b79eceb9694 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:22.511012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efd07c40-cc69-4da3-afc4-6b79eceb9694 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:22.511781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efd07c40-cc69-4da3-afc4-6b79eceb9694 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:22.512217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efd07c40-cc69-4da3-afc4-6b79eceb9694 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:22.543239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efd07c40-cc69-4da3-afc4-6b79eceb9694 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044604 May 23 13:52:22.543805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 761/1447] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:22.818411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8986952-b76c-4b2e-ac2d-83f562a9a371 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:22.819010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8986952-b76c-4b2e-ac2d-83f562a9a371 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:22.826379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8986952-b76c-4b2e-ac2d-83f562a9a371 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:22.826821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8986952-b76c-4b2e-ac2d-83f562a9a371 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:22.827582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8986952-b76c-4b2e-ac2d-83f562a9a371 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:22.828017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8986952-b76c-4b2e-ac2d-83f562a9a371 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:22.890133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b8986952-b76c-4b2e-ac2d-83f562a9a371 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:22.898312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8986952-b76c-4b2e-ac2d-83f562a9a371 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083140 May 23 13:52:22.898895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 687/1448] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:22 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:23.556303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf85875e-3187-4b03-9410-f6ca5e93109b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:23.557185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf85875e-3187-4b03-9410-f6ca5e93109b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:23.563906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf85875e-3187-4b03-9410-f6ca5e93109b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:23.564354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf85875e-3187-4b03-9410-f6ca5e93109b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:23.565162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf85875e-3187-4b03-9410-f6ca5e93109b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:23.565595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf85875e-3187-4b03-9410-f6ca5e93109b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:23.584252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:23.599120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf85875e-3187-4b03-9410-f6ca5e93109b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047903 May 23 13:52:23.599796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 762/1449] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:23.799145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:52:23.799387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:52:23.915644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c3ae4267-2f4f-4d27-980c-978a70c61a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:23.916333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c3ae4267-2f4f-4d27-980c-978a70c61a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:23.922896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3ae4267-2f4f-4d27-980c-978a70c61a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:23.923342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3ae4267-2f4f-4d27-980c-978a70c61a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:23.924107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3ae4267-2f4f-4d27-980c-978a70c61a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:23.924543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3ae4267-2f4f-4d27-980c-978a70c61a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:23.992134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c3ae4267-2f4f-4d27-980c-978a70c61a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:24.001865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c3ae4267-2f4f-4d27-980c-978a70c61a1c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090421 May 23 13:52:24.002457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 688/1450] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:23 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:24.611590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-88e62c0e-77a5-4107-85cf-0308e558e320 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:24.612534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-88e62c0e-77a5-4107-85cf-0308e558e320 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:24.620383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88e62c0e-77a5-4107-85cf-0308e558e320 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:24.620866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88e62c0e-77a5-4107-85cf-0308e558e320 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:24.621673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88e62c0e-77a5-4107-85cf-0308e558e320 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:24.622117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88e62c0e-77a5-4107-85cf-0308e558e320 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:24.656428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-88e62c0e-77a5-4107-85cf-0308e558e320 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049172 May 23 13:52:24.657245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 763/1451] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:25.019724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fb5ee241-3389-4c86-a374-be3511d0c173 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:25.021067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fb5ee241-3389-4c86-a374-be3511d0c173 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:25.029909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb5ee241-3389-4c86-a374-be3511d0c173 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:25.031592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb5ee241-3389-4c86-a374-be3511d0c173 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:25.031592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb5ee241-3389-4c86-a374-be3511d0c173 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:25.031592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb5ee241-3389-4c86-a374-be3511d0c173 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:25.106278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb5ee241-3389-4c86-a374-be3511d0c173 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:25.114670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fb5ee241-3389-4c86-a374-be3511d0c173 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.098928 May 23 13:52:25.119432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 689/1452] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:25 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:25.668965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e241f85-39aa-47a9-a87d-071810d16562 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:25.669881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1e241f85-39aa-47a9-a87d-071810d16562 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:25.676463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e241f85-39aa-47a9-a87d-071810d16562 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:25.676934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e241f85-39aa-47a9-a87d-071810d16562 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:25.677714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e241f85-39aa-47a9-a87d-071810d16562 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:25.678146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e241f85-39aa-47a9-a87d-071810d16562 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:25.707366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1e241f85-39aa-47a9-a87d-071810d16562 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 May 23 13:52:25.707916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 764/1453] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:26.135273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c30fbfb7-f1e4-4543-81c4-fb9bde24a369 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:26.135885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c30fbfb7-f1e4-4543-81c4-fb9bde24a369 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:26.143468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c30fbfb7-f1e4-4543-81c4-fb9bde24a369 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:26.143918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c30fbfb7-f1e4-4543-81c4-fb9bde24a369 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:26.144721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c30fbfb7-f1e4-4543-81c4-fb9bde24a369 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:26.145180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c30fbfb7-f1e4-4543-81c4-fb9bde24a369 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:26.215442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c30fbfb7-f1e4-4543-81c4-fb9bde24a369 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:26.226756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c30fbfb7-f1e4-4543-81c4-fb9bde24a369 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.095953 May 23 13:52:26.227832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 690/1454] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:26 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:26.720140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7bc0ed3-ecba-4402-9bd5-aa81863cede8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:26.721134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7bc0ed3-ecba-4402-9bd5-aa81863cede8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:26.728023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7bc0ed3-ecba-4402-9bd5-aa81863cede8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:26.728482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7bc0ed3-ecba-4402-9bd5-aa81863cede8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:26.729408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7bc0ed3-ecba-4402-9bd5-aa81863cede8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:26.729852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7bc0ed3-ecba-4402-9bd5-aa81863cede8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:26.762498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7bc0ed3-ecba-4402-9bd5-aa81863cede8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046240 May 23 13:52:26.763235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 765/1455] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:27.245509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-026ff142-8921-4ca7-b7f5-d6b4c6d97f93 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:27.246131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-026ff142-8921-4ca7-b7f5-d6b4c6d97f93 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:27.252958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-026ff142-8921-4ca7-b7f5-d6b4c6d97f93 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:27.253430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-026ff142-8921-4ca7-b7f5-d6b4c6d97f93 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:27.254211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-026ff142-8921-4ca7-b7f5-d6b4c6d97f93 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:27.254659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-026ff142-8921-4ca7-b7f5-d6b4c6d97f93 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:27.323216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-026ff142-8921-4ca7-b7f5-d6b4c6d97f93 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:27.331469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-026ff142-8921-4ca7-b7f5-d6b4c6d97f93 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090609 May 23 13:52:27.332059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 691/1456] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:27 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:27.775261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33bd71c0-a115-4e34-8e37-e84ab2003510 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:27.776190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33bd71c0-a115-4e34-8e37-e84ab2003510 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:27.782816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33bd71c0-a115-4e34-8e37-e84ab2003510 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:27.783258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33bd71c0-a115-4e34-8e37-e84ab2003510 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:27.784029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33bd71c0-a115-4e34-8e37-e84ab2003510 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:27.784469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33bd71c0-a115-4e34-8e37-e84ab2003510 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:27.815357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33bd71c0-a115-4e34-8e37-e84ab2003510 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045278 May 23 13:52:27.815924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 766/1457] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:28.349436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6dbe08b3-9578-4618-bfaa-2161eac19507 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:28.350081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6dbe08b3-9578-4618-bfaa-2161eac19507 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:28.357846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6dbe08b3-9578-4618-bfaa-2161eac19507 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:28.358286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6dbe08b3-9578-4618-bfaa-2161eac19507 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:28.359052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6dbe08b3-9578-4618-bfaa-2161eac19507 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:28.359554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6dbe08b3-9578-4618-bfaa-2161eac19507 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:28.427200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6dbe08b3-9578-4618-bfaa-2161eac19507 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:28.436757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6dbe08b3-9578-4618-bfaa-2161eac19507 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091222 May 23 13:52:28.437255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 692/1458] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:28 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:28.828406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6e293c9d-616f-44d2-adf8-cbf61cc529ce tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:28.829272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6e293c9d-616f-44d2-adf8-cbf61cc529ce tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:28.836482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e293c9d-616f-44d2-adf8-cbf61cc529ce tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:28.836971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e293c9d-616f-44d2-adf8-cbf61cc529ce tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:28.837796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e293c9d-616f-44d2-adf8-cbf61cc529ce tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:28.838273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e293c9d-616f-44d2-adf8-cbf61cc529ce tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:28.872004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6e293c9d-616f-44d2-adf8-cbf61cc529ce tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047630 May 23 13:52:28.872610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 767/1459] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:29.454129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ad8226d4-8264-4ab9-812c-7ab17d18b0c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:29.454782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ad8226d4-8264-4ab9-812c-7ab17d18b0c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:29.462416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad8226d4-8264-4ab9-812c-7ab17d18b0c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:29.462862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad8226d4-8264-4ab9-812c-7ab17d18b0c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:29.463638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad8226d4-8264-4ab9-812c-7ab17d18b0c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:29.464072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad8226d4-8264-4ab9-812c-7ab17d18b0c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:29.532980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ad8226d4-8264-4ab9-812c-7ab17d18b0c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:29.541842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ad8226d4-8264-4ab9-812c-7ab17d18b0c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091601 May 23 13:52:29.542421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 693/1460] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:29 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:29.884582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-563e93fc-a1e6-4e9f-9466-a35e3ccd4482 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:29.885568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-563e93fc-a1e6-4e9f-9466-a35e3ccd4482 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:29.892071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-563e93fc-a1e6-4e9f-9466-a35e3ccd4482 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:29.892516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-563e93fc-a1e6-4e9f-9466-a35e3ccd4482 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:29.893310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-563e93fc-a1e6-4e9f-9466-a35e3ccd4482 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:29.893743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-563e93fc-a1e6-4e9f-9466-a35e3ccd4482 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:29.924809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-563e93fc-a1e6-4e9f-9466-a35e3ccd4482 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044795 May 23 13:52:29.925376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 768/1461] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:30.560205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-16bed032-65f3-4e3e-903a-607e9a4cb600 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:30.564176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-16bed032-65f3-4e3e-903a-607e9a4cb600 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:30.567270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16bed032-65f3-4e3e-903a-607e9a4cb600 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:30.567839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16bed032-65f3-4e3e-903a-607e9a4cb600 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:30.568505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16bed032-65f3-4e3e-903a-607e9a4cb600 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:30.569063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16bed032-65f3-4e3e-903a-607e9a4cb600 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:30.635816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-16bed032-65f3-4e3e-903a-607e9a4cb600 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:30.643743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-16bed032-65f3-4e3e-903a-607e9a4cb600 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087465 May 23 13:52:30.644321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 694/1462] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:30 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:30.936937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a2c2885-7785-453b-9f5a-2a156303b013 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:30.937852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a2c2885-7785-453b-9f5a-2a156303b013 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:30.944960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a2c2885-7785-453b-9f5a-2a156303b013 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:30.945406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a2c2885-7785-453b-9f5a-2a156303b013 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:30.946160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a2c2885-7785-453b-9f5a-2a156303b013 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:30.946591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a2c2885-7785-453b-9f5a-2a156303b013 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:30.975887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a2c2885-7785-453b-9f5a-2a156303b013 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042862 May 23 13:52:30.976451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 769/1463] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:31.661653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7f6aad5-794f-42d2-8053-bec003b00bf0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:31.662257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7f6aad5-794f-42d2-8053-bec003b00bf0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:31.669162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7f6aad5-794f-42d2-8053-bec003b00bf0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:31.669616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7f6aad5-794f-42d2-8053-bec003b00bf0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:31.670384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7f6aad5-794f-42d2-8053-bec003b00bf0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:31.670828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7f6aad5-794f-42d2-8053-bec003b00bf0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:31.733458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7f6aad5-794f-42d2-8053-bec003b00bf0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:31.741257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7f6aad5-794f-42d2-8053-bec003b00bf0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083405 May 23 13:52:31.741830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 695/1464] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:31 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:52:31.987756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a8858cf-c979-4456-afc2-a367ad17e76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:31.988614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a8858cf-c979-4456-afc2-a367ad17e76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:31.996322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a8858cf-c979-4456-afc2-a367ad17e76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:31.996797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a8858cf-c979-4456-afc2-a367ad17e76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:31.997570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a8858cf-c979-4456-afc2-a367ad17e76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:31.998001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a8858cf-c979-4456-afc2-a367ad17e76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:32.028591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a8858cf-c979-4456-afc2-a367ad17e76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044933 May 23 13:52:32.029469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 770/1465] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:32.759612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c117fb1e-308b-4a00-a771-2b39dbac4246 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:32.760226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c117fb1e-308b-4a00-a771-2b39dbac4246 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:32.766904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c117fb1e-308b-4a00-a771-2b39dbac4246 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:32.767354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c117fb1e-308b-4a00-a771-2b39dbac4246 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:32.768109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c117fb1e-308b-4a00-a771-2b39dbac4246 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:32.768543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c117fb1e-308b-4a00-a771-2b39dbac4246 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:32.832915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c117fb1e-308b-4a00-a771-2b39dbac4246 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:32.841403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c117fb1e-308b-4a00-a771-2b39dbac4246 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086184 May 23 13:52:32.841967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 696/1466] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:32 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:52:33.041695 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aee605a3-1b78-4002-8b2f-5139d002942d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:33.042546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aee605a3-1b78-4002-8b2f-5139d002942d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:33.049705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee605a3-1b78-4002-8b2f-5139d002942d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:33.050194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee605a3-1b78-4002-8b2f-5139d002942d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:33.051082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee605a3-1b78-4002-8b2f-5139d002942d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:33.051525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee605a3-1b78-4002-8b2f-5139d002942d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:33.080598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aee605a3-1b78-4002-8b2f-5139d002942d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043402 May 23 13:52:33.081153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 771/1467] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:33.858052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04029cf7-f7fa-4a1c-b41e-4eda8aeab107 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:33.858669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04029cf7-f7fa-4a1c-b41e-4eda8aeab107 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:33.865097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04029cf7-f7fa-4a1c-b41e-4eda8aeab107 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:33.865539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04029cf7-f7fa-4a1c-b41e-4eda8aeab107 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:33.866303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04029cf7-f7fa-4a1c-b41e-4eda8aeab107 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:33.866733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04029cf7-f7fa-4a1c-b41e-4eda8aeab107 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:33.933985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04029cf7-f7fa-4a1c-b41e-4eda8aeab107 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:33.944951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04029cf7-f7fa-4a1c-b41e-4eda8aeab107 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090292 May 23 13:52:33.945942 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 697/1468] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:33 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:34.092934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-838c0080-4d1e-4a37-b0fc-5d9430e19adf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:34.093869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-838c0080-4d1e-4a37-b0fc-5d9430e19adf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:34.100389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-838c0080-4d1e-4a37-b0fc-5d9430e19adf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:34.100880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-838c0080-4d1e-4a37-b0fc-5d9430e19adf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:34.101724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-838c0080-4d1e-4a37-b0fc-5d9430e19adf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:34.102333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-838c0080-4d1e-4a37-b0fc-5d9430e19adf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:34.142774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-838c0080-4d1e-4a37-b0fc-5d9430e19adf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053888 May 23 13:52:34.143364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 772/1469] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:34.963455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5698ba30-b529-4e27-9b07-65b37d9eadb4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:34.964088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5698ba30-b529-4e27-9b07-65b37d9eadb4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:34.970817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5698ba30-b529-4e27-9b07-65b37d9eadb4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:34.971267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5698ba30-b529-4e27-9b07-65b37d9eadb4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:34.972045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5698ba30-b529-4e27-9b07-65b37d9eadb4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:34.972483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5698ba30-b529-4e27-9b07-65b37d9eadb4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:35.040425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5698ba30-b529-4e27-9b07-65b37d9eadb4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:35.047474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5698ba30-b529-4e27-9b07-65b37d9eadb4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088373 May 23 13:52:35.048054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 698/1470] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:34 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:35.155283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-698859a6-a274-4454-af2c-dabc592653d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:35.156760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-698859a6-a274-4454-af2c-dabc592653d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:35.163017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698859a6-a274-4454-af2c-dabc592653d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:35.163466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698859a6-a274-4454-af2c-dabc592653d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:35.164241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698859a6-a274-4454-af2c-dabc592653d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:35.165050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698859a6-a274-4454-af2c-dabc592653d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:35.195219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-698859a6-a274-4454-af2c-dabc592653d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 May 23 13:52:35.196758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 773/1471] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:36.065194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-73bdf240-ac6f-4340-9e1a-8b3b6be3da28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:36.065754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-73bdf240-ac6f-4340-9e1a-8b3b6be3da28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:36.073535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73bdf240-ac6f-4340-9e1a-8b3b6be3da28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:36.073990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73bdf240-ac6f-4340-9e1a-8b3b6be3da28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:36.074762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73bdf240-ac6f-4340-9e1a-8b3b6be3da28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:36.075222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73bdf240-ac6f-4340-9e1a-8b3b6be3da28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:36.139263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-73bdf240-ac6f-4340-9e1a-8b3b6be3da28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:36.146893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-73bdf240-ac6f-4340-9e1a-8b3b6be3da28 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085616 May 23 13:52:36.147442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 699/1472] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:36 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:36.207446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb1f10e7-5a7b-46d1-95c9-82281758ba98 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:36.208668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb1f10e7-5a7b-46d1-95c9-82281758ba98 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:36.215209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb1f10e7-5a7b-46d1-95c9-82281758ba98 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:36.215655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb1f10e7-5a7b-46d1-95c9-82281758ba98 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:36.216416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb1f10e7-5a7b-46d1-95c9-82281758ba98 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:36.216893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb1f10e7-5a7b-46d1-95c9-82281758ba98 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:36.245642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb1f10e7-5a7b-46d1-95c9-82281758ba98 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042166 May 23 13:52:36.246196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 774/1473] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:37.163318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eb8034b8-0fe1-4a5e-81e6-1b9b99054699 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:37.165196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eb8034b8-0fe1-4a5e-81e6-1b9b99054699 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:37.174404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb8034b8-0fe1-4a5e-81e6-1b9b99054699 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:37.174858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb8034b8-0fe1-4a5e-81e6-1b9b99054699 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:37.175643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb8034b8-0fe1-4a5e-81e6-1b9b99054699 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:37.176126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb8034b8-0fe1-4a5e-81e6-1b9b99054699 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:37.251009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eb8034b8-0fe1-4a5e-81e6-1b9b99054699 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:37.257400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df47a548-4a27-4163-a6eb-12a9be43d7a6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:37.259395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df47a548-4a27-4163-a6eb-12a9be43d7a6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:37.260427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eb8034b8-0fe1-4a5e-81e6-1b9b99054699 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.100904 May 23 13:52:37.261065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 700/1474] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:37 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:37.266204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df47a548-4a27-4163-a6eb-12a9be43d7a6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:37.266654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df47a548-4a27-4163-a6eb-12a9be43d7a6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:37.267432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df47a548-4a27-4163-a6eb-12a9be43d7a6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:37.267870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df47a548-4a27-4163-a6eb-12a9be43d7a6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:37.310269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df47a548-4a27-4163-a6eb-12a9be43d7a6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056756 May 23 13:52:37.310857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 775/1475] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:38.277660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb08cd49-3fc6-470c-98f0-6f8e93637669 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:38.278295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb08cd49-3fc6-470c-98f0-6f8e93637669 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:38.285741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb08cd49-3fc6-470c-98f0-6f8e93637669 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:38.286447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb08cd49-3fc6-470c-98f0-6f8e93637669 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:38.287647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb08cd49-3fc6-470c-98f0-6f8e93637669 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:38.288087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb08cd49-3fc6-470c-98f0-6f8e93637669 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:38.323219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-58e995a5-1908-4658-901b-25999f6870fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:38.325034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-58e995a5-1908-4658-901b-25999f6870fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:38.331950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58e995a5-1908-4658-901b-25999f6870fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:38.332445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58e995a5-1908-4658-901b-25999f6870fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:38.333566 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58e995a5-1908-4658-901b-25999f6870fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:38.334016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58e995a5-1908-4658-901b-25999f6870fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:38.362411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb08cd49-3fc6-470c-98f0-6f8e93637669 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:38.368018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-58e995a5-1908-4658-901b-25999f6870fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049438 May 23 13:52:38.371949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 776/1476] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:38.372719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb08cd49-3fc6-470c-98f0-6f8e93637669 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.098919 May 23 13:52:38.373295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 701/1477] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:38 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:39.379913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-22c9e91f-6e43-45fd-9515-13e2c8bc73ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:39.380904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-22c9e91f-6e43-45fd-9515-13e2c8bc73ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:39.390175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-16b496ab-c121-4195-88f5-e62392953296 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:39.390848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22c9e91f-6e43-45fd-9515-13e2c8bc73ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:39.391077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-16b496ab-c121-4195-88f5-e62392953296 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:39.391319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22c9e91f-6e43-45fd-9515-13e2c8bc73ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:39.392119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22c9e91f-6e43-45fd-9515-13e2c8bc73ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:39.392597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22c9e91f-6e43-45fd-9515-13e2c8bc73ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:39.397455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16b496ab-c121-4195-88f5-e62392953296 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:39.397908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16b496ab-c121-4195-88f5-e62392953296 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:39.398700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16b496ab-c121-4195-88f5-e62392953296 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:39.399323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16b496ab-c121-4195-88f5-e62392953296 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:39.426954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-22c9e91f-6e43-45fd-9515-13e2c8bc73ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050811 May 23 13:52:39.427908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 777/1478] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:39.465282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-16b496ab-c121-4195-88f5-e62392953296 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:39.470310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:39.477549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-16b496ab-c121-4195-88f5-e62392953296 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091079 May 23 13:52:39.478562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 702/1479] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:39 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:52:40.440659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-71ea5dbf-e18d-4d7c-87bc-cbac7b306254 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:40.441502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-71ea5dbf-e18d-4d7c-87bc-cbac7b306254 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:40.449465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71ea5dbf-e18d-4d7c-87bc-cbac7b306254 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:40.449911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71ea5dbf-e18d-4d7c-87bc-cbac7b306254 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:40.450684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71ea5dbf-e18d-4d7c-87bc-cbac7b306254 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:40.451117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71ea5dbf-e18d-4d7c-87bc-cbac7b306254 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:40.483318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-71ea5dbf-e18d-4d7c-87bc-cbac7b306254 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046668 May 23 13:52:40.483891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 778/1480] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:40.507234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4513141a-bc2c-4f46-aeeb-899d57724604 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:40.508747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4513141a-bc2c-4f46-aeeb-899d57724604 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:40.515894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4513141a-bc2c-4f46-aeeb-899d57724604 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:40.516348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4513141a-bc2c-4f46-aeeb-899d57724604 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:40.517167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4513141a-bc2c-4f46-aeeb-899d57724604 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:40.517600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4513141a-bc2c-4f46-aeeb-899d57724604 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:40.582509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4513141a-bc2c-4f46-aeeb-899d57724604 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:40.590616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4513141a-bc2c-4f46-aeeb-899d57724604 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087590 May 23 13:52:40.591184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 703/1481] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:40 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:41.495419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-76f8fdfa-191c-4b7b-ac31-fe6fcca3842e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:41.496268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-76f8fdfa-191c-4b7b-ac31-fe6fcca3842e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:41.502936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76f8fdfa-191c-4b7b-ac31-fe6fcca3842e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:41.503383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76f8fdfa-191c-4b7b-ac31-fe6fcca3842e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:41.504161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76f8fdfa-191c-4b7b-ac31-fe6fcca3842e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:41.504624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76f8fdfa-191c-4b7b-ac31-fe6fcca3842e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:41.509175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:41.536167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-76f8fdfa-191c-4b7b-ac31-fe6fcca3842e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045215 May 23 13:52:41.536779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 779/1482] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:41.608243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5f799c9-e754-414a-bd49-8e4893e91169 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:41.608911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5f799c9-e754-414a-bd49-8e4893e91169 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:41.615685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f799c9-e754-414a-bd49-8e4893e91169 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:41.616128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f799c9-e754-414a-bd49-8e4893e91169 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:41.617699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f799c9-e754-414a-bd49-8e4893e91169 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:41.618238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f799c9-e754-414a-bd49-8e4893e91169 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:41.682467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f5f799c9-e754-414a-bd49-8e4893e91169 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:41.690429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5f799c9-e754-414a-bd49-8e4893e91169 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086318 May 23 13:52:41.691000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 704/1483] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:41 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:42.548521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9db5751-da81-4b0b-8aa0-687de5f23016 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:42.549376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9db5751-da81-4b0b-8aa0-687de5f23016 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:42.556890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9db5751-da81-4b0b-8aa0-687de5f23016 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:42.557346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9db5751-da81-4b0b-8aa0-687de5f23016 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:42.558130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9db5751-da81-4b0b-8aa0-687de5f23016 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:42.558576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9db5751-da81-4b0b-8aa0-687de5f23016 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:42.592368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9db5751-da81-4b0b-8aa0-687de5f23016 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048201 May 23 13:52:42.592972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 780/1484] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:42.708467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c8a25187-8b98-4b1b-b845-3278ebe6f1c6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:42.709110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c8a25187-8b98-4b1b-b845-3278ebe6f1c6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:42.716332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8a25187-8b98-4b1b-b845-3278ebe6f1c6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:42.716814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8a25187-8b98-4b1b-b845-3278ebe6f1c6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:42.717583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8a25187-8b98-4b1b-b845-3278ebe6f1c6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:42.718019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8a25187-8b98-4b1b-b845-3278ebe6f1c6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:42.786854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8a25187-8b98-4b1b-b845-3278ebe6f1c6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:42.794594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c8a25187-8b98-4b1b-b845-3278ebe6f1c6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090194 May 23 13:52:42.795158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 705/1485] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:42 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:43.604532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f914a3ac-d86e-47e8-b94f-c7c494835154 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:43.605638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f914a3ac-d86e-47e8-b94f-c7c494835154 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:43.612628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f914a3ac-d86e-47e8-b94f-c7c494835154 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:43.613072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f914a3ac-d86e-47e8-b94f-c7c494835154 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:43.613931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f914a3ac-d86e-47e8-b94f-c7c494835154 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:43.614366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f914a3ac-d86e-47e8-b94f-c7c494835154 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:43.646773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f914a3ac-d86e-47e8-b94f-c7c494835154 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 May 23 13:52:43.647370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 781/1486] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:43.811466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07bf02be-ff25-4562-81b8-b84e1722f331 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:43.812010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07bf02be-ff25-4562-81b8-b84e1722f331 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:43.818769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07bf02be-ff25-4562-81b8-b84e1722f331 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:43.819212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07bf02be-ff25-4562-81b8-b84e1722f331 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:43.820035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07bf02be-ff25-4562-81b8-b84e1722f331 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:43.820469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07bf02be-ff25-4562-81b8-b84e1722f331 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:43.884621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07bf02be-ff25-4562-81b8-b84e1722f331 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:43.895046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07bf02be-ff25-4562-81b8-b84e1722f331 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087460 May 23 13:52:43.895636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 706/1487] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:43 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:44.659961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-afe520f0-49df-4be5-967f-c6610600e778 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:44.660909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-afe520f0-49df-4be5-967f-c6610600e778 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:44.668109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afe520f0-49df-4be5-967f-c6610600e778 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:44.668577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afe520f0-49df-4be5-967f-c6610600e778 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:44.669360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afe520f0-49df-4be5-967f-c6610600e778 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:44.669801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afe520f0-49df-4be5-967f-c6610600e778 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:44.700607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-afe520f0-49df-4be5-967f-c6610600e778 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 May 23 13:52:44.701444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 782/1488] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:44.913225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-16495ed4-10f6-4579-8d61-7decd4a9f52d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:44.914989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-16495ed4-10f6-4579-8d61-7decd4a9f52d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:44.921131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16495ed4-10f6-4579-8d61-7decd4a9f52d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:44.921581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16495ed4-10f6-4579-8d61-7decd4a9f52d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:44.922348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16495ed4-10f6-4579-8d61-7decd4a9f52d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:44.922780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16495ed4-10f6-4579-8d61-7decd4a9f52d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:44.986795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-16495ed4-10f6-4579-8d61-7decd4a9f52d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:44.996747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-16495ed4-10f6-4579-8d61-7decd4a9f52d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087522 May 23 13:52:44.997337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 707/1489] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:44 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:45.713975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6771e884-b81f-4368-b3c1-2e0f2ff75eaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:45.714911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6771e884-b81f-4368-b3c1-2e0f2ff75eaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:45.717055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=58 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:45.722235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6771e884-b81f-4368-b3c1-2e0f2ff75eaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:45.722681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6771e884-b81f-4368-b3c1-2e0f2ff75eaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:45.723462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6771e884-b81f-4368-b3c1-2e0f2ff75eaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:45.723921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6771e884-b81f-4368-b3c1-2e0f2ff75eaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:45.762587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6771e884-b81f-4368-b3c1-2e0f2ff75eaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053339 May 23 13:52:45.763183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 783/1490] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:46.015294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da333147-c0c3-4037-97ea-e7770f39a44f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:46.016014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da333147-c0c3-4037-97ea-e7770f39a44f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:46.023020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da333147-c0c3-4037-97ea-e7770f39a44f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:46.023906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da333147-c0c3-4037-97ea-e7770f39a44f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:46.024817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da333147-c0c3-4037-97ea-e7770f39a44f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:46.025247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da333147-c0c3-4037-97ea-e7770f39a44f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:46.093626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da333147-c0c3-4037-97ea-e7770f39a44f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:46.102573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da333147-c0c3-4037-97ea-e7770f39a44f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091571 May 23 13:52:46.103179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 708/1491] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:46 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:46.842590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5e6b027d-4be9-49bc-af2c-677bde1d7de7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:46.843547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5e6b027d-4be9-49bc-af2c-677bde1d7de7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:46.849700 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e6b027d-4be9-49bc-af2c-677bde1d7de7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:46.850154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e6b027d-4be9-49bc-af2c-677bde1d7de7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:46.851478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e6b027d-4be9-49bc-af2c-677bde1d7de7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:46.851478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e6b027d-4be9-49bc-af2c-677bde1d7de7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:46.884550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5e6b027d-4be9-49bc-af2c-677bde1d7de7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114434 May 23 13:52:46.885143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 784/1492] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:47.119466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-03c16492-1d5e-4b7a-8e0e-1e88707344c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:47.120061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-03c16492-1d5e-4b7a-8e0e-1e88707344c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:47.126804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-03c16492-1d5e-4b7a-8e0e-1e88707344c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:47.127253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-03c16492-1d5e-4b7a-8e0e-1e88707344c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:47.128033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-03c16492-1d5e-4b7a-8e0e-1e88707344c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:47.128501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-03c16492-1d5e-4b7a-8e0e-1e88707344c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:47.249514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-03c16492-1d5e-4b7a-8e0e-1e88707344c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:47.259263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-03c16492-1d5e-4b7a-8e0e-1e88707344c7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.144269 May 23 13:52:47.259869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 709/1493] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:47 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:47.896386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1122237b-e017-4def-8b47-a56a1f2fe6b2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:47.897357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1122237b-e017-4def-8b47-a56a1f2fe6b2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:47.904332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1122237b-e017-4def-8b47-a56a1f2fe6b2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:47.904822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1122237b-e017-4def-8b47-a56a1f2fe6b2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:47.905603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1122237b-e017-4def-8b47-a56a1f2fe6b2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:47.906041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1122237b-e017-4def-8b47-a56a1f2fe6b2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:47.937874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1122237b-e017-4def-8b47-a56a1f2fe6b2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 May 23 13:52:47.938451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 785/1494] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:48.277270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d63a61cd-8e37-4882-84f1-64203d89e427 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:48.277911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d63a61cd-8e37-4882-84f1-64203d89e427 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:48.280285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=56 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:48.285271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d63a61cd-8e37-4882-84f1-64203d89e427 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:48.285724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d63a61cd-8e37-4882-84f1-64203d89e427 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:48.286503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d63a61cd-8e37-4882-84f1-64203d89e427 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:48.286936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d63a61cd-8e37-4882-84f1-64203d89e427 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:48.363386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d63a61cd-8e37-4882-84f1-64203d89e427 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:48.371599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d63a61cd-8e37-4882-84f1-64203d89e427 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.099079 May 23 13:52:48.372186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 710/1495] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:48 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:48.949755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b74fa43-8e0b-4525-b627-b0046397edda tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:48.950678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b74fa43-8e0b-4525-b627-b0046397edda tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:48.957710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b74fa43-8e0b-4525-b627-b0046397edda tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:48.958223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b74fa43-8e0b-4525-b627-b0046397edda tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:48.958991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b74fa43-8e0b-4525-b627-b0046397edda tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:48.959426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b74fa43-8e0b-4525-b627-b0046397edda tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:48.989792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b74fa43-8e0b-4525-b627-b0046397edda tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 May 23 13:52:48.990467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 786/1496] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:49.388730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f245425d-f5aa-41c5-9405-6ad866e4c3b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:49.389333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f245425d-f5aa-41c5-9405-6ad866e4c3b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:49.395760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f245425d-f5aa-41c5-9405-6ad866e4c3b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:49.396211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f245425d-f5aa-41c5-9405-6ad866e4c3b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:49.396988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f245425d-f5aa-41c5-9405-6ad866e4c3b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:49.397425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f245425d-f5aa-41c5-9405-6ad866e4c3b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:49.462167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f245425d-f5aa-41c5-9405-6ad866e4c3b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:49.469785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f245425d-f5aa-41c5-9405-6ad866e4c3b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084933 May 23 13:52:49.470348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 711/1497] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:49 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:50.002626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b01db0d2-497b-4391-98cb-105de90ceaf3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:50.003459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b01db0d2-497b-4391-98cb-105de90ceaf3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:50.010745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b01db0d2-497b-4391-98cb-105de90ceaf3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:50.011197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b01db0d2-497b-4391-98cb-105de90ceaf3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:50.011955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b01db0d2-497b-4391-98cb-105de90ceaf3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:50.012391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b01db0d2-497b-4391-98cb-105de90ceaf3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:50.041909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b01db0d2-497b-4391-98cb-105de90ceaf3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 May 23 13:52:50.042471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 787/1498] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:52:50.486914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e03868af-1957-456e-af3d-992b9efbbe3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:50.487550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e03868af-1957-456e-af3d-992b9efbbe3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:50.494565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e03868af-1957-456e-af3d-992b9efbbe3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:50.495010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e03868af-1957-456e-af3d-992b9efbbe3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:50.495763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e03868af-1957-456e-af3d-992b9efbbe3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:50.496197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e03868af-1957-456e-af3d-992b9efbbe3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:50.559553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e03868af-1957-456e-af3d-992b9efbbe3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:50.567000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e03868af-1957-456e-af3d-992b9efbbe3b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083966 May 23 13:52:50.567563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 712/1499] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:50 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:51.053052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fa603a4f-753f-4363-bd4a-f56352588cc3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:51.054571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fa603a4f-753f-4363-bd4a-f56352588cc3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:51.061277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa603a4f-753f-4363-bd4a-f56352588cc3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:51.061734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa603a4f-753f-4363-bd4a-f56352588cc3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:51.062514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa603a4f-753f-4363-bd4a-f56352588cc3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:51.062958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa603a4f-753f-4363-bd4a-f56352588cc3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:51.095471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fa603a4f-753f-4363-bd4a-f56352588cc3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046364 May 23 13:52:51.096037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 788/1500] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:51.592647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3da36c27-2fa8-40d1-89e4-7b24c34fec37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:51.593328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3da36c27-2fa8-40d1-89e4-7b24c34fec37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:51.599840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3da36c27-2fa8-40d1-89e4-7b24c34fec37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:51.600290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3da36c27-2fa8-40d1-89e4-7b24c34fec37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:51.601248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3da36c27-2fa8-40d1-89e4-7b24c34fec37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:51.601813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3da36c27-2fa8-40d1-89e4-7b24c34fec37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:51.668447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3da36c27-2fa8-40d1-89e4-7b24c34fec37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:51.676511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3da36c27-2fa8-40d1-89e4-7b24c34fec37 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087928 May 23 13:52:51.677132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 713/1501] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:51 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:52.107894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-346ca110-0462-404a-a3ca-dad4fc4a7f0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:52.109173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-346ca110-0462-404a-a3ca-dad4fc4a7f0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:52.117030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-346ca110-0462-404a-a3ca-dad4fc4a7f0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:52.117548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-346ca110-0462-404a-a3ca-dad4fc4a7f0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:52.119181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-346ca110-0462-404a-a3ca-dad4fc4a7f0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:52.119647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-346ca110-0462-404a-a3ca-dad4fc4a7f0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:52.162162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-346ca110-0462-404a-a3ca-dad4fc4a7f0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058389 May 23 13:52:52.162776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 789/1502] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:52.693639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-904e35c4-0408-4fba-a864-c57b748abd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:52.694408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-904e35c4-0408-4fba-a864-c57b748abd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:52.701658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-904e35c4-0408-4fba-a864-c57b748abd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:52.702114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-904e35c4-0408-4fba-a864-c57b748abd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:52.702883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-904e35c4-0408-4fba-a864-c57b748abd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:52.703322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-904e35c4-0408-4fba-a864-c57b748abd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:52.764920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-904e35c4-0408-4fba-a864-c57b748abd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:52.773005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-904e35c4-0408-4fba-a864-c57b748abd49 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082679 May 23 13:52:52.773831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 714/1503] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:52 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:52:53.175270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87feed2b-eafa-4586-9768-b66faedbed13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:53.176198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87feed2b-eafa-4586-9768-b66faedbed13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:53.183068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87feed2b-eafa-4586-9768-b66faedbed13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:53.183528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87feed2b-eafa-4586-9768-b66faedbed13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:53.184313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87feed2b-eafa-4586-9768-b66faedbed13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:53.184797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87feed2b-eafa-4586-9768-b66faedbed13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:53.215896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87feed2b-eafa-4586-9768-b66faedbed13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 May 23 13:52:53.216453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 790/1504] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:53.791227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f185df22-4474-4471-be8b-e66d6b0f8ae7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:53.791848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f185df22-4474-4471-be8b-e66d6b0f8ae7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:53.798824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f185df22-4474-4471-be8b-e66d6b0f8ae7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:53.799276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f185df22-4474-4471-be8b-e66d6b0f8ae7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:53.800040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f185df22-4474-4471-be8b-e66d6b0f8ae7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:53.800554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f185df22-4474-4471-be8b-e66d6b0f8ae7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:53.864447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f185df22-4474-4471-be8b-e66d6b0f8ae7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:53.876258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f185df22-4474-4471-be8b-e66d6b0f8ae7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.089948 May 23 13:52:53.876881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 715/1505] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:53 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:54.228412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed325a4f-e94f-4c5e-8815-8db68946be9e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:54.229408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed325a4f-e94f-4c5e-8815-8db68946be9e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:54.236280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed325a4f-e94f-4c5e-8815-8db68946be9e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:54.236772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed325a4f-e94f-4c5e-8815-8db68946be9e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:54.237549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed325a4f-e94f-4c5e-8815-8db68946be9e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:54.237985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed325a4f-e94f-4c5e-8815-8db68946be9e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:54.269396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed325a4f-e94f-4c5e-8815-8db68946be9e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045363 May 23 13:52:54.270776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 791/1506] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:54.894529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-077f18d6-f718-4c38-88db-86c52cdce250 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:54.895142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-077f18d6-f718-4c38-88db-86c52cdce250 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:54.902631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-077f18d6-f718-4c38-88db-86c52cdce250 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:54.903142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-077f18d6-f718-4c38-88db-86c52cdce250 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:54.903900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-077f18d6-f718-4c38-88db-86c52cdce250 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:54.904339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-077f18d6-f718-4c38-88db-86c52cdce250 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:54.972833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-077f18d6-f718-4c38-88db-86c52cdce250 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:54.982598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-077f18d6-f718-4c38-88db-86c52cdce250 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091950 May 23 13:52:54.989843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 716/1507] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:54 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:55.282859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb51a1b5-2635-4f43-bf53-ed88bda74842 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:55.283722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb51a1b5-2635-4f43-bf53-ed88bda74842 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:55.291802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb51a1b5-2635-4f43-bf53-ed88bda74842 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:55.292257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb51a1b5-2635-4f43-bf53-ed88bda74842 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:55.293081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb51a1b5-2635-4f43-bf53-ed88bda74842 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:55.293528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb51a1b5-2635-4f43-bf53-ed88bda74842 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:55.326141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb51a1b5-2635-4f43-bf53-ed88bda74842 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047282 May 23 13:52:55.326744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 792/1508] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:56.000342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-01e5dba0-c0b1-45fe-8225-a8071c205759 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:56.000931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-01e5dba0-c0b1-45fe-8225-a8071c205759 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:56.008364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01e5dba0-c0b1-45fe-8225-a8071c205759 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:56.008849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01e5dba0-c0b1-45fe-8225-a8071c205759 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:56.009634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01e5dba0-c0b1-45fe-8225-a8071c205759 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:56.010071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01e5dba0-c0b1-45fe-8225-a8071c205759 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:56.078614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-01e5dba0-c0b1-45fe-8225-a8071c205759 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:56.087708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-01e5dba0-c0b1-45fe-8225-a8071c205759 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091456 May 23 13:52:56.088303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 717/1509] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:55 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:56.338386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c341d385-2464-492a-889f-d37e682c7b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:56.339229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c341d385-2464-492a-889f-d37e682c7b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:56.346056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c341d385-2464-492a-889f-d37e682c7b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:56.346550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c341d385-2464-492a-889f-d37e682c7b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:56.347334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c341d385-2464-492a-889f-d37e682c7b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:56.347770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c341d385-2464-492a-889f-d37e682c7b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:56.380284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c341d385-2464-492a-889f-d37e682c7b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 May 23 13:52:56.380885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 793/1510] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:57.105422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8dc8f98b-a4da-4742-a65d-a07b672aec45 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:57.106186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8dc8f98b-a4da-4742-a65d-a07b672aec45 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:57.112875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8dc8f98b-a4da-4742-a65d-a07b672aec45 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:57.113332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8dc8f98b-a4da-4742-a65d-a07b672aec45 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:57.114119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8dc8f98b-a4da-4742-a65d-a07b672aec45 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:57.114593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8dc8f98b-a4da-4742-a65d-a07b672aec45 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:57.187767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8dc8f98b-a4da-4742-a65d-a07b672aec45 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:57.195661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8dc8f98b-a4da-4742-a65d-a07b672aec45 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.094253 May 23 13:52:57.196234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 718/1511] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:57 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:57.393131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-edf1d4ec-153a-4cd4-9d6c-3251f07e353b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:57.393961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-edf1d4ec-153a-4cd4-9d6c-3251f07e353b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:57.401292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edf1d4ec-153a-4cd4-9d6c-3251f07e353b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:57.401743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edf1d4ec-153a-4cd4-9d6c-3251f07e353b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:57.402508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edf1d4ec-153a-4cd4-9d6c-3251f07e353b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:57.402943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edf1d4ec-153a-4cd4-9d6c-3251f07e353b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:57.433857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-edf1d4ec-153a-4cd4-9d6c-3251f07e353b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 May 23 13:52:57.434429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 794/1512] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:58.212290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c86187d-7863-47bf-8b41-a726c89b4700 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:58.212909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c86187d-7863-47bf-8b41-a726c89b4700 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:58.221800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c86187d-7863-47bf-8b41-a726c89b4700 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:58.222620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c86187d-7863-47bf-8b41-a726c89b4700 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:58.224089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c86187d-7863-47bf-8b41-a726c89b4700 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:58.224929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c86187d-7863-47bf-8b41-a726c89b4700 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:58.247470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:58.294132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c86187d-7863-47bf-8b41-a726c89b4700 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:58.303964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c86187d-7863-47bf-8b41-a726c89b4700 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.095700 May 23 13:52:58.304553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 719/1513] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:58 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:58.445963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87265932-931a-4f0c-a75b-29b1eef4a744 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:58.446804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87265932-931a-4f0c-a75b-29b1eef4a744 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:58.453452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87265932-931a-4f0c-a75b-29b1eef4a744 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:58.453904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87265932-931a-4f0c-a75b-29b1eef4a744 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:58.454686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87265932-931a-4f0c-a75b-29b1eef4a744 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:58.455120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87265932-931a-4f0c-a75b-29b1eef4a744 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:58.484242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:52:58.488814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87265932-931a-4f0c-a75b-29b1eef4a744 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046989 May 23 13:52:58.489389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 795/1514] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:58 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:52:59.322232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1bc3a412-c98d-446b-905e-e879bcd5f4cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:59.322864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1bc3a412-c98d-446b-905e-e879bcd5f4cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:59.329590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bc3a412-c98d-446b-905e-e879bcd5f4cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:59.330043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bc3a412-c98d-446b-905e-e879bcd5f4cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:59.330823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bc3a412-c98d-446b-905e-e879bcd5f4cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:59.331258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bc3a412-c98d-446b-905e-e879bcd5f4cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:59.400052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1bc3a412-c98d-446b-905e-e879bcd5f4cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:52:59.408265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1bc3a412-c98d-446b-905e-e879bcd5f4cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090594 May 23 13:52:59.408891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 720/1515] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:52:59 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:52:59.501953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b898e351-5596-48fb-a108-0916f4f5b27d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:52:59.502793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b898e351-5596-48fb-a108-0916f4f5b27d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:52:59.510147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b898e351-5596-48fb-a108-0916f4f5b27d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:59.510597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b898e351-5596-48fb-a108-0916f4f5b27d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:59.511388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b898e351-5596-48fb-a108-0916f4f5b27d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:52:59.511828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b898e351-5596-48fb-a108-0916f4f5b27d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:52:59.545082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b898e351-5596-48fb-a108-0916f4f5b27d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 May 23 13:52:59.545867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 796/1516] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:52:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:00.424595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c3065c42-0fc2-48ed-9ccf-d09178e9d3cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:00.425213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c3065c42-0fc2-48ed-9ccf-d09178e9d3cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:00.431913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3065c42-0fc2-48ed-9ccf-d09178e9d3cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:00.432446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3065c42-0fc2-48ed-9ccf-d09178e9d3cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:00.433162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3065c42-0fc2-48ed-9ccf-d09178e9d3cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:00.433597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3065c42-0fc2-48ed-9ccf-d09178e9d3cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:00.503695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c3065c42-0fc2-48ed-9ccf-d09178e9d3cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:00.511993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c3065c42-0fc2-48ed-9ccf-d09178e9d3cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091173 May 23 13:53:00.512892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 721/1517] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:00 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:00.557609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc49450c-91ec-4c25-a805-6b4c53442b65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:00.565454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc49450c-91ec-4c25-a805-6b4c53442b65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:00.565454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc49450c-91ec-4c25-a805-6b4c53442b65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:00.565930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc49450c-91ec-4c25-a805-6b4c53442b65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:00.566776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc49450c-91ec-4c25-a805-6b4c53442b65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:00.567253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc49450c-91ec-4c25-a805-6b4c53442b65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:00.601332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc49450c-91ec-4c25-a805-6b4c53442b65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046875 May 23 13:53:00.602335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 797/1518] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:01.528976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5799bf4b-bc10-4302-b3d8-f3379f85c2e0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:01.529545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5799bf4b-bc10-4302-b3d8-f3379f85c2e0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:01.536181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5799bf4b-bc10-4302-b3d8-f3379f85c2e0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:01.536662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5799bf4b-bc10-4302-b3d8-f3379f85c2e0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:01.540763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5799bf4b-bc10-4302-b3d8-f3379f85c2e0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:01.541269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5799bf4b-bc10-4302-b3d8-f3379f85c2e0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:01.606404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5799bf4b-bc10-4302-b3d8-f3379f85c2e0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:01.613197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5f74db55-4e5f-4403-89ee-9af30934923c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:01.614241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5f74db55-4e5f-4403-89ee-9af30934923c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:01.616066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5799bf4b-bc10-4302-b3d8-f3379f85c2e0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090475 May 23 13:53:01.616886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 722/1519] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:01 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:01.621667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f74db55-4e5f-4403-89ee-9af30934923c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:01.622152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f74db55-4e5f-4403-89ee-9af30934923c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:01.622908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f74db55-4e5f-4403-89ee-9af30934923c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:01.623811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f74db55-4e5f-4403-89ee-9af30934923c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:01.655854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5f74db55-4e5f-4403-89ee-9af30934923c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046770 May 23 13:53:01.656428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 798/1520] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:53:02.633785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59a1e0e1-19ed-4144-b652-4539928857ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:02.634387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59a1e0e1-19ed-4144-b652-4539928857ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:02.641086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59a1e0e1-19ed-4144-b652-4539928857ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:02.641543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59a1e0e1-19ed-4144-b652-4539928857ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:02.642311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59a1e0e1-19ed-4144-b652-4539928857ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:02.642747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59a1e0e1-19ed-4144-b652-4539928857ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:02.668046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-104a702b-6a34-42a2-bd09-9018db0b0598 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:02.669012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-104a702b-6a34-42a2-bd09-9018db0b0598 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:02.675844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-104a702b-6a34-42a2-bd09-9018db0b0598 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:02.676300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-104a702b-6a34-42a2-bd09-9018db0b0598 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:02.677141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-104a702b-6a34-42a2-bd09-9018db0b0598 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:02.677565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-104a702b-6a34-42a2-bd09-9018db0b0598 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:02.708801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59a1e0e1-19ed-4144-b652-4539928857ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:02.709717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-104a702b-6a34-42a2-bd09-9018db0b0598 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 May 23 13:53:02.710282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 799/1521] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:02.717299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59a1e0e1-19ed-4144-b652-4539928857ae tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088074 May 23 13:53:02.717879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 723/1522] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:02 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:03.721331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-29647f5b-2905-425f-b555-6a9058f54ceb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:03.722301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-29647f5b-2905-425f-b555-6a9058f54ceb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:03.729870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29647f5b-2905-425f-b555-6a9058f54ceb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:03.730322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29647f5b-2905-425f-b555-6a9058f54ceb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:03.731127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29647f5b-2905-425f-b555-6a9058f54ceb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:03.731569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29647f5b-2905-425f-b555-6a9058f54ceb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:03.740018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f39079a4-1276-4175-873d-2e7fa6a2f8a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:03.741230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f39079a4-1276-4175-873d-2e7fa6a2f8a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:03.751678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f39079a4-1276-4175-873d-2e7fa6a2f8a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:03.752450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f39079a4-1276-4175-873d-2e7fa6a2f8a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:03.753866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f39079a4-1276-4175-873d-2e7fa6a2f8a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:03.754659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f39079a4-1276-4175-873d-2e7fa6a2f8a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:03.762614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-29647f5b-2905-425f-b555-6a9058f54ceb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045176 May 23 13:53:03.763186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 800/1523] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:03.824154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f39079a4-1276-4175-873d-2e7fa6a2f8a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:03.838304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f39079a4-1276-4175-873d-2e7fa6a2f8a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.105358 May 23 13:53:03.839446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 724/1524] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:03 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:04.778198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3526cf1b-a8e0-423b-9f44-bb43b28cc2fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:04.779156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3526cf1b-a8e0-423b-9f44-bb43b28cc2fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:04.786491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3526cf1b-a8e0-423b-9f44-bb43b28cc2fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:04.787009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3526cf1b-a8e0-423b-9f44-bb43b28cc2fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:04.788192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3526cf1b-a8e0-423b-9f44-bb43b28cc2fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:04.788788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3526cf1b-a8e0-423b-9f44-bb43b28cc2fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:04.821467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3526cf1b-a8e0-423b-9f44-bb43b28cc2fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047219 May 23 13:53:04.822051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 801/1525] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:04.856214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2262c705-c73a-4178-a78d-238e35602b8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:04.856855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2262c705-c73a-4178-a78d-238e35602b8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:04.863745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2262c705-c73a-4178-a78d-238e35602b8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:04.864479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2262c705-c73a-4178-a78d-238e35602b8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:04.865317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2262c705-c73a-4178-a78d-238e35602b8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:04.865829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2262c705-c73a-4178-a78d-238e35602b8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:04.941705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2262c705-c73a-4178-a78d-238e35602b8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:04.957564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2262c705-c73a-4178-a78d-238e35602b8b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.104549 May 23 13:53:04.958389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 725/1526] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:04 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:05.835570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65354af8-8e95-4a72-9b0d-c5eeef3c4560 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:05.836517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-65354af8-8e95-4a72-9b0d-c5eeef3c4560 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:05.843655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65354af8-8e95-4a72-9b0d-c5eeef3c4560 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:05.844112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65354af8-8e95-4a72-9b0d-c5eeef3c4560 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:05.844932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65354af8-8e95-4a72-9b0d-c5eeef3c4560 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:05.845377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65354af8-8e95-4a72-9b0d-c5eeef3c4560 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:05.878179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65354af8-8e95-4a72-9b0d-c5eeef3c4560 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047301 May 23 13:53:05.878781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 802/1527] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:05.977300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f5909bb-be9f-4566-8f5e-eabe6c2d5a15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:05.977867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f5909bb-be9f-4566-8f5e-eabe6c2d5a15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:05.984755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f5909bb-be9f-4566-8f5e-eabe6c2d5a15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:05.985210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f5909bb-be9f-4566-8f5e-eabe6c2d5a15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:05.985999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f5909bb-be9f-4566-8f5e-eabe6c2d5a15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:05.986434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f5909bb-be9f-4566-8f5e-eabe6c2d5a15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:06.053211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f5909bb-be9f-4566-8f5e-eabe6c2d5a15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:06.061302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f5909bb-be9f-4566-8f5e-eabe6c2d5a15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088729 May 23 13:53:06.061898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 726/1528] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:05 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:06.890943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cedfd067-59c8-4007-b2d3-1a120222c0d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:06.891894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cedfd067-59c8-4007-b2d3-1a120222c0d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:06.900638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cedfd067-59c8-4007-b2d3-1a120222c0d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:06.901085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cedfd067-59c8-4007-b2d3-1a120222c0d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:06.901886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cedfd067-59c8-4007-b2d3-1a120222c0d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:06.902335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cedfd067-59c8-4007-b2d3-1a120222c0d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:06.936249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cedfd067-59c8-4007-b2d3-1a120222c0d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049480 May 23 13:53:06.936888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 803/1529] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:07.079649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f8524bf-1529-4f73-8c25-44e1a6532fc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:07.080277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f8524bf-1529-4f73-8c25-44e1a6532fc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:07.087813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f8524bf-1529-4f73-8c25-44e1a6532fc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:07.088279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f8524bf-1529-4f73-8c25-44e1a6532fc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:07.089122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f8524bf-1529-4f73-8c25-44e1a6532fc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:07.089560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f8524bf-1529-4f73-8c25-44e1a6532fc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:07.170670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f8524bf-1529-4f73-8c25-44e1a6532fc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:07.179771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f8524bf-1529-4f73-8c25-44e1a6532fc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.103931 May 23 13:53:07.180602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 727/1530] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:07 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:07.948297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-124c5a3c-74f6-4caf-a854-a1e267e13075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:07.949252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-124c5a3c-74f6-4caf-a854-a1e267e13075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:07.956030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-124c5a3c-74f6-4caf-a854-a1e267e13075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:07.956477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-124c5a3c-74f6-4caf-a854-a1e267e13075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:07.957530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-124c5a3c-74f6-4caf-a854-a1e267e13075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:07.957968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-124c5a3c-74f6-4caf-a854-a1e267e13075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:07.991313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-124c5a3c-74f6-4caf-a854-a1e267e13075 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046901 May 23 13:53:07.991815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 804/1531] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:08.198007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f45c4898-8c72-4a78-ac41-bf7d9b7cbc15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:08.198639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f45c4898-8c72-4a78-ac41-bf7d9b7cbc15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:08.205338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f45c4898-8c72-4a78-ac41-bf7d9b7cbc15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:08.205792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f45c4898-8c72-4a78-ac41-bf7d9b7cbc15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:08.207053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f45c4898-8c72-4a78-ac41-bf7d9b7cbc15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:08.207489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f45c4898-8c72-4a78-ac41-bf7d9b7cbc15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:08.275584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f45c4898-8c72-4a78-ac41-bf7d9b7cbc15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:08.284379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f45c4898-8c72-4a78-ac41-bf7d9b7cbc15 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091710 May 23 13:53:08.300363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 728/1532] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:08 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:09.002565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff320b12-a213-41fa-a1e1-1ad17f2d2da3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:09.003417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff320b12-a213-41fa-a1e1-1ad17f2d2da3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:09.010165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff320b12-a213-41fa-a1e1-1ad17f2d2da3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:09.010623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff320b12-a213-41fa-a1e1-1ad17f2d2da3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:09.011402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff320b12-a213-41fa-a1e1-1ad17f2d2da3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:09.011875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff320b12-a213-41fa-a1e1-1ad17f2d2da3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:09.043580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff320b12-a213-41fa-a1e1-1ad17f2d2da3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 May 23 13:53:09.044169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 805/1533] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:09.315172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-43326b3f-74d3-4de2-a092-c230e636c880 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:09.315798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-43326b3f-74d3-4de2-a092-c230e636c880 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:09.323009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43326b3f-74d3-4de2-a092-c230e636c880 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:09.323462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43326b3f-74d3-4de2-a092-c230e636c880 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:09.324257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43326b3f-74d3-4de2-a092-c230e636c880 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:09.324733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43326b3f-74d3-4de2-a092-c230e636c880 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:09.395595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43326b3f-74d3-4de2-a092-c230e636c880 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:09.404526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-43326b3f-74d3-4de2-a092-c230e636c880 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093204 May 23 13:53:09.405174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 729/1534] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:09 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:53:10.056349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-71e0818c-08e8-4f9a-b4af-a05615f1f331 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:10.057217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-71e0818c-08e8-4f9a-b4af-a05615f1f331 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:10.063900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71e0818c-08e8-4f9a-b4af-a05615f1f331 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:10.064359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71e0818c-08e8-4f9a-b4af-a05615f1f331 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:10.065174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71e0818c-08e8-4f9a-b4af-a05615f1f331 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:10.065623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71e0818c-08e8-4f9a-b4af-a05615f1f331 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:10.099827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-71e0818c-08e8-4f9a-b4af-a05615f1f331 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048734 May 23 13:53:10.100545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 806/1535] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:10.422433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9db3da3a-7805-4371-be93-09ce4918a0e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:10.423047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9db3da3a-7805-4371-be93-09ce4918a0e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:10.429809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9db3da3a-7805-4371-be93-09ce4918a0e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:10.430259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9db3da3a-7805-4371-be93-09ce4918a0e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:10.431028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9db3da3a-7805-4371-be93-09ce4918a0e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:10.431459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9db3da3a-7805-4371-be93-09ce4918a0e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:10.499199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9db3da3a-7805-4371-be93-09ce4918a0e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:10.508420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9db3da3a-7805-4371-be93-09ce4918a0e3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090020 May 23 13:53:10.509040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 730/1536] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:10 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:11.111549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d18d7cdb-9f33-46c1-8e2b-2cc0e4f59a65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:11.112493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d18d7cdb-9f33-46c1-8e2b-2cc0e4f59a65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:11.120092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18d7cdb-9f33-46c1-8e2b-2cc0e4f59a65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:11.120548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18d7cdb-9f33-46c1-8e2b-2cc0e4f59a65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:11.121352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18d7cdb-9f33-46c1-8e2b-2cc0e4f59a65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:11.121796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18d7cdb-9f33-46c1-8e2b-2cc0e4f59a65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:11.153018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d18d7cdb-9f33-46c1-8e2b-2cc0e4f59a65 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045361 May 23 13:53:11.153582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 807/1537] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:11.526022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7a22f56-c679-4d86-8eff-19384b850dbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:11.526642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7a22f56-c679-4d86-8eff-19384b850dbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:11.533587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7a22f56-c679-4d86-8eff-19384b850dbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:11.534030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7a22f56-c679-4d86-8eff-19384b850dbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:11.534857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7a22f56-c679-4d86-8eff-19384b850dbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:11.535286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7a22f56-c679-4d86-8eff-19384b850dbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:11.605764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7a22f56-c679-4d86-8eff-19384b850dbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:11.614070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7a22f56-c679-4d86-8eff-19384b850dbf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092508 May 23 13:53:11.614649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 731/1538] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:11 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:12.165740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-44652f6d-0fc4-480e-9fbd-d2a976817ac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:12.166688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-44652f6d-0fc4-480e-9fbd-d2a976817ac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:12.173299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44652f6d-0fc4-480e-9fbd-d2a976817ac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:12.173758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44652f6d-0fc4-480e-9fbd-d2a976817ac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:12.174537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44652f6d-0fc4-480e-9fbd-d2a976817ac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:12.174976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44652f6d-0fc4-480e-9fbd-d2a976817ac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:12.206841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-44652f6d-0fc4-480e-9fbd-d2a976817ac0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045567 May 23 13:53:12.207401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 808/1539] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:12.631679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9f5c7b58-3984-4022-9547-a7b7aebad4b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:12.632505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9f5c7b58-3984-4022-9547-a7b7aebad4b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:12.639512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f5c7b58-3984-4022-9547-a7b7aebad4b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:12.639961 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f5c7b58-3984-4022-9547-a7b7aebad4b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:12.640779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f5c7b58-3984-4022-9547-a7b7aebad4b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:12.641221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f5c7b58-3984-4022-9547-a7b7aebad4b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:12.704692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f5c7b58-3984-4022-9547-a7b7aebad4b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:12.713328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9f5c7b58-3984-4022-9547-a7b7aebad4b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085711 May 23 13:53:12.713900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 732/1540] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:12 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:13.218717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48f6fd8c-7f59-4c7e-96c4-2fe005a9ee27 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:13.219631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-48f6fd8c-7f59-4c7e-96c4-2fe005a9ee27 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:13.226940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48f6fd8c-7f59-4c7e-96c4-2fe005a9ee27 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:13.227431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48f6fd8c-7f59-4c7e-96c4-2fe005a9ee27 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:13.228221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48f6fd8c-7f59-4c7e-96c4-2fe005a9ee27 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:13.228685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48f6fd8c-7f59-4c7e-96c4-2fe005a9ee27 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:13.259551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48f6fd8c-7f59-4c7e-96c4-2fe005a9ee27 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 May 23 13:53:13.260131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 809/1541] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:13.731497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5bfe5811-b24b-40bf-9ada-f05f1a3dfb39 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:13.732176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5bfe5811-b24b-40bf-9ada-f05f1a3dfb39 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:13.740684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bfe5811-b24b-40bf-9ada-f05f1a3dfb39 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:13.741860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bfe5811-b24b-40bf-9ada-f05f1a3dfb39 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:13.742651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bfe5811-b24b-40bf-9ada-f05f1a3dfb39 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:13.743099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bfe5811-b24b-40bf-9ada-f05f1a3dfb39 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:13.810780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5bfe5811-b24b-40bf-9ada-f05f1a3dfb39 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:13.824318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5bfe5811-b24b-40bf-9ada-f05f1a3dfb39 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.096793 May 23 13:53:13.824935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 733/1542] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:13 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:14.271524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5bad4174-4239-4ec6-ae79-a9f4a0073d68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:14.272452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5bad4174-4239-4ec6-ae79-a9f4a0073d68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:14.279056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bad4174-4239-4ec6-ae79-a9f4a0073d68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:14.279512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bad4174-4239-4ec6-ae79-a9f4a0073d68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:14.280352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bad4174-4239-4ec6-ae79-a9f4a0073d68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:14.280764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bad4174-4239-4ec6-ae79-a9f4a0073d68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:14.313065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5bad4174-4239-4ec6-ae79-a9f4a0073d68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 May 23 13:53:14.313644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 810/1543] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:14.841635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0b77b3db-e089-456a-af1c-64b5da470226 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:14.842395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0b77b3db-e089-456a-af1c-64b5da470226 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:14.849173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b77b3db-e089-456a-af1c-64b5da470226 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:14.849717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b77b3db-e089-456a-af1c-64b5da470226 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:14.850447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b77b3db-e089-456a-af1c-64b5da470226 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:14.850873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b77b3db-e089-456a-af1c-64b5da470226 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:14.925655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0b77b3db-e089-456a-af1c-64b5da470226 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:14.934545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0b77b3db-e089-456a-af1c-64b5da470226 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.096912 May 23 13:53:14.935140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 734/1544] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:14 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:53:15.325441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc8bb668-28b0-4c36-b1b9-4aba379c090a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:15.326449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc8bb668-28b0-4c36-b1b9-4aba379c090a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:15.333459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc8bb668-28b0-4c36-b1b9-4aba379c090a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:15.346984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc8bb668-28b0-4c36-b1b9-4aba379c090a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:15.346984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc8bb668-28b0-4c36-b1b9-4aba379c090a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:15.346984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc8bb668-28b0-4c36-b1b9-4aba379c090a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:15.368948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc8bb668-28b0-4c36-b1b9-4aba379c090a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047745 May 23 13:53:15.376622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 811/1545] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:15.952086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e1c0a49-2000-46a8-8d53-35dc7b076e9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:15.952724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e1c0a49-2000-46a8-8d53-35dc7b076e9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:15.959897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e1c0a49-2000-46a8-8d53-35dc7b076e9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:15.960341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e1c0a49-2000-46a8-8d53-35dc7b076e9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:15.961148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e1c0a49-2000-46a8-8d53-35dc7b076e9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:15.961583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e1c0a49-2000-46a8-8d53-35dc7b076e9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:16.026389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6e1c0a49-2000-46a8-8d53-35dc7b076e9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:16.034721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e1c0a49-2000-46a8-8d53-35dc7b076e9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086288 May 23 13:53:16.035314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 735/1546] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:15 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:16.380632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d49199b-fae2-48a9-a6cb-cf5c7f987187 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:16.381611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d49199b-fae2-48a9-a6cb-cf5c7f987187 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:16.384097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=58 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:16.390207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d49199b-fae2-48a9-a6cb-cf5c7f987187 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:16.390661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d49199b-fae2-48a9-a6cb-cf5c7f987187 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:16.391461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d49199b-fae2-48a9-a6cb-cf5c7f987187 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:16.391951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d49199b-fae2-48a9-a6cb-cf5c7f987187 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:16.410319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:16.425531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d49199b-fae2-48a9-a6cb-cf5c7f987187 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049428 May 23 13:53:16.426135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 812/1547] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:16 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:17.053514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8511bf01-8c26-45b9-9440-e7be258b2c30 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:17.054171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8511bf01-8c26-45b9-9440-e7be258b2c30 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:17.060939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8511bf01-8c26-45b9-9440-e7be258b2c30 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:17.061401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8511bf01-8c26-45b9-9440-e7be258b2c30 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:17.062216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8511bf01-8c26-45b9-9440-e7be258b2c30 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:17.062653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8511bf01-8c26-45b9-9440-e7be258b2c30 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:17.067000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:17.127564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8511bf01-8c26-45b9-9440-e7be258b2c30 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:17.135860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8511bf01-8c26-45b9-9440-e7be258b2c30 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086810 May 23 13:53:17.136444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 736/1548] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:17 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:17.438415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-19038031-ffbf-4f1a-b4f2-64db9ae5c004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:17.439364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-19038031-ffbf-4f1a-b4f2-64db9ae5c004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:17.446148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19038031-ffbf-4f1a-b4f2-64db9ae5c004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:17.446603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19038031-ffbf-4f1a-b4f2-64db9ae5c004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:17.447477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19038031-ffbf-4f1a-b4f2-64db9ae5c004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:17.447912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19038031-ffbf-4f1a-b4f2-64db9ae5c004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:17.478771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-19038031-ffbf-4f1a-b4f2-64db9ae5c004 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 May 23 13:53:17.479337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 813/1549] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:18.153375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5dbf9a8e-acc6-4afd-85bf-6d8ab709e20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:18.153994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5dbf9a8e-acc6-4afd-85bf-6d8ab709e20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:18.160753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5dbf9a8e-acc6-4afd-85bf-6d8ab709e20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:18.161213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5dbf9a8e-acc6-4afd-85bf-6d8ab709e20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:18.163093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5dbf9a8e-acc6-4afd-85bf-6d8ab709e20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:18.163548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5dbf9a8e-acc6-4afd-85bf-6d8ab709e20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:18.229579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5dbf9a8e-acc6-4afd-85bf-6d8ab709e20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:18.237097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5dbf9a8e-acc6-4afd-85bf-6d8ab709e20a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087596 May 23 13:53:18.237648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 737/1550] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:18 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:18.490793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14ffba3f-7376-4675-b74f-5c1cfff2c8fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:18.491628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-14ffba3f-7376-4675-b74f-5c1cfff2c8fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:18.498380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14ffba3f-7376-4675-b74f-5c1cfff2c8fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:18.498840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14ffba3f-7376-4675-b74f-5c1cfff2c8fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:18.499644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14ffba3f-7376-4675-b74f-5c1cfff2c8fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:18.500091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14ffba3f-7376-4675-b74f-5c1cfff2c8fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:18.531039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-14ffba3f-7376-4675-b74f-5c1cfff2c8fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044347 May 23 13:53:18.531604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 814/1551] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:19.253764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-39ddce0e-7a92-401a-851f-9c9ae984eb5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:19.254377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-39ddce0e-7a92-401a-851f-9c9ae984eb5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:19.257743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=56 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:19.262500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39ddce0e-7a92-401a-851f-9c9ae984eb5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:19.262954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39ddce0e-7a92-401a-851f-9c9ae984eb5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:19.263720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39ddce0e-7a92-401a-851f-9c9ae984eb5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:19.264158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39ddce0e-7a92-401a-851f-9c9ae984eb5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:19.329771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-39ddce0e-7a92-401a-851f-9c9ae984eb5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:19.338878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-39ddce0e-7a92-401a-851f-9c9ae984eb5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088915 May 23 13:53:19.339450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 738/1552] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:19 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:19.541957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0824dfde-5d73-45c9-a79b-3a3068477fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:19.542787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0824dfde-5d73-45c9-a79b-3a3068477fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:19.549357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0824dfde-5d73-45c9-a79b-3a3068477fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:19.549810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0824dfde-5d73-45c9-a79b-3a3068477fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:19.550583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0824dfde-5d73-45c9-a79b-3a3068477fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:19.551025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0824dfde-5d73-45c9-a79b-3a3068477fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:19.581723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0824dfde-5d73-45c9-a79b-3a3068477fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 May 23 13:53:19.582290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 815/1553] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:20.355951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-135983e8-a428-405a-bfb6-75507c35dec6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:20.356930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-135983e8-a428-405a-bfb6-75507c35dec6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:20.369013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-135983e8-a428-405a-bfb6-75507c35dec6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:20.369810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-135983e8-a428-405a-bfb6-75507c35dec6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:20.370826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-135983e8-a428-405a-bfb6-75507c35dec6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:20.371466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-135983e8-a428-405a-bfb6-75507c35dec6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:20.437539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-135983e8-a428-405a-bfb6-75507c35dec6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:20.445067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-135983e8-a428-405a-bfb6-75507c35dec6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092942 May 23 13:53:20.445632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 739/1554] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:20 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:20.593928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e86b95ca-5b35-41d1-a704-bc35dd971402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:20.594847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e86b95ca-5b35-41d1-a704-bc35dd971402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:20.602390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e86b95ca-5b35-41d1-a704-bc35dd971402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:20.602836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e86b95ca-5b35-41d1-a704-bc35dd971402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:20.603607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e86b95ca-5b35-41d1-a704-bc35dd971402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:20.604042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e86b95ca-5b35-41d1-a704-bc35dd971402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:20.635744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e86b95ca-5b35-41d1-a704-bc35dd971402 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 May 23 13:53:20.636310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 816/1555] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:21.462399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-587200f1-3cc3-43a8-afb8-985806892a1f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:21.462959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-587200f1-3cc3-43a8-afb8-985806892a1f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:21.469398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-587200f1-3cc3-43a8-afb8-985806892a1f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:21.469849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-587200f1-3cc3-43a8-afb8-985806892a1f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:21.470606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-587200f1-3cc3-43a8-afb8-985806892a1f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:21.471064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-587200f1-3cc3-43a8-afb8-985806892a1f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:21.534146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-587200f1-3cc3-43a8-afb8-985806892a1f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:21.542431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-587200f1-3cc3-43a8-afb8-985806892a1f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083971 May 23 13:53:21.542985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 740/1556] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:21 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:21.647314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-34430ebe-f30d-47aa-b103-565edab5739b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:21.648245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-34430ebe-f30d-47aa-b103-565edab5739b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:21.654990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34430ebe-f30d-47aa-b103-565edab5739b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:21.655449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34430ebe-f30d-47aa-b103-565edab5739b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:21.656228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34430ebe-f30d-47aa-b103-565edab5739b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:21.656703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34430ebe-f30d-47aa-b103-565edab5739b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:21.687487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-34430ebe-f30d-47aa-b103-565edab5739b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044130 May 23 13:53:21.688065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 817/1557] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:22.559553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c70f8f27-452d-449a-a2d9-4e6d3ff3b4e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:22.560102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c70f8f27-452d-449a-a2d9-4e6d3ff3b4e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:22.566631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c70f8f27-452d-449a-a2d9-4e6d3ff3b4e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:22.567085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c70f8f27-452d-449a-a2d9-4e6d3ff3b4e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:22.567910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c70f8f27-452d-449a-a2d9-4e6d3ff3b4e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:22.568347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c70f8f27-452d-449a-a2d9-4e6d3ff3b4e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:22.632453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c70f8f27-452d-449a-a2d9-4e6d3ff3b4e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:22.640177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c70f8f27-452d-449a-a2d9-4e6d3ff3b4e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084572 May 23 13:53:22.640785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 741/1558] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:22 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:22.699699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92ff6586-0f0c-4c32-953b-d93e08c0cf0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:22.700665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92ff6586-0f0c-4c32-953b-d93e08c0cf0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:22.707553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92ff6586-0f0c-4c32-953b-d93e08c0cf0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:22.708007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92ff6586-0f0c-4c32-953b-d93e08c0cf0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:22.709462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92ff6586-0f0c-4c32-953b-d93e08c0cf0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:22.710155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92ff6586-0f0c-4c32-953b-d93e08c0cf0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:22.740466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92ff6586-0f0c-4c32-953b-d93e08c0cf0a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 May 23 13:53:22.741067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 818/1559] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:23.657802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-761d75c8-7ba2-4b0e-9d4d-0f966b5416bd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:23.658555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-761d75c8-7ba2-4b0e-9d4d-0f966b5416bd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:23.666436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-761d75c8-7ba2-4b0e-9d4d-0f966b5416bd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:23.671089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-761d75c8-7ba2-4b0e-9d4d-0f966b5416bd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:23.671089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-761d75c8-7ba2-4b0e-9d4d-0f966b5416bd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:23.671089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-761d75c8-7ba2-4b0e-9d4d-0f966b5416bd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:23.734248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-761d75c8-7ba2-4b0e-9d4d-0f966b5416bd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:23.742004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-761d75c8-7ba2-4b0e-9d4d-0f966b5416bd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088063 May 23 13:53:23.742609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 742/1560] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:23 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:23.752023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d334ee6a-80b1-49da-ade6-6d441fb580e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:23.753004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d334ee6a-80b1-49da-ade6-6d441fb580e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:23.760000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d334ee6a-80b1-49da-ade6-6d441fb580e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:23.760477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d334ee6a-80b1-49da-ade6-6d441fb580e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:23.761265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d334ee6a-80b1-49da-ade6-6d441fb580e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:23.761702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d334ee6a-80b1-49da-ade6-6d441fb580e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:23.792222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d334ee6a-80b1-49da-ade6-6d441fb580e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044526 May 23 13:53:23.792817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 819/1561] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:24.758698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a072d71f-9e9f-404b-9efb-becf12bb4ab3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:24.759363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a072d71f-9e9f-404b-9efb-becf12bb4ab3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:24.765904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a072d71f-9e9f-404b-9efb-becf12bb4ab3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:24.766258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a072d71f-9e9f-404b-9efb-becf12bb4ab3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:24.767014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a072d71f-9e9f-404b-9efb-becf12bb4ab3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:24.767439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a072d71f-9e9f-404b-9efb-becf12bb4ab3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:24.807324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-503752aa-e1f1-4186-ad0b-29447675b175 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:24.809556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-503752aa-e1f1-4186-ad0b-29447675b175 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:24.818461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-503752aa-e1f1-4186-ad0b-29447675b175 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:24.819095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-503752aa-e1f1-4186-ad0b-29447675b175 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:24.819986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-503752aa-e1f1-4186-ad0b-29447675b175 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:24.820462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-503752aa-e1f1-4186-ad0b-29447675b175 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:24.836099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a072d71f-9e9f-404b-9efb-becf12bb4ab3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:24.844271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a072d71f-9e9f-404b-9efb-becf12bb4ab3 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.089520 May 23 13:53:24.844886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 743/1562] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:24 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:24.853025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-503752aa-e1f1-4186-ad0b-29447675b175 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050967 May 23 13:53:24.855514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 820/1563] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:53:25.862313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19297631-0b65-4d19-9b5c-ab74b80cf7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:25.863053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19297631-0b65-4d19-9b5c-ab74b80cf7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:25.864975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4faa21b3-6e28-4ca9-ab0f-b08326b34692 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:25.866426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4faa21b3-6e28-4ca9-ab0f-b08326b34692 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:25.870241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19297631-0b65-4d19-9b5c-ab74b80cf7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:25.870747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19297631-0b65-4d19-9b5c-ab74b80cf7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:25.871461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19297631-0b65-4d19-9b5c-ab74b80cf7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:25.871894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19297631-0b65-4d19-9b5c-ab74b80cf7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:25.873127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4faa21b3-6e28-4ca9-ab0f-b08326b34692 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:25.873497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4faa21b3-6e28-4ca9-ab0f-b08326b34692 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:25.874267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4faa21b3-6e28-4ca9-ab0f-b08326b34692 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:25.874707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4faa21b3-6e28-4ca9-ab0f-b08326b34692 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:25.904750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4faa21b3-6e28-4ca9-ab0f-b08326b34692 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 May 23 13:53:25.905334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 821/1564] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:53:25.938264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19297631-0b65-4d19-9b5c-ab74b80cf7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:25.946686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19297631-0b65-4d19-9b5c-ab74b80cf7a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088320 May 23 13:53:25.947260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 744/1565] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:25 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:26.915993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f78d761-2c5e-4bd6-9b02-7cdcb6fca92b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:26.916850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f78d761-2c5e-4bd6-9b02-7cdcb6fca92b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:26.923437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f78d761-2c5e-4bd6-9b02-7cdcb6fca92b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:26.923896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f78d761-2c5e-4bd6-9b02-7cdcb6fca92b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:26.924736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f78d761-2c5e-4bd6-9b02-7cdcb6fca92b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:26.925183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f78d761-2c5e-4bd6-9b02-7cdcb6fca92b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:26.956555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f78d761-2c5e-4bd6-9b02-7cdcb6fca92b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 May 23 13:53:26.957161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 822/1566] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:26.964872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a506de20-a9eb-49fd-89f8-ba7e8f98ee22 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:26.965516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a506de20-a9eb-49fd-89f8-ba7e8f98ee22 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:26.975927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a506de20-a9eb-49fd-89f8-ba7e8f98ee22 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:26.976384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a506de20-a9eb-49fd-89f8-ba7e8f98ee22 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:26.977195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a506de20-a9eb-49fd-89f8-ba7e8f98ee22 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:26.977629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a506de20-a9eb-49fd-89f8-ba7e8f98ee22 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:27.045482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a506de20-a9eb-49fd-89f8-ba7e8f98ee22 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:27.053790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a506de20-a9eb-49fd-89f8-ba7e8f98ee22 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092730 May 23 13:53:27.054382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 745/1567] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:26 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:27.968370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-63b7ef92-fec9-4a5f-b9c4-8a5c994fd3c5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:27.969242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-63b7ef92-fec9-4a5f-b9c4-8a5c994fd3c5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:27.977307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63b7ef92-fec9-4a5f-b9c4-8a5c994fd3c5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:27.977756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63b7ef92-fec9-4a5f-b9c4-8a5c994fd3c5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:27.978571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63b7ef92-fec9-4a5f-b9c4-8a5c994fd3c5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:27.979032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-63b7ef92-fec9-4a5f-b9c4-8a5c994fd3c5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:28.009311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-63b7ef92-fec9-4a5f-b9c4-8a5c994fd3c5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044912 May 23 13:53:28.009883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 823/1568] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:28.072400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b4900342-2ab3-4cb9-a33c-18311fd4ffab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:28.073070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b4900342-2ab3-4cb9-a33c-18311fd4ffab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:28.079883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4900342-2ab3-4cb9-a33c-18311fd4ffab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:28.080337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4900342-2ab3-4cb9-a33c-18311fd4ffab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:28.081399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4900342-2ab3-4cb9-a33c-18311fd4ffab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:28.081837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4900342-2ab3-4cb9-a33c-18311fd4ffab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:28.145433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4900342-2ab3-4cb9-a33c-18311fd4ffab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:28.153606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b4900342-2ab3-4cb9-a33c-18311fd4ffab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085899 May 23 13:53:28.154185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 746/1569] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:28 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:29.021107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f8b3380-24ee-4e32-8eae-97297a171ccd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:29.022114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f8b3380-24ee-4e32-8eae-97297a171ccd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:29.029044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f8b3380-24ee-4e32-8eae-97297a171ccd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:29.029507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f8b3380-24ee-4e32-8eae-97297a171ccd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:29.030289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f8b3380-24ee-4e32-8eae-97297a171ccd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:29.030732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f8b3380-24ee-4e32-8eae-97297a171ccd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:29.063376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f8b3380-24ee-4e32-8eae-97297a171ccd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 May 23 13:53:29.063958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 824/1570] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:29.170724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b32d16fc-d3ff-4bae-a43f-5779ca1d2ef4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:29.171329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b32d16fc-d3ff-4bae-a43f-5779ca1d2ef4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:29.178827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b32d16fc-d3ff-4bae-a43f-5779ca1d2ef4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:29.179128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b32d16fc-d3ff-4bae-a43f-5779ca1d2ef4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:29.179905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b32d16fc-d3ff-4bae-a43f-5779ca1d2ef4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:29.180334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b32d16fc-d3ff-4bae-a43f-5779ca1d2ef4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:29.245166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b32d16fc-d3ff-4bae-a43f-5779ca1d2ef4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:29.252676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b32d16fc-d3ff-4bae-a43f-5779ca1d2ef4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085810 May 23 13:53:29.253245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 747/1571] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:29 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:30.075502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efc1a681-0939-4b2c-bc66-ed685fd9ec4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:30.076334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efc1a681-0939-4b2c-bc66-ed685fd9ec4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:30.083078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efc1a681-0939-4b2c-bc66-ed685fd9ec4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:30.083532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efc1a681-0939-4b2c-bc66-ed685fd9ec4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:30.085530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efc1a681-0939-4b2c-bc66-ed685fd9ec4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:30.085979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efc1a681-0939-4b2c-bc66-ed685fd9ec4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:30.119486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efc1a681-0939-4b2c-bc66-ed685fd9ec4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047960 May 23 13:53:30.120063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 825/1572] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:30.269624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7e508f0b-f362-41a5-ade1-23a83c14ccc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:30.270229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7e508f0b-f362-41a5-ade1-23a83c14ccc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:30.276963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e508f0b-f362-41a5-ade1-23a83c14ccc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:30.277417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e508f0b-f362-41a5-ade1-23a83c14ccc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:30.278177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e508f0b-f362-41a5-ade1-23a83c14ccc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:30.278614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e508f0b-f362-41a5-ade1-23a83c14ccc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:30.340032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7e508f0b-f362-41a5-ade1-23a83c14ccc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:30.347566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7e508f0b-f362-41a5-ade1-23a83c14ccc4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.081796 May 23 13:53:30.348127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 748/1573] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:30 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:31.131635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5ac89f6e-6e7b-49f4-a27b-79a0008c4ab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:31.132588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5ac89f6e-6e7b-49f4-a27b-79a0008c4ab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:31.139174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ac89f6e-6e7b-49f4-a27b-79a0008c4ab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:31.139624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ac89f6e-6e7b-49f4-a27b-79a0008c4ab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:31.140394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ac89f6e-6e7b-49f4-a27b-79a0008c4ab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:31.140864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ac89f6e-6e7b-49f4-a27b-79a0008c4ab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:31.170656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5ac89f6e-6e7b-49f4-a27b-79a0008c4ab5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043265 May 23 13:53:31.171216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 826/1574] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:31.364878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ccfd2e39-b68a-43e8-9a0b-2ec960f62f67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:31.365543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ccfd2e39-b68a-43e8-9a0b-2ec960f62f67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:31.372006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccfd2e39-b68a-43e8-9a0b-2ec960f62f67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:31.372448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccfd2e39-b68a-43e8-9a0b-2ec960f62f67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:31.373236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccfd2e39-b68a-43e8-9a0b-2ec960f62f67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:31.373666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccfd2e39-b68a-43e8-9a0b-2ec960f62f67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:31.443574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ccfd2e39-b68a-43e8-9a0b-2ec960f62f67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:31.451098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ccfd2e39-b68a-43e8-9a0b-2ec960f62f67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090169 May 23 13:53:31.451658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 749/1575] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:31 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:32.182972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e20200d0-26d2-42f6-bba8-63528b06fdc2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:32.184721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e20200d0-26d2-42f6-bba8-63528b06fdc2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:32.190611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e20200d0-26d2-42f6-bba8-63528b06fdc2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:32.191061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e20200d0-26d2-42f6-bba8-63528b06fdc2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:32.191834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e20200d0-26d2-42f6-bba8-63528b06fdc2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:32.192273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e20200d0-26d2-42f6-bba8-63528b06fdc2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:32.221249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e20200d0-26d2-42f6-bba8-63528b06fdc2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042199 May 23 13:53:32.221812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 827/1576] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:32 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:53:32.524185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36a12035-16a6-48cc-9f00-361052d8d982 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:32.524851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36a12035-16a6-48cc-9f00-361052d8d982 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:32.531374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36a12035-16a6-48cc-9f00-361052d8d982 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:32.531827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36a12035-16a6-48cc-9f00-361052d8d982 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:32.532619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36a12035-16a6-48cc-9f00-361052d8d982 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:32.533062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36a12035-16a6-48cc-9f00-361052d8d982 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:32.594907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36a12035-16a6-48cc-9f00-361052d8d982 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:32.603104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36a12035-16a6-48cc-9f00-361052d8d982 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083833 May 23 13:53:32.603664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 750/1577] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:32 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:33.233969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee4f7f8e-a265-457d-99f1-2073acb0b0f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:33.234952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee4f7f8e-a265-457d-99f1-2073acb0b0f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:33.242207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee4f7f8e-a265-457d-99f1-2073acb0b0f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:33.242664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee4f7f8e-a265-457d-99f1-2073acb0b0f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:33.243431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee4f7f8e-a265-457d-99f1-2073acb0b0f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:33.243873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee4f7f8e-a265-457d-99f1-2073acb0b0f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:33.274570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee4f7f8e-a265-457d-99f1-2073acb0b0f0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 May 23 13:53:33.275138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 828/1578] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:33.620751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-35eecd07-a0e0-476b-8d90-54d247034aa0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:33.621431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-35eecd07-a0e0-476b-8d90-54d247034aa0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:33.628100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35eecd07-a0e0-476b-8d90-54d247034aa0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:33.628553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35eecd07-a0e0-476b-8d90-54d247034aa0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:33.629355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35eecd07-a0e0-476b-8d90-54d247034aa0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:33.629812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35eecd07-a0e0-476b-8d90-54d247034aa0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:33.694304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-35eecd07-a0e0-476b-8d90-54d247034aa0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:33.701837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-35eecd07-a0e0-476b-8d90-54d247034aa0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085053 May 23 13:53:33.702386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 751/1579] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:33 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:34.286198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56bcff43-25e9-4495-9050-a1b74419c312 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:34.287674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56bcff43-25e9-4495-9050-a1b74419c312 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:34.294256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56bcff43-25e9-4495-9050-a1b74419c312 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:34.294704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56bcff43-25e9-4495-9050-a1b74419c312 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:34.295464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56bcff43-25e9-4495-9050-a1b74419c312 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:34.295897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56bcff43-25e9-4495-9050-a1b74419c312 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:34.300306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:34.328902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56bcff43-25e9-4495-9050-a1b74419c312 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046548 May 23 13:53:34.329475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 829/1580] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:34.718760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-69214763-20b5-4183-af57-343d672e387a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:34.719375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-69214763-20b5-4183-af57-343d672e387a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:34.726656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69214763-20b5-4183-af57-343d672e387a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:34.727125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69214763-20b5-4183-af57-343d672e387a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:34.727896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69214763-20b5-4183-af57-343d672e387a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:34.728332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69214763-20b5-4183-af57-343d672e387a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:34.790900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-69214763-20b5-4183-af57-343d672e387a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:34.794365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:34.798740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-69214763-20b5-4183-af57-343d672e387a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083884 May 23 13:53:34.799307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 752/1581] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:34 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:35.340983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c955ab5d-006f-4338-bb84-95729585af04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:35.341906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c955ab5d-006f-4338-bb84-95729585af04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:35.348615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c955ab5d-006f-4338-bb84-95729585af04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:35.349580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c955ab5d-006f-4338-bb84-95729585af04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:35.350457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c955ab5d-006f-4338-bb84-95729585af04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:35.350794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c955ab5d-006f-4338-bb84-95729585af04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:35.379854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c955ab5d-006f-4338-bb84-95729585af04 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 May 23 13:53:35.380522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 830/1582] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:35.815649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0226cea2-9649-41f9-a9af-debc6870584f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:35.816260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0226cea2-9649-41f9-a9af-debc6870584f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:35.823883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0226cea2-9649-41f9-a9af-debc6870584f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:35.824336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0226cea2-9649-41f9-a9af-debc6870584f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:35.825148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0226cea2-9649-41f9-a9af-debc6870584f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:35.825568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0226cea2-9649-41f9-a9af-debc6870584f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:35.889227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0226cea2-9649-41f9-a9af-debc6870584f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:35.897486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0226cea2-9649-41f9-a9af-debc6870584f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085616 May 23 13:53:35.898055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 753/1583] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:35 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:36.391851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-890547db-7793-4b28-8cc0-baf4870a89a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:36.392816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-890547db-7793-4b28-8cc0-baf4870a89a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:36.400043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-890547db-7793-4b28-8cc0-baf4870a89a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:36.400487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-890547db-7793-4b28-8cc0-baf4870a89a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:36.401289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-890547db-7793-4b28-8cc0-baf4870a89a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:36.401783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-890547db-7793-4b28-8cc0-baf4870a89a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:36.431166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-890547db-7793-4b28-8cc0-baf4870a89a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043255 May 23 13:53:36.431721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 831/1584] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:36.914583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1c0f858f-a5c7-4514-ad71-845042f43d8a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:36.915176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1c0f858f-a5c7-4514-ad71-845042f43d8a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:36.921719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c0f858f-a5c7-4514-ad71-845042f43d8a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:36.922165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c0f858f-a5c7-4514-ad71-845042f43d8a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:36.922916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c0f858f-a5c7-4514-ad71-845042f43d8a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:36.923345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c0f858f-a5c7-4514-ad71-845042f43d8a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:36.985768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1c0f858f-a5c7-4514-ad71-845042f43d8a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:36.995747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1c0f858f-a5c7-4514-ad71-845042f43d8a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085057 May 23 13:53:36.996328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 754/1585] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:36 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:37.444383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-225eb4ba-b8b1-478e-8b34-971ae87bb6bf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:37.445326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-225eb4ba-b8b1-478e-8b34-971ae87bb6bf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:37.451869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-225eb4ba-b8b1-478e-8b34-971ae87bb6bf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:37.452416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-225eb4ba-b8b1-478e-8b34-971ae87bb6bf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:37.453104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-225eb4ba-b8b1-478e-8b34-971ae87bb6bf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:37.453537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-225eb4ba-b8b1-478e-8b34-971ae87bb6bf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:37.483473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-225eb4ba-b8b1-478e-8b34-971ae87bb6bf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043260 May 23 13:53:37.484027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 832/1586] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:38.013271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b40dfc0b-e0be-4061-94ca-78003b3826ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:38.013843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b40dfc0b-e0be-4061-94ca-78003b3826ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:38.020529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b40dfc0b-e0be-4061-94ca-78003b3826ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:38.021590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b40dfc0b-e0be-4061-94ca-78003b3826ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:38.022362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b40dfc0b-e0be-4061-94ca-78003b3826ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:38.022797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b40dfc0b-e0be-4061-94ca-78003b3826ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:38.083119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b40dfc0b-e0be-4061-94ca-78003b3826ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:38.091303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b40dfc0b-e0be-4061-94ca-78003b3826ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082095 May 23 13:53:38.091867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 755/1587] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:38 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:38.495968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d05b9bd-9650-4e05-9d8d-a3da2ccc3a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:38.497039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d05b9bd-9650-4e05-9d8d-a3da2ccc3a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:38.503764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d05b9bd-9650-4e05-9d8d-a3da2ccc3a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:38.504211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d05b9bd-9650-4e05-9d8d-a3da2ccc3a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:38.505727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d05b9bd-9650-4e05-9d8d-a3da2ccc3a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:38.506169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d05b9bd-9650-4e05-9d8d-a3da2ccc3a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:38.536839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d05b9bd-9650-4e05-9d8d-a3da2ccc3a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 May 23 13:53:38.540633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 833/1588] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:39.108521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-546b9bb7-eb05-48d3-9679-19a4905edc67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:39.109600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-546b9bb7-eb05-48d3-9679-19a4905edc67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:39.117969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-546b9bb7-eb05-48d3-9679-19a4905edc67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:39.118651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-546b9bb7-eb05-48d3-9679-19a4905edc67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:39.119329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-546b9bb7-eb05-48d3-9679-19a4905edc67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:39.119758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-546b9bb7-eb05-48d3-9679-19a4905edc67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:39.195275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-546b9bb7-eb05-48d3-9679-19a4905edc67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:39.205949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-546b9bb7-eb05-48d3-9679-19a4905edc67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.101887 May 23 13:53:39.206553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 756/1589] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:39 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:53:39.547466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be300acc-cebf-4c8a-93d3-7842ba3d08df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:39.548405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be300acc-cebf-4c8a-93d3-7842ba3d08df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:39.557715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be300acc-cebf-4c8a-93d3-7842ba3d08df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:39.558170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be300acc-cebf-4c8a-93d3-7842ba3d08df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:39.558947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be300acc-cebf-4c8a-93d3-7842ba3d08df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:39.559383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be300acc-cebf-4c8a-93d3-7842ba3d08df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:39.590643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be300acc-cebf-4c8a-93d3-7842ba3d08df tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047091 May 23 13:53:39.591223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 834/1590] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:40.224736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fa5413f7-36d9-4b46-9a67-6a95791060cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:40.225369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fa5413f7-36d9-4b46-9a67-6a95791060cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:40.232939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa5413f7-36d9-4b46-9a67-6a95791060cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:40.233402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa5413f7-36d9-4b46-9a67-6a95791060cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:40.234246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa5413f7-36d9-4b46-9a67-6a95791060cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:40.234689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa5413f7-36d9-4b46-9a67-6a95791060cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:40.310628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fa5413f7-36d9-4b46-9a67-6a95791060cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:40.318770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fa5413f7-36d9-4b46-9a67-6a95791060cd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.098877 May 23 13:53:40.319332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 757/1591] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:40 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:40.603319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7874796-e908-4ca9-bda8-9ee64dd515d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:40.604200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7874796-e908-4ca9-bda8-9ee64dd515d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:40.611027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7874796-e908-4ca9-bda8-9ee64dd515d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:40.611488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7874796-e908-4ca9-bda8-9ee64dd515d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:40.612264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7874796-e908-4ca9-bda8-9ee64dd515d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:40.612760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7874796-e908-4ca9-bda8-9ee64dd515d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:40.643336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7874796-e908-4ca9-bda8-9ee64dd515d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 May 23 13:53:40.644346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 835/1592] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:53:41.336513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ac104ae1-99e8-4d2e-a195-a1802fb2bab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:41.337146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ac104ae1-99e8-4d2e-a195-a1802fb2bab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:41.343959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac104ae1-99e8-4d2e-a195-a1802fb2bab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:41.344402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac104ae1-99e8-4d2e-a195-a1802fb2bab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:41.345184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac104ae1-99e8-4d2e-a195-a1802fb2bab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:41.345614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac104ae1-99e8-4d2e-a195-a1802fb2bab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:41.406943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ac104ae1-99e8-4d2e-a195-a1802fb2bab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:41.414865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ac104ae1-99e8-4d2e-a195-a1802fb2bab6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082915 May 23 13:53:41.415597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 758/1593] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:41 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:41.655227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b8fae4ae-55de-4045-adc6-657ce7c3e710 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:41.656186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b8fae4ae-55de-4045-adc6-657ce7c3e710 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:41.662770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8fae4ae-55de-4045-adc6-657ce7c3e710 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:41.663224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8fae4ae-55de-4045-adc6-657ce7c3e710 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:41.664009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8fae4ae-55de-4045-adc6-657ce7c3e710 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:41.664432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8fae4ae-55de-4045-adc6-657ce7c3e710 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:41.693817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b8fae4ae-55de-4045-adc6-657ce7c3e710 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 May 23 13:53:41.694370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 836/1594] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:42.432292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-927fd475-77e2-4e1d-898f-67dabf79a659 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:42.432982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-927fd475-77e2-4e1d-898f-67dabf79a659 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:42.439661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-927fd475-77e2-4e1d-898f-67dabf79a659 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:42.440111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-927fd475-77e2-4e1d-898f-67dabf79a659 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:42.440912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-927fd475-77e2-4e1d-898f-67dabf79a659 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:42.441349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-927fd475-77e2-4e1d-898f-67dabf79a659 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:42.512355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-927fd475-77e2-4e1d-898f-67dabf79a659 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:42.519924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-927fd475-77e2-4e1d-898f-67dabf79a659 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091481 May 23 13:53:42.521191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 759/1595] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:42 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:42.705961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b3c20b66-3cd7-423e-a38a-4f0870d72c63 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:42.706790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b3c20b66-3cd7-423e-a38a-4f0870d72c63 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:42.713367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3c20b66-3cd7-423e-a38a-4f0870d72c63 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:42.713827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3c20b66-3cd7-423e-a38a-4f0870d72c63 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:42.714582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3c20b66-3cd7-423e-a38a-4f0870d72c63 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:42.715012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3c20b66-3cd7-423e-a38a-4f0870d72c63 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:42.744818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b3c20b66-3cd7-423e-a38a-4f0870d72c63 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043083 May 23 13:53:42.745376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 837/1596] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:43.538402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0a6f5c8c-027e-4598-8f4b-c2f4804e9a09 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:43.538946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0a6f5c8c-027e-4598-8f4b-c2f4804e9a09 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:43.545621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a6f5c8c-027e-4598-8f4b-c2f4804e9a09 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:43.546072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a6f5c8c-027e-4598-8f4b-c2f4804e9a09 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:43.546833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a6f5c8c-027e-4598-8f4b-c2f4804e9a09 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:43.547263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0a6f5c8c-027e-4598-8f4b-c2f4804e9a09 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:43.609383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0a6f5c8c-027e-4598-8f4b-c2f4804e9a09 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:43.618200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0a6f5c8c-027e-4598-8f4b-c2f4804e9a09 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084333 May 23 13:53:43.618802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 760/1597] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:43 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:53:43.755654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1ee83a6-6370-4a83-b416-3ae721731401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:43.756597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e1ee83a6-6370-4a83-b416-3ae721731401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:43.763100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1ee83a6-6370-4a83-b416-3ae721731401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:43.763557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1ee83a6-6370-4a83-b416-3ae721731401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:43.764324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1ee83a6-6370-4a83-b416-3ae721731401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:43.764796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1ee83a6-6370-4a83-b416-3ae721731401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:43.794927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1ee83a6-6370-4a83-b416-3ae721731401 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 May 23 13:53:43.795383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 838/1598] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:44.635368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-49d969cd-b969-4a42-93c9-56face326b92 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:44.636002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-49d969cd-b969-4a42-93c9-56face326b92 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:44.642641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49d969cd-b969-4a42-93c9-56face326b92 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:44.643080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49d969cd-b969-4a42-93c9-56face326b92 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:44.643824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49d969cd-b969-4a42-93c9-56face326b92 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:44.644333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49d969cd-b969-4a42-93c9-56face326b92 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:44.711256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49d969cd-b969-4a42-93c9-56face326b92 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:44.719248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-49d969cd-b969-4a42-93c9-56face326b92 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087791 May 23 13:53:44.719808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 761/1599] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:44 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:44.806538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-322ac3cb-2cf1-48ca-8a86-3392a0755e96 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:44.807465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-322ac3cb-2cf1-48ca-8a86-3392a0755e96 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:44.813968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-322ac3cb-2cf1-48ca-8a86-3392a0755e96 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:44.814423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-322ac3cb-2cf1-48ca-8a86-3392a0755e96 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:44.815193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-322ac3cb-2cf1-48ca-8a86-3392a0755e96 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:44.815634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-322ac3cb-2cf1-48ca-8a86-3392a0755e96 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:44.846140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-322ac3cb-2cf1-48ca-8a86-3392a0755e96 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 May 23 13:53:44.846704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 839/1600] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:45.736937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0bcfccb5-15eb-476a-887d-0c62b49e6312 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:45.737570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0bcfccb5-15eb-476a-887d-0c62b49e6312 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:45.745285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bcfccb5-15eb-476a-887d-0c62b49e6312 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:45.745740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bcfccb5-15eb-476a-887d-0c62b49e6312 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:45.746513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bcfccb5-15eb-476a-887d-0c62b49e6312 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:45.746949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bcfccb5-15eb-476a-887d-0c62b49e6312 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:45.809135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0bcfccb5-15eb-476a-887d-0c62b49e6312 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:45.816769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0bcfccb5-15eb-476a-887d-0c62b49e6312 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083762 May 23 13:53:45.817960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 762/1601] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:45 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:45.857445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c4c4255-a741-4339-8164-83f72fc5cb71 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:45.858367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c4c4255-a741-4339-8164-83f72fc5cb71 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:45.865569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c4c4255-a741-4339-8164-83f72fc5cb71 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:45.866024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c4c4255-a741-4339-8164-83f72fc5cb71 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:45.866811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c4c4255-a741-4339-8164-83f72fc5cb71 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:45.867254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c4c4255-a741-4339-8164-83f72fc5cb71 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:45.898315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c4c4255-a741-4339-8164-83f72fc5cb71 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 May 23 13:53:45.898954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 840/1602] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:46.836822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d98358d4-4ce3-40c8-a0b2-d3f3136c075f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:46.837622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d98358d4-4ce3-40c8-a0b2-d3f3136c075f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:46.845492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d98358d4-4ce3-40c8-a0b2-d3f3136c075f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:46.845941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d98358d4-4ce3-40c8-a0b2-d3f3136c075f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:46.846927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d98358d4-4ce3-40c8-a0b2-d3f3136c075f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:46.847347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d98358d4-4ce3-40c8-a0b2-d3f3136c075f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:46.929797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52ecdda5-7b99-44fc-af9d-8512a87da079 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:46.930254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d98358d4-4ce3-40c8-a0b2-d3f3136c075f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:46.930374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52ecdda5-7b99-44fc-af9d-8512a87da079 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:46.930374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=58 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:46.930374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ecdda5-7b99-44fc-af9d-8512a87da079 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:46.930374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ecdda5-7b99-44fc-af9d-8512a87da079 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:46.930734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d98358d4-4ce3-40c8-a0b2-d3f3136c075f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088365 May 23 13:53:46.930734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 763/1603] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:46 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:46.930912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ecdda5-7b99-44fc-af9d-8512a87da079 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:46.930912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52ecdda5-7b99-44fc-af9d-8512a87da079 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:46.952370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52ecdda5-7b99-44fc-af9d-8512a87da079 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046081 May 23 13:53:46.953222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 841/1604] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:53:47.937956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7a7c8fe6-038e-4880-adf5-d8d81e9c28f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:47.938570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7a7c8fe6-038e-4880-adf5-d8d81e9c28f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:47.945747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a7c8fe6-038e-4880-adf5-d8d81e9c28f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:47.946193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a7c8fe6-038e-4880-adf5-d8d81e9c28f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:47.946954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a7c8fe6-038e-4880-adf5-d8d81e9c28f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:47.947389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a7c8fe6-038e-4880-adf5-d8d81e9c28f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:47.964430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0fdf5e7e-095e-4cea-9a16-7665d556e108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:47.965482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0fdf5e7e-095e-4cea-9a16-7665d556e108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:47.972276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fdf5e7e-095e-4cea-9a16-7665d556e108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:47.972757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fdf5e7e-095e-4cea-9a16-7665d556e108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:47.973620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fdf5e7e-095e-4cea-9a16-7665d556e108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:47.974252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fdf5e7e-095e-4cea-9a16-7665d556e108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:48.013258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0fdf5e7e-095e-4cea-9a16-7665d556e108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052902 May 23 13:53:48.013731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 842/1605] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:53:48.019828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7a7c8fe6-038e-4880-adf5-d8d81e9c28f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:48.028259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7a7c8fe6-038e-4880-adf5-d8d81e9c28f4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.094192 May 23 13:53:48.028947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 764/1606] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:47 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:49.025308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ed7a44a-3a5c-4628-b169-54ed2a191d16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:49.026231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ed7a44a-3a5c-4628-b169-54ed2a191d16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:49.032905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ed7a44a-3a5c-4628-b169-54ed2a191d16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:49.033367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ed7a44a-3a5c-4628-b169-54ed2a191d16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:49.034168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ed7a44a-3a5c-4628-b169-54ed2a191d16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:49.034697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ed7a44a-3a5c-4628-b169-54ed2a191d16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:49.045904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45d95b34-2aa2-4e7c-a6e4-d404a4fd0ca9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:49.046517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45d95b34-2aa2-4e7c-a6e4-d404a4fd0ca9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:49.053762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45d95b34-2aa2-4e7c-a6e4-d404a4fd0ca9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:49.054219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45d95b34-2aa2-4e7c-a6e4-d404a4fd0ca9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:49.054987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45d95b34-2aa2-4e7c-a6e4-d404a4fd0ca9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:49.055432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45d95b34-2aa2-4e7c-a6e4-d404a4fd0ca9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:49.067774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ed7a44a-3a5c-4628-b169-54ed2a191d16 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046450 May 23 13:53:49.068401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 843/1607] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:49.119971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45d95b34-2aa2-4e7c-a6e4-d404a4fd0ca9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:49.127578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45d95b34-2aa2-4e7c-a6e4-d404a4fd0ca9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085514 May 23 13:53:49.128138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 765/1608] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:49 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:53:50.079803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a4f1e6e-b859-413e-85f0-d1ca78a679e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:50.080692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a4f1e6e-b859-413e-85f0-d1ca78a679e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:50.087531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a4f1e6e-b859-413e-85f0-d1ca78a679e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:50.087984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a4f1e6e-b859-413e-85f0-d1ca78a679e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:50.088802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a4f1e6e-b859-413e-85f0-d1ca78a679e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:50.089248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a4f1e6e-b859-413e-85f0-d1ca78a679e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:50.120100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a4f1e6e-b859-413e-85f0-d1ca78a679e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 May 23 13:53:50.120688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 844/1609] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:50.144721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92e265e8-e607-483f-a019-213228f4f60b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:50.145387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-92e265e8-e607-483f-a019-213228f4f60b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:50.147724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=56 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:50.152392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92e265e8-e607-483f-a019-213228f4f60b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:50.152879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92e265e8-e607-483f-a019-213228f4f60b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:50.153669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92e265e8-e607-483f-a019-213228f4f60b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:50.154103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92e265e8-e607-483f-a019-213228f4f60b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:50.218576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-92e265e8-e607-483f-a019-213228f4f60b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:50.226709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-92e265e8-e607-483f-a019-213228f4f60b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085834 May 23 13:53:50.227279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 766/1610] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:50 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:51.132099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9514589a-233a-4012-923f-39325aabfd09 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:51.133091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9514589a-233a-4012-923f-39325aabfd09 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:51.139841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9514589a-233a-4012-923f-39325aabfd09 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:51.140290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9514589a-233a-4012-923f-39325aabfd09 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:51.141094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9514589a-233a-4012-923f-39325aabfd09 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:51.141533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9514589a-233a-4012-923f-39325aabfd09 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:51.167881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:51.172549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9514589a-233a-4012-923f-39325aabfd09 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 May 23 13:53:51.173160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 845/1611] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:51.244195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a21ba7c5-ef60-452a-b4d9-136b74fde9a2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:51.244837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a21ba7c5-ef60-452a-b4d9-136b74fde9a2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:51.251778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a21ba7c5-ef60-452a-b4d9-136b74fde9a2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:51.254272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a21ba7c5-ef60-452a-b4d9-136b74fde9a2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:51.254272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a21ba7c5-ef60-452a-b4d9-136b74fde9a2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:51.254272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a21ba7c5-ef60-452a-b4d9-136b74fde9a2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:51.321507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a21ba7c5-ef60-452a-b4d9-136b74fde9a2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:51.330261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a21ba7c5-ef60-452a-b4d9-136b74fde9a2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090301 May 23 13:53:51.330840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 767/1612] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:51 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:52.184997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d8b5ee6-e65e-4d08-b47a-ebfa88a2cdb6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:52.185913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d8b5ee6-e65e-4d08-b47a-ebfa88a2cdb6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:52.193633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d8b5ee6-e65e-4d08-b47a-ebfa88a2cdb6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:52.194078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d8b5ee6-e65e-4d08-b47a-ebfa88a2cdb6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:52.194910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d8b5ee6-e65e-4d08-b47a-ebfa88a2cdb6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:52.195343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d8b5ee6-e65e-4d08-b47a-ebfa88a2cdb6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:52.224896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d8b5ee6-e65e-4d08-b47a-ebfa88a2cdb6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 May 23 13:53:52.225446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 846/1613] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:52.347259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ee18c706-1b17-4dc5-9578-c2f8094dda10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:52.347904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ee18c706-1b17-4dc5-9578-c2f8094dda10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:52.355155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee18c706-1b17-4dc5-9578-c2f8094dda10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:52.355604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee18c706-1b17-4dc5-9578-c2f8094dda10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:52.356360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee18c706-1b17-4dc5-9578-c2f8094dda10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:52.356822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee18c706-1b17-4dc5-9578-c2f8094dda10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:52.419334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ee18c706-1b17-4dc5-9578-c2f8094dda10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:52.426847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ee18c706-1b17-4dc5-9578-c2f8094dda10 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083407 May 23 13:53:52.428195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 768/1614] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:52 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:53.236120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6fb5498a-b665-4e5e-90b4-096250c8bc08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:53.237163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6fb5498a-b665-4e5e-90b4-096250c8bc08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:53.244774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fb5498a-b665-4e5e-90b4-096250c8bc08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:53.245218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fb5498a-b665-4e5e-90b4-096250c8bc08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:53.245984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fb5498a-b665-4e5e-90b4-096250c8bc08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:53.246418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fb5498a-b665-4e5e-90b4-096250c8bc08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:53.276053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6fb5498a-b665-4e5e-90b4-096250c8bc08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044295 May 23 13:53:53.276640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 847/1615] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:53.444771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-513f4e03-31a3-485b-8ce8-af7000f5fccd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:53.445478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-513f4e03-31a3-485b-8ce8-af7000f5fccd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:53.452098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-513f4e03-31a3-485b-8ce8-af7000f5fccd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:53.452553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-513f4e03-31a3-485b-8ce8-af7000f5fccd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:53.453411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-513f4e03-31a3-485b-8ce8-af7000f5fccd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:53.453846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-513f4e03-31a3-485b-8ce8-af7000f5fccd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:53.473919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:53:53.527293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-513f4e03-31a3-485b-8ce8-af7000f5fccd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:53.537858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-513f4e03-31a3-485b-8ce8-af7000f5fccd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.097000 May 23 13:53:53.538547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 769/1616] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:53 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:54.287923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-23f2acdf-684a-4b68-bfaa-1ac686667100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:54.288905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-23f2acdf-684a-4b68-bfaa-1ac686667100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:54.295414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23f2acdf-684a-4b68-bfaa-1ac686667100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:54.295870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23f2acdf-684a-4b68-bfaa-1ac686667100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:54.296665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23f2acdf-684a-4b68-bfaa-1ac686667100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:54.297114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23f2acdf-684a-4b68-bfaa-1ac686667100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:54.329112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-23f2acdf-684a-4b68-bfaa-1ac686667100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 May 23 13:53:54.329965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 848/1617] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:54.559585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f7d32cf-126f-4c1e-8f08-aeb1c7fd29b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:54.560120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f7d32cf-126f-4c1e-8f08-aeb1c7fd29b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:54.567043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7d32cf-126f-4c1e-8f08-aeb1c7fd29b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:54.567489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7d32cf-126f-4c1e-8f08-aeb1c7fd29b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:54.568364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7d32cf-126f-4c1e-8f08-aeb1c7fd29b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:54.568845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7d32cf-126f-4c1e-8f08-aeb1c7fd29b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:54.634536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f7d32cf-126f-4c1e-8f08-aeb1c7fd29b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:54.642180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f7d32cf-126f-4c1e-8f08-aeb1c7fd29b0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086704 May 23 13:53:54.642921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 770/1618] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:54 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:55.340902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6ce5c4e-a792-4cd9-a9cc-60a9166a26c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:55.346799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d6ce5c4e-a792-4cd9-a9cc-60a9166a26c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:55.348360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ce5c4e-a792-4cd9-a9cc-60a9166a26c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:55.349399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ce5c4e-a792-4cd9-a9cc-60a9166a26c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:55.350470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ce5c4e-a792-4cd9-a9cc-60a9166a26c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:55.350913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ce5c4e-a792-4cd9-a9cc-60a9166a26c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:55.381794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d6ce5c4e-a792-4cd9-a9cc-60a9166a26c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044860 May 23 13:53:55.382365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 849/1619] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:55.659394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e946d10-999d-4fb6-a332-9d19b30e77fc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:55.660004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e946d10-999d-4fb6-a332-9d19b30e77fc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:55.667909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e946d10-999d-4fb6-a332-9d19b30e77fc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:55.668358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e946d10-999d-4fb6-a332-9d19b30e77fc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:55.669156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e946d10-999d-4fb6-a332-9d19b30e77fc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:55.669591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e946d10-999d-4fb6-a332-9d19b30e77fc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:55.732778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6e946d10-999d-4fb6-a332-9d19b30e77fc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:55.740750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e946d10-999d-4fb6-a332-9d19b30e77fc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085050 May 23 13:53:55.741501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 771/1620] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:55 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:56.393579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bdfa2501-63b8-4011-97cf-7d51564b354a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:56.394519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bdfa2501-63b8-4011-97cf-7d51564b354a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:56.401253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdfa2501-63b8-4011-97cf-7d51564b354a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:56.401652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdfa2501-63b8-4011-97cf-7d51564b354a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:56.402382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdfa2501-63b8-4011-97cf-7d51564b354a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:56.402813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdfa2501-63b8-4011-97cf-7d51564b354a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:56.433159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bdfa2501-63b8-4011-97cf-7d51564b354a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043484 May 23 13:53:56.433724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 850/1621] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:56.757579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff1b1833-ad06-4d8d-a39f-80e7150637e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:56.758119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff1b1833-ad06-4d8d-a39f-80e7150637e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:56.764720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff1b1833-ad06-4d8d-a39f-80e7150637e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:56.765249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff1b1833-ad06-4d8d-a39f-80e7150637e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:56.765998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff1b1833-ad06-4d8d-a39f-80e7150637e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:56.766427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff1b1833-ad06-4d8d-a39f-80e7150637e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:56.832090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ff1b1833-ad06-4d8d-a39f-80e7150637e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:56.842616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff1b1833-ad06-4d8d-a39f-80e7150637e4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.089612 May 23 13:53:56.843186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 772/1622] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:56 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:57.445547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ce54bdb-73c1-4de6-b2b4-83bc3a6ad0dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:57.446450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ce54bdb-73c1-4de6-b2b4-83bc3a6ad0dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:57.452962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ce54bdb-73c1-4de6-b2b4-83bc3a6ad0dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:57.453406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ce54bdb-73c1-4de6-b2b4-83bc3a6ad0dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:57.454157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ce54bdb-73c1-4de6-b2b4-83bc3a6ad0dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:57.454843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ce54bdb-73c1-4de6-b2b4-83bc3a6ad0dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:57.484440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ce54bdb-73c1-4de6-b2b4-83bc3a6ad0dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 May 23 13:53:57.485025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 851/1623] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:57.859869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aa8d5149-b991-40dc-87ba-c834ba425a9f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:57.860483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aa8d5149-b991-40dc-87ba-c834ba425a9f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:57.869146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa8d5149-b991-40dc-87ba-c834ba425a9f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:57.869598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa8d5149-b991-40dc-87ba-c834ba425a9f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:57.870364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa8d5149-b991-40dc-87ba-c834ba425a9f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:57.870801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa8d5149-b991-40dc-87ba-c834ba425a9f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:57.940887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aa8d5149-b991-40dc-87ba-c834ba425a9f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:57.949500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aa8d5149-b991-40dc-87ba-c834ba425a9f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093493 May 23 13:53:57.950069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 773/1624] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:57 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:58.496860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-36396ac2-01ad-4c39-b9a9-de1899c859c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:58.497686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-36396ac2-01ad-4c39-b9a9-de1899c859c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:58.504156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36396ac2-01ad-4c39-b9a9-de1899c859c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:58.504633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36396ac2-01ad-4c39-b9a9-de1899c859c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:58.505491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36396ac2-01ad-4c39-b9a9-de1899c859c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:58.505988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36396ac2-01ad-4c39-b9a9-de1899c859c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:58.543165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-36396ac2-01ad-4c39-b9a9-de1899c859c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050284 May 23 13:53:58.543760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 852/1625] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:58 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:53:58.966033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-50603ecf-59e9-4961-bf13-c63393cb30b2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:58.966648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-50603ecf-59e9-4961-bf13-c63393cb30b2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:58.973302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50603ecf-59e9-4961-bf13-c63393cb30b2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:58.973992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50603ecf-59e9-4961-bf13-c63393cb30b2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:58.974594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50603ecf-59e9-4961-bf13-c63393cb30b2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:58.975032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50603ecf-59e9-4961-bf13-c63393cb30b2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:59.037483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-50603ecf-59e9-4961-bf13-c63393cb30b2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:53:59.045075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-50603ecf-59e9-4961-bf13-c63393cb30b2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082862 May 23 13:53:59.046670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 774/1626] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:53:58 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:53:59.556031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c54b2f9-acde-4925-a436-9dc0ee1a1d06 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:53:59.557086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c54b2f9-acde-4925-a436-9dc0ee1a1d06 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:53:59.563914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c54b2f9-acde-4925-a436-9dc0ee1a1d06 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:59.564364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c54b2f9-acde-4925-a436-9dc0ee1a1d06 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:59.565163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c54b2f9-acde-4925-a436-9dc0ee1a1d06 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:53:59.565608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c54b2f9-acde-4925-a436-9dc0ee1a1d06 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:53:59.596060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c54b2f9-acde-4925-a436-9dc0ee1a1d06 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 May 23 13:53:59.596673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 853/1627] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:53:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:00.064373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fc84eac9-352d-4b15-a6db-4f34f9014576 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:00.065074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fc84eac9-352d-4b15-a6db-4f34f9014576 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:00.072068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc84eac9-352d-4b15-a6db-4f34f9014576 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:00.072512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc84eac9-352d-4b15-a6db-4f34f9014576 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:00.073292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc84eac9-352d-4b15-a6db-4f34f9014576 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:00.073796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc84eac9-352d-4b15-a6db-4f34f9014576 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:00.137018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc84eac9-352d-4b15-a6db-4f34f9014576 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:00.144635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fc84eac9-352d-4b15-a6db-4f34f9014576 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084724 May 23 13:54:00.145212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 775/1628] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:00 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:00.607433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48d047da-e7f1-4b28-ac79-e3733a85aae4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:00.608671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-48d047da-e7f1-4b28-ac79-e3733a85aae4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:00.615947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48d047da-e7f1-4b28-ac79-e3733a85aae4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:00.616398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48d047da-e7f1-4b28-ac79-e3733a85aae4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:00.617221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48d047da-e7f1-4b28-ac79-e3733a85aae4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:00.617688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48d047da-e7f1-4b28-ac79-e3733a85aae4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:00.647626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48d047da-e7f1-4b28-ac79-e3733a85aae4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 May 23 13:54:00.648187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 854/1629] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:01.162964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb990958-a2fd-48bd-a44a-61752bfde30f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:01.163579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb990958-a2fd-48bd-a44a-61752bfde30f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:01.169795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb990958-a2fd-48bd-a44a-61752bfde30f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:01.170253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb990958-a2fd-48bd-a44a-61752bfde30f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:01.171029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb990958-a2fd-48bd-a44a-61752bfde30f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:01.171465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb990958-a2fd-48bd-a44a-61752bfde30f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:01.240261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bb990958-a2fd-48bd-a44a-61752bfde30f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:01.249409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb990958-a2fd-48bd-a44a-61752bfde30f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091181 May 23 13:54:01.249999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 776/1630] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:01 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:01.659485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-23cf4e1d-c716-4994-b39f-e83438c849c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:01.660540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-23cf4e1d-c716-4994-b39f-e83438c849c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:01.667864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23cf4e1d-c716-4994-b39f-e83438c849c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:01.668313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23cf4e1d-c716-4994-b39f-e83438c849c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:01.669115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23cf4e1d-c716-4994-b39f-e83438c849c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:01.669556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23cf4e1d-c716-4994-b39f-e83438c849c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:01.698370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-23cf4e1d-c716-4994-b39f-e83438c849c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043026 May 23 13:54:01.698925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 855/1631] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:02.267872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-315a054a-23da-4b4d-b6c1-d50aba9c754d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:02.268506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-315a054a-23da-4b4d-b6c1-d50aba9c754d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:02.275944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-315a054a-23da-4b4d-b6c1-d50aba9c754d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:02.276397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-315a054a-23da-4b4d-b6c1-d50aba9c754d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:02.277193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-315a054a-23da-4b4d-b6c1-d50aba9c754d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:02.277630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-315a054a-23da-4b4d-b6c1-d50aba9c754d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:02.344543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-315a054a-23da-4b4d-b6c1-d50aba9c754d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:02.352390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-315a054a-23da-4b4d-b6c1-d50aba9c754d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088352 May 23 13:54:02.352997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 777/1632] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:02 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:02.710387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-23db63f4-fbaf-4314-a550-d95eca4ed108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:02.711385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-23db63f4-fbaf-4314-a550-d95eca4ed108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:02.717963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23db63f4-fbaf-4314-a550-d95eca4ed108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:02.718418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23db63f4-fbaf-4314-a550-d95eca4ed108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:02.719195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23db63f4-fbaf-4314-a550-d95eca4ed108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:02.719635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23db63f4-fbaf-4314-a550-d95eca4ed108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:02.748327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-23db63f4-fbaf-4314-a550-d95eca4ed108 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042887 May 23 13:54:02.748927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 856/1633] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:03.369778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b258d9a5-cad5-465f-809d-0a25ac2c114b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:03.370391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b258d9a5-cad5-465f-809d-0a25ac2c114b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:03.376843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b258d9a5-cad5-465f-809d-0a25ac2c114b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:03.377295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b258d9a5-cad5-465f-809d-0a25ac2c114b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:03.378056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b258d9a5-cad5-465f-809d-0a25ac2c114b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:03.378487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b258d9a5-cad5-465f-809d-0a25ac2c114b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:03.606419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b258d9a5-cad5-465f-809d-0a25ac2c114b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:03.618713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b258d9a5-cad5-465f-809d-0a25ac2c114b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.252643 May 23 13:54:03.620397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 778/1634] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:03 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:54:03.760261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b7571fb-16bd-4bfa-8f7d-a2bfd93fa0a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:03.761237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b7571fb-16bd-4bfa-8f7d-a2bfd93fa0a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:03.767945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b7571fb-16bd-4bfa-8f7d-a2bfd93fa0a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:03.768399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b7571fb-16bd-4bfa-8f7d-a2bfd93fa0a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:03.769214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b7571fb-16bd-4bfa-8f7d-a2bfd93fa0a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:03.769650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b7571fb-16bd-4bfa-8f7d-a2bfd93fa0a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:03.800934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b7571fb-16bd-4bfa-8f7d-a2bfd93fa0a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 May 23 13:54:03.802201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 857/1635] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:04.640536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c41bebb8-82c4-47b5-bff7-cc29713cbf9d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:04.641161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c41bebb8-82c4-47b5-bff7-cc29713cbf9d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:04.648654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c41bebb8-82c4-47b5-bff7-cc29713cbf9d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:04.649111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c41bebb8-82c4-47b5-bff7-cc29713cbf9d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:04.649880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c41bebb8-82c4-47b5-bff7-cc29713cbf9d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:04.650319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c41bebb8-82c4-47b5-bff7-cc29713cbf9d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:04.712444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c41bebb8-82c4-47b5-bff7-cc29713cbf9d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:04.719985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c41bebb8-82c4-47b5-bff7-cc29713cbf9d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083382 May 23 13:54:04.720540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 779/1636] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:04 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:04.813421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c813cd9a-fb53-4fe2-b894-c78339ef8c7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:04.814350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c813cd9a-fb53-4fe2-b894-c78339ef8c7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:04.821289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c813cd9a-fb53-4fe2-b894-c78339ef8c7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:04.821742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c813cd9a-fb53-4fe2-b894-c78339ef8c7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:04.822505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c813cd9a-fb53-4fe2-b894-c78339ef8c7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:04.822944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c813cd9a-fb53-4fe2-b894-c78339ef8c7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:04.853143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c813cd9a-fb53-4fe2-b894-c78339ef8c7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043736 May 23 13:54:04.853692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 858/1637] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:05.738440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d8036844-57d4-425f-8921-683a3d9c888b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:05.739072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d8036844-57d4-425f-8921-683a3d9c888b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:05.746631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8036844-57d4-425f-8921-683a3d9c888b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:05.747082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8036844-57d4-425f-8921-683a3d9c888b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:05.747864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8036844-57d4-425f-8921-683a3d9c888b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:05.748306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8036844-57d4-425f-8921-683a3d9c888b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:05.813239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d8036844-57d4-425f-8921-683a3d9c888b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:05.821078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d8036844-57d4-425f-8921-683a3d9c888b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086619 May 23 13:54:05.821646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 780/1638] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:05 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:05.864843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-42f2aa8c-6f6a-4673-ac00-fa270e05c97e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:05.865769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-42f2aa8c-6f6a-4673-ac00-fa270e05c97e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:05.873180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42f2aa8c-6f6a-4673-ac00-fa270e05c97e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:05.873633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42f2aa8c-6f6a-4673-ac00-fa270e05c97e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:05.874407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42f2aa8c-6f6a-4673-ac00-fa270e05c97e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:05.874840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42f2aa8c-6f6a-4673-ac00-fa270e05c97e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:05.904327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-42f2aa8c-6f6a-4673-ac00-fa270e05c97e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043445 May 23 13:54:05.904933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 859/1639] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:06.840166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fe9fbd74-5662-4d87-9f6b-e58a928f14e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:06.840847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fe9fbd74-5662-4d87-9f6b-e58a928f14e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:06.848459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe9fbd74-5662-4d87-9f6b-e58a928f14e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:06.848936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe9fbd74-5662-4d87-9f6b-e58a928f14e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:06.849951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe9fbd74-5662-4d87-9f6b-e58a928f14e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:06.850432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe9fbd74-5662-4d87-9f6b-e58a928f14e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:06.917049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-23c2fa18-8710-41cd-ac53-9db8f24d3c51 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:06.918455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-23c2fa18-8710-41cd-ac53-9db8f24d3c51 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:06.923525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fe9fbd74-5662-4d87-9f6b-e58a928f14e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:06.925656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23c2fa18-8710-41cd-ac53-9db8f24d3c51 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:06.926111 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23c2fa18-8710-41cd-ac53-9db8f24d3c51 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:06.926891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23c2fa18-8710-41cd-ac53-9db8f24d3c51 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:06.927331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23c2fa18-8710-41cd-ac53-9db8f24d3c51 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:06.932861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fe9fbd74-5662-4d87-9f6b-e58a928f14e2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.097913 May 23 13:54:06.933445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 781/1640] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:06 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:06.969908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-23c2fa18-8710-41cd-ac53-9db8f24d3c51 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057749 May 23 13:54:06.970499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 860/1641] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:07.959232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d87c820d-7325-4a3b-8f95-fe96192736c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:07.959917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d87c820d-7325-4a3b-8f95-fe96192736c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:07.966643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d87c820d-7325-4a3b-8f95-fe96192736c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:07.967102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d87c820d-7325-4a3b-8f95-fe96192736c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:07.967887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d87c820d-7325-4a3b-8f95-fe96192736c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:07.968330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d87c820d-7325-4a3b-8f95-fe96192736c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:07.982571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-08d758cd-2885-4d12-ab58-b654999d004f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:07.983532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-08d758cd-2885-4d12-ab58-b654999d004f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:07.990332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08d758cd-2885-4d12-ab58-b654999d004f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:07.990698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08d758cd-2885-4d12-ab58-b654999d004f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:07.991477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08d758cd-2885-4d12-ab58-b654999d004f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:07.992767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08d758cd-2885-4d12-ab58-b654999d004f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:08.033594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-08d758cd-2885-4d12-ab58-b654999d004f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054981 May 23 13:54:08.034236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 861/1642] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:08.037486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d87c820d-7325-4a3b-8f95-fe96192736c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:08.043818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d87c820d-7325-4a3b-8f95-fe96192736c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088518 May 23 13:54:08.044453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 782/1643] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:07 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:54:09.045798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-81e1eb99-8fa1-4389-9931-f15c917199eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:09.046725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-81e1eb99-8fa1-4389-9931-f15c917199eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:09.053251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81e1eb99-8fa1-4389-9931-f15c917199eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:09.053710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81e1eb99-8fa1-4389-9931-f15c917199eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:09.054626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81e1eb99-8fa1-4389-9931-f15c917199eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:09.055078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81e1eb99-8fa1-4389-9931-f15c917199eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:09.063206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c975694f-7db1-4642-82b3-ae4255f5c643 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:09.063838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c975694f-7db1-4642-82b3-ae4255f5c643 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:09.070381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c975694f-7db1-4642-82b3-ae4255f5c643 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:09.070833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c975694f-7db1-4642-82b3-ae4255f5c643 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:09.071588 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c975694f-7db1-4642-82b3-ae4255f5c643 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:09.072024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c975694f-7db1-4642-82b3-ae4255f5c643 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:09.072334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:09.085899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-81e1eb99-8fa1-4389-9931-f15c917199eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 May 23 13:54:09.090053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 862/1644] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:09.138111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c975694f-7db1-4642-82b3-ae4255f5c643 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:09.145759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c975694f-7db1-4642-82b3-ae4255f5c643 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086481 May 23 13:54:09.146323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 783/1645] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:09 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:54:10.098552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d8824ae4-ee84-4ad7-8967-948c12eee78a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:10.099400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d8824ae4-ee84-4ad7-8967-948c12eee78a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:10.106544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8824ae4-ee84-4ad7-8967-948c12eee78a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:10.106993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8824ae4-ee84-4ad7-8967-948c12eee78a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:10.107768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8824ae4-ee84-4ad7-8967-948c12eee78a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:10.108203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8824ae4-ee84-4ad7-8967-948c12eee78a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:10.139334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d8824ae4-ee84-4ad7-8967-948c12eee78a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 May 23 13:54:10.139912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 863/1646] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:10.163258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff964519-7e58-47b8-923f-fdadb4a62833 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:10.165085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff964519-7e58-47b8-923f-fdadb4a62833 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:10.171763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff964519-7e58-47b8-923f-fdadb4a62833 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:10.172214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff964519-7e58-47b8-923f-fdadb4a62833 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:10.173014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff964519-7e58-47b8-923f-fdadb4a62833 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:10.173453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff964519-7e58-47b8-923f-fdadb4a62833 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:10.242825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ff964519-7e58-47b8-923f-fdadb4a62833 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:10.250833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff964519-7e58-47b8-923f-fdadb4a62833 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091393 May 23 13:54:10.251413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 784/1647] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:10 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:11.152242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fef7f5d-2398-48f2-84c4-39d094ec839d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:11.153210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fef7f5d-2398-48f2-84c4-39d094ec839d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:11.160171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fef7f5d-2398-48f2-84c4-39d094ec839d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:11.160647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fef7f5d-2398-48f2-84c4-39d094ec839d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:11.161440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fef7f5d-2398-48f2-84c4-39d094ec839d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:11.161880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fef7f5d-2398-48f2-84c4-39d094ec839d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:11.195369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fef7f5d-2398-48f2-84c4-39d094ec839d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046884 May 23 13:54:11.195642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 864/1648] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:11.269171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8685fc03-839b-42dd-994b-8d43a5e357cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:11.269827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8685fc03-839b-42dd-994b-8d43a5e357cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:11.277038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8685fc03-839b-42dd-994b-8d43a5e357cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:11.277516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8685fc03-839b-42dd-994b-8d43a5e357cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:11.278321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8685fc03-839b-42dd-994b-8d43a5e357cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:11.278805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8685fc03-839b-42dd-994b-8d43a5e357cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:11.357529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8685fc03-839b-42dd-994b-8d43a5e357cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:11.365543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8685fc03-839b-42dd-994b-8d43a5e357cf tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.100117 May 23 13:54:11.366121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 785/1649] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:11 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:12.207498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3472061e-0a85-4c5b-a855-8863ad781acb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:12.208406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3472061e-0a85-4c5b-a855-8863ad781acb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:12.215025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3472061e-0a85-4c5b-a855-8863ad781acb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:12.215492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3472061e-0a85-4c5b-a855-8863ad781acb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:12.216248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3472061e-0a85-4c5b-a855-8863ad781acb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:12.216754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3472061e-0a85-4c5b-a855-8863ad781acb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:12.248320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3472061e-0a85-4c5b-a855-8863ad781acb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 May 23 13:54:12.248943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 865/1650] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:12.386470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-de53f3ef-5c1c-4e65-864d-8e31b8044990 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:12.387149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-de53f3ef-5c1c-4e65-864d-8e31b8044990 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:12.393975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de53f3ef-5c1c-4e65-864d-8e31b8044990 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:12.394428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de53f3ef-5c1c-4e65-864d-8e31b8044990 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:12.395218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de53f3ef-5c1c-4e65-864d-8e31b8044990 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:12.395651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de53f3ef-5c1c-4e65-864d-8e31b8044990 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:12.400379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:12.460872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-de53f3ef-5c1c-4e65-864d-8e31b8044990 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:12.468700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-de53f3ef-5c1c-4e65-864d-8e31b8044990 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088226 May 23 13:54:12.469298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 786/1651] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:12 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:13.260224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b548d05b-0ec0-447e-b4f7-cdf5a34bcf87 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:13.261176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b548d05b-0ec0-447e-b4f7-cdf5a34bcf87 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:13.268015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b548d05b-0ec0-447e-b4f7-cdf5a34bcf87 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:13.268464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b548d05b-0ec0-447e-b4f7-cdf5a34bcf87 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:13.269272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b548d05b-0ec0-447e-b4f7-cdf5a34bcf87 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:13.269711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b548d05b-0ec0-447e-b4f7-cdf5a34bcf87 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:13.301284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b548d05b-0ec0-447e-b4f7-cdf5a34bcf87 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 May 23 13:54:13.301871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 866/1652] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:13.486665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-529a7b3d-8fdd-4597-9b6c-72c12a7d05d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:13.487209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-529a7b3d-8fdd-4597-9b6c-72c12a7d05d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:13.494519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-529a7b3d-8fdd-4597-9b6c-72c12a7d05d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:13.494964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-529a7b3d-8fdd-4597-9b6c-72c12a7d05d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:13.495731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-529a7b3d-8fdd-4597-9b6c-72c12a7d05d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:13.496157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-529a7b3d-8fdd-4597-9b6c-72c12a7d05d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:13.559202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-529a7b3d-8fdd-4597-9b6c-72c12a7d05d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:13.566925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-529a7b3d-8fdd-4597-9b6c-72c12a7d05d5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084191 May 23 13:54:13.567500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 787/1653] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:13 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:14.313563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0da6844e-c6c2-4fcb-9b48-83194b81b3d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:14.314561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0da6844e-c6c2-4fcb-9b48-83194b81b3d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:14.322089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0da6844e-c6c2-4fcb-9b48-83194b81b3d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:14.322543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0da6844e-c6c2-4fcb-9b48-83194b81b3d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:14.323318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0da6844e-c6c2-4fcb-9b48-83194b81b3d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:14.323761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0da6844e-c6c2-4fcb-9b48-83194b81b3d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:14.353959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0da6844e-c6c2-4fcb-9b48-83194b81b3d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 May 23 13:54:14.354525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 867/1654] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:14.586027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65a17652-97d6-437d-8750-9aa5c1a39d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:14.586576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65a17652-97d6-437d-8750-9aa5c1a39d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:14.593139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65a17652-97d6-437d-8750-9aa5c1a39d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:14.593584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65a17652-97d6-437d-8750-9aa5c1a39d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:14.594348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65a17652-97d6-437d-8750-9aa5c1a39d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:14.594772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65a17652-97d6-437d-8750-9aa5c1a39d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:14.657460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65a17652-97d6-437d-8750-9aa5c1a39d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:14.665810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65a17652-97d6-437d-8750-9aa5c1a39d8e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083865 May 23 13:54:14.666383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 788/1655] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:14 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:15.364758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52678e33-c748-455d-b76f-addb7f014ab1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:15.365802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52678e33-c748-455d-b76f-addb7f014ab1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:15.372419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52678e33-c748-455d-b76f-addb7f014ab1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:15.372910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52678e33-c748-455d-b76f-addb7f014ab1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:15.373693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52678e33-c748-455d-b76f-addb7f014ab1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:15.374141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52678e33-c748-455d-b76f-addb7f014ab1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:15.406098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52678e33-c748-455d-b76f-addb7f014ab1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 May 23 13:54:15.406672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 868/1656] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:15.683448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23746ceb-dbcc-4ffb-8813-f2de38cbcf91 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:15.683994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-23746ceb-dbcc-4ffb-8813-f2de38cbcf91 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:15.690610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23746ceb-dbcc-4ffb-8813-f2de38cbcf91 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:15.691054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23746ceb-dbcc-4ffb-8813-f2de38cbcf91 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:15.691835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23746ceb-dbcc-4ffb-8813-f2de38cbcf91 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:15.692241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23746ceb-dbcc-4ffb-8813-f2de38cbcf91 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:15.760558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-23746ceb-dbcc-4ffb-8813-f2de38cbcf91 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:15.768321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23746ceb-dbcc-4ffb-8813-f2de38cbcf91 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088923 May 23 13:54:15.768916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 789/1657] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:15 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:16.418941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fd342a2c-c002-43c0-b9e1-c01adaaa13eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:16.419885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fd342a2c-c002-43c0-b9e1-c01adaaa13eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:16.427079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd342a2c-c002-43c0-b9e1-c01adaaa13eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:16.427529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd342a2c-c002-43c0-b9e1-c01adaaa13eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:16.428312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd342a2c-c002-43c0-b9e1-c01adaaa13eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:16.429791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd342a2c-c002-43c0-b9e1-c01adaaa13eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:16.461417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fd342a2c-c002-43c0-b9e1-c01adaaa13eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 May 23 13:54:16.461925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 869/1658] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:16 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:16.785462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-778dfc25-9a86-4f26-842d-b44ed10b83a7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:16.786010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-778dfc25-9a86-4f26-842d-b44ed10b83a7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:16.793783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778dfc25-9a86-4f26-842d-b44ed10b83a7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:16.794239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778dfc25-9a86-4f26-842d-b44ed10b83a7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:16.795017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778dfc25-9a86-4f26-842d-b44ed10b83a7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:16.795456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778dfc25-9a86-4f26-842d-b44ed10b83a7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:16.863069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-778dfc25-9a86-4f26-842d-b44ed10b83a7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:16.871729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-778dfc25-9a86-4f26-842d-b44ed10b83a7 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090173 May 23 13:54:16.872312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 790/1659] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:16 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:17.473509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e286373-14be-48ea-aaa5-20b3fbc56e6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:17.474359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e286373-14be-48ea-aaa5-20b3fbc56e6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:17.481790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e286373-14be-48ea-aaa5-20b3fbc56e6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:17.482249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e286373-14be-48ea-aaa5-20b3fbc56e6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:17.483028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e286373-14be-48ea-aaa5-20b3fbc56e6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:17.483472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e286373-14be-48ea-aaa5-20b3fbc56e6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:17.517019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e286373-14be-48ea-aaa5-20b3fbc56e6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047473 May 23 13:54:17.517603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 870/1660] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:17.889390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e48d122-9a54-4e50-a499-5efa5a9bb144 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:17.890048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e48d122-9a54-4e50-a499-5efa5a9bb144 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:17.897010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e48d122-9a54-4e50-a499-5efa5a9bb144 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:17.897516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e48d122-9a54-4e50-a499-5efa5a9bb144 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:17.898547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e48d122-9a54-4e50-a499-5efa5a9bb144 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:17.898989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e48d122-9a54-4e50-a499-5efa5a9bb144 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:17.968875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0e48d122-9a54-4e50-a499-5efa5a9bb144 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:17.973905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e48d122-9a54-4e50-a499-5efa5a9bb144 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088396 May 23 13:54:17.974489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 791/1661] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:17 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:18.529286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0433831e-8b9a-4d4c-9425-ad927932c14c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:18.530157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0433831e-8b9a-4d4c-9425-ad927932c14c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:18.532684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=60 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:18.537829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0433831e-8b9a-4d4c-9425-ad927932c14c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:18.538861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0433831e-8b9a-4d4c-9425-ad927932c14c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:18.539073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0433831e-8b9a-4d4c-9425-ad927932c14c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:18.539516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0433831e-8b9a-4d4c-9425-ad927932c14c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:18.572513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0433831e-8b9a-4d4c-9425-ad927932c14c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047367 May 23 13:54:18.573140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 871/1662] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:18.993767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7e8d62a-07d4-4b14-b448-e53ad003efa9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:18.994522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7e8d62a-07d4-4b14-b448-e53ad003efa9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:19.001476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7e8d62a-07d4-4b14-b448-e53ad003efa9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:19.001928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7e8d62a-07d4-4b14-b448-e53ad003efa9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:19.002708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7e8d62a-07d4-4b14-b448-e53ad003efa9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:19.003149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7e8d62a-07d4-4b14-b448-e53ad003efa9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:19.071825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7e8d62a-07d4-4b14-b448-e53ad003efa9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:19.079878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7e8d62a-07d4-4b14-b448-e53ad003efa9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091578 May 23 13:54:19.080451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 792/1663] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:18 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:19.585607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-da1f76de-6814-4c77-8849-4a48c4fe39f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:19.586536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-da1f76de-6814-4c77-8849-4a48c4fe39f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:19.593248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da1f76de-6814-4c77-8849-4a48c4fe39f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:19.593691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da1f76de-6814-4c77-8849-4a48c4fe39f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:19.594461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da1f76de-6814-4c77-8849-4a48c4fe39f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:19.594889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da1f76de-6814-4c77-8849-4a48c4fe39f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:19.625720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-da1f76de-6814-4c77-8849-4a48c4fe39f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 May 23 13:54:19.626280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 872/1664] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:20.097295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5df4a205-bc8b-449c-a835-f0e72adaccb5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:20.097930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5df4a205-bc8b-449c-a835-f0e72adaccb5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:20.104660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5df4a205-bc8b-449c-a835-f0e72adaccb5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:20.105109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5df4a205-bc8b-449c-a835-f0e72adaccb5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:20.105877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5df4a205-bc8b-449c-a835-f0e72adaccb5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:20.106313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5df4a205-bc8b-449c-a835-f0e72adaccb5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:20.170879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5df4a205-bc8b-449c-a835-f0e72adaccb5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:20.178961 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5df4a205-bc8b-449c-a835-f0e72adaccb5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085558 May 23 13:54:20.179659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 793/1665] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:20 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:20.638350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef2af9a6-3eb2-4c0b-80b6-7516f0929072 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:20.639338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef2af9a6-3eb2-4c0b-80b6-7516f0929072 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:20.645816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2af9a6-3eb2-4c0b-80b6-7516f0929072 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:20.646271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2af9a6-3eb2-4c0b-80b6-7516f0929072 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:20.647041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2af9a6-3eb2-4c0b-80b6-7516f0929072 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:20.647566 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2af9a6-3eb2-4c0b-80b6-7516f0929072 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:20.677322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef2af9a6-3eb2-4c0b-80b6-7516f0929072 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042980 May 23 13:54:20.677878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 873/1666] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:21.197750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b4f9b70-c68e-4645-87dd-5a1dd5d05b55 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:21.198505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b4f9b70-c68e-4645-87dd-5a1dd5d05b55 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:21.200894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=56 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:21.206070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b4f9b70-c68e-4645-87dd-5a1dd5d05b55 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:21.206520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b4f9b70-c68e-4645-87dd-5a1dd5d05b55 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:21.207585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b4f9b70-c68e-4645-87dd-5a1dd5d05b55 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:21.208020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b4f9b70-c68e-4645-87dd-5a1dd5d05b55 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:21.274557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b4f9b70-c68e-4645-87dd-5a1dd5d05b55 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:21.282632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b4f9b70-c68e-4645-87dd-5a1dd5d05b55 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090086 May 23 13:54:21.283202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 794/1667] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:21 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:21.690195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-136398ae-d39f-4bd0-88c3-2e06a87e47b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:21.691151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-136398ae-d39f-4bd0-88c3-2e06a87e47b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:21.698153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-136398ae-d39f-4bd0-88c3-2e06a87e47b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:21.698610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-136398ae-d39f-4bd0-88c3-2e06a87e47b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:21.699391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-136398ae-d39f-4bd0-88c3-2e06a87e47b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:21.699834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-136398ae-d39f-4bd0-88c3-2e06a87e47b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:21.730660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-136398ae-d39f-4bd0-88c3-2e06a87e47b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 May 23 13:54:21.731246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 874/1668] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:22.299623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b6f3ecc1-abbd-4378-b0ec-3c25c2dfeb68 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:22.300266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b6f3ecc1-abbd-4378-b0ec-3c25c2dfeb68 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:22.307180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6f3ecc1-abbd-4378-b0ec-3c25c2dfeb68 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:22.307626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6f3ecc1-abbd-4378-b0ec-3c25c2dfeb68 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:22.308378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6f3ecc1-abbd-4378-b0ec-3c25c2dfeb68 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:22.308833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6f3ecc1-abbd-4378-b0ec-3c25c2dfeb68 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:22.371744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6f3ecc1-abbd-4378-b0ec-3c25c2dfeb68 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:22.379300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b6f3ecc1-abbd-4378-b0ec-3c25c2dfeb68 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083679 May 23 13:54:22.379855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 795/1669] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:22 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:22.743232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-43d0de6a-1d89-47a3-83c0-878c2e8e8269 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:22.744061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-43d0de6a-1d89-47a3-83c0-878c2e8e8269 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:22.750618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43d0de6a-1d89-47a3-83c0-878c2e8e8269 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:22.751067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43d0de6a-1d89-47a3-83c0-878c2e8e8269 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:22.751830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43d0de6a-1d89-47a3-83c0-878c2e8e8269 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:22.752265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43d0de6a-1d89-47a3-83c0-878c2e8e8269 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:22.784259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-43d0de6a-1d89-47a3-83c0-878c2e8e8269 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045611 May 23 13:54:22.784880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 875/1670] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:23.398389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9d59b8f4-a74c-4a68-9f5a-f9069af836c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:23.399169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9d59b8f4-a74c-4a68-9f5a-f9069af836c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:23.407515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d59b8f4-a74c-4a68-9f5a-f9069af836c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:23.407969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d59b8f4-a74c-4a68-9f5a-f9069af836c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:23.408804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d59b8f4-a74c-4a68-9f5a-f9069af836c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:23.409248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d59b8f4-a74c-4a68-9f5a-f9069af836c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:23.477991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d59b8f4-a74c-4a68-9f5a-f9069af836c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:23.486155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9d59b8f4-a74c-4a68-9f5a-f9069af836c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092361 May 23 13:54:23.486749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 796/1671] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:23 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:23.797018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-169d3123-6a7c-44d5-ba90-601e7e14d4d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:23.797974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-169d3123-6a7c-44d5-ba90-601e7e14d4d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:23.805549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-169d3123-6a7c-44d5-ba90-601e7e14d4d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:23.806340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-169d3123-6a7c-44d5-ba90-601e7e14d4d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:23.807157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-169d3123-6a7c-44d5-ba90-601e7e14d4d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:23.807600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-169d3123-6a7c-44d5-ba90-601e7e14d4d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:23.852123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-169d3123-6a7c-44d5-ba90-601e7e14d4d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059162 May 23 13:54:23.852786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 876/1672] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:24.511503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf82575c-96a0-4593-8cfb-65363ed55f2c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:24.512066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf82575c-96a0-4593-8cfb-65363ed55f2c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:24.518905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf82575c-96a0-4593-8cfb-65363ed55f2c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:24.519347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf82575c-96a0-4593-8cfb-65363ed55f2c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:24.520123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf82575c-96a0-4593-8cfb-65363ed55f2c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:24.520554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf82575c-96a0-4593-8cfb-65363ed55f2c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:24.593278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bf82575c-96a0-4593-8cfb-65363ed55f2c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:24.604812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf82575c-96a0-4593-8cfb-65363ed55f2c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.097254 May 23 13:54:24.606193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 797/1673] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:24 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:24.863543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1cab39a4-49e7-459b-bbe4-cfad9196ad1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:24.864474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1cab39a4-49e7-459b-bbe4-cfad9196ad1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:24.871536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1cab39a4-49e7-459b-bbe4-cfad9196ad1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:24.871987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1cab39a4-49e7-459b-bbe4-cfad9196ad1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:24.872802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1cab39a4-49e7-459b-bbe4-cfad9196ad1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:24.873247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1cab39a4-49e7-459b-bbe4-cfad9196ad1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:24.905211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1cab39a4-49e7-459b-bbe4-cfad9196ad1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 May 23 13:54:24.905801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 877/1674] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:25.623341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65c88aa4-63c7-40b2-9640-4b890ed87e5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:25.623972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65c88aa4-63c7-40b2-9640-4b890ed87e5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:25.631979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65c88aa4-63c7-40b2-9640-4b890ed87e5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:25.632540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65c88aa4-63c7-40b2-9640-4b890ed87e5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:25.632970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65c88aa4-63c7-40b2-9640-4b890ed87e5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:25.633402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65c88aa4-63c7-40b2-9640-4b890ed87e5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:25.703632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65c88aa4-63c7-40b2-9640-4b890ed87e5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:25.712727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65c88aa4-63c7-40b2-9640-4b890ed87e5e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093626 May 23 13:54:25.713288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 798/1675] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:25 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:25.917796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e484063b-b724-4d2b-b328-c51b681628d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:25.918767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e484063b-b724-4d2b-b328-c51b681628d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:25.926045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e484063b-b724-4d2b-b328-c51b681628d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:25.926499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e484063b-b724-4d2b-b328-c51b681628d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:25.927322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e484063b-b724-4d2b-b328-c51b681628d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:25.927760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e484063b-b724-4d2b-b328-c51b681628d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:25.962152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e484063b-b724-4d2b-b328-c51b681628d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048524 May 23 13:54:25.962755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 878/1676] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:26.729835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2c3ce7a4-b3f4-42dd-be78-78f781d2dc01 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:26.730608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2c3ce7a4-b3f4-42dd-be78-78f781d2dc01 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:26.737208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c3ce7a4-b3f4-42dd-be78-78f781d2dc01 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:26.737653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c3ce7a4-b3f4-42dd-be78-78f781d2dc01 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:26.738413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c3ce7a4-b3f4-42dd-be78-78f781d2dc01 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:26.738846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c3ce7a4-b3f4-42dd-be78-78f781d2dc01 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:26.807610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2c3ce7a4-b3f4-42dd-be78-78f781d2dc01 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:26.821839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2c3ce7a4-b3f4-42dd-be78-78f781d2dc01 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.095932 May 23 13:54:26.822428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 799/1677] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:26 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:26.974048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1f3c027-8ddc-4135-bd4f-42e4cb64184d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:26.975020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1f3c027-8ddc-4135-bd4f-42e4cb64184d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:26.982089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1f3c027-8ddc-4135-bd4f-42e4cb64184d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:26.982499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1f3c027-8ddc-4135-bd4f-42e4cb64184d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:26.983286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1f3c027-8ddc-4135-bd4f-42e4cb64184d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:26.983734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1f3c027-8ddc-4135-bd4f-42e4cb64184d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:26.987782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:27.015452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1f3c027-8ddc-4135-bd4f-42e4cb64184d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 May 23 13:54:27.016041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 879/1678] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:27.840137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4bc095c8-20f2-4abc-862c-5c226f08a484 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:27.840785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4bc095c8-20f2-4abc-862c-5c226f08a484 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:27.847405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bc095c8-20f2-4abc-862c-5c226f08a484 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:27.847856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bc095c8-20f2-4abc-862c-5c226f08a484 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:27.848665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bc095c8-20f2-4abc-862c-5c226f08a484 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:27.849102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bc095c8-20f2-4abc-862c-5c226f08a484 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:27.915067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4bc095c8-20f2-4abc-862c-5c226f08a484 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:27.923341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4bc095c8-20f2-4abc-862c-5c226f08a484 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086985 May 23 13:54:27.923946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 800/1679] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:27 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:54:28.027158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4019bbdf-9b2d-4dbe-8539-1c044273fb73 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:28.028002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4019bbdf-9b2d-4dbe-8539-1c044273fb73 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:28.036130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4019bbdf-9b2d-4dbe-8539-1c044273fb73 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:28.036618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4019bbdf-9b2d-4dbe-8539-1c044273fb73 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:28.037984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4019bbdf-9b2d-4dbe-8539-1c044273fb73 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:28.038467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4019bbdf-9b2d-4dbe-8539-1c044273fb73 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:28.068510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4019bbdf-9b2d-4dbe-8539-1c044273fb73 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 May 23 13:54:28.069198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 880/1680] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:28.940955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7fc38f98-8005-45bb-82ae-9f0e6c9e6b47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:28.941513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7fc38f98-8005-45bb-82ae-9f0e6c9e6b47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:28.949146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc38f98-8005-45bb-82ae-9f0e6c9e6b47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:28.949598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc38f98-8005-45bb-82ae-9f0e6c9e6b47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:28.950379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc38f98-8005-45bb-82ae-9f0e6c9e6b47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:28.950819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc38f98-8005-45bb-82ae-9f0e6c9e6b47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:29.023510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7fc38f98-8005-45bb-82ae-9f0e6c9e6b47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:29.031816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7fc38f98-8005-45bb-82ae-9f0e6c9e6b47 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.094891 May 23 13:54:29.032400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 801/1681] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:28 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:29.080084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b381de11-fd11-419a-a380-a1aa4f9b97a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:29.081161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b381de11-fd11-419a-a380-a1aa4f9b97a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:29.089050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b381de11-fd11-419a-a380-a1aa4f9b97a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:29.089505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b381de11-fd11-419a-a380-a1aa4f9b97a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:29.090289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b381de11-fd11-419a-a380-a1aa4f9b97a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:29.090734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b381de11-fd11-419a-a380-a1aa4f9b97a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:29.125120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b381de11-fd11-419a-a380-a1aa4f9b97a0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049180 May 23 13:54:29.125701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 881/1682] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:30.049984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dacb525a-f900-4b35-8ffe-c2092882b735 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:30.050532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dacb525a-f900-4b35-8ffe-c2092882b735 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:30.056982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dacb525a-f900-4b35-8ffe-c2092882b735 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:30.057430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dacb525a-f900-4b35-8ffe-c2092882b735 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:30.058194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dacb525a-f900-4b35-8ffe-c2092882b735 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:30.058631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dacb525a-f900-4b35-8ffe-c2092882b735 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:30.121741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dacb525a-f900-4b35-8ffe-c2092882b735 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:30.125181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:30.129543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dacb525a-f900-4b35-8ffe-c2092882b735 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083571 May 23 13:54:30.130148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 802/1683] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:30 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:30.137100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a7ecd8c-ef8e-4bae-a476-17be8d726a89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:30.138239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a7ecd8c-ef8e-4bae-a476-17be8d726a89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:30.144728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a7ecd8c-ef8e-4bae-a476-17be8d726a89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:30.145174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a7ecd8c-ef8e-4bae-a476-17be8d726a89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:30.145928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a7ecd8c-ef8e-4bae-a476-17be8d726a89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:30.146953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a7ecd8c-ef8e-4bae-a476-17be8d726a89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:30.178546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a7ecd8c-ef8e-4bae-a476-17be8d726a89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 May 23 13:54:30.179115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 882/1684] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:31.153285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f7bd8bb-d5db-4125-a369-911493237503 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:31.153904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f7bd8bb-d5db-4125-a369-911493237503 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:31.160464 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f7bd8bb-d5db-4125-a369-911493237503 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:31.160941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f7bd8bb-d5db-4125-a369-911493237503 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:31.161703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f7bd8bb-d5db-4125-a369-911493237503 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:31.162643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f7bd8bb-d5db-4125-a369-911493237503 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:31.191530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c61d09c7-fcfd-4d50-8b6b-9a93035a76b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:31.192446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c61d09c7-fcfd-4d50-8b6b-9a93035a76b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:31.201389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c61d09c7-fcfd-4d50-8b6b-9a93035a76b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:31.201813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c61d09c7-fcfd-4d50-8b6b-9a93035a76b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:31.202581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c61d09c7-fcfd-4d50-8b6b-9a93035a76b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:31.203283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c61d09c7-fcfd-4d50-8b6b-9a93035a76b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:31.226744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8f7bd8bb-d5db-4125-a369-911493237503 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:31.233964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c61d09c7-fcfd-4d50-8b6b-9a93035a76b0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046404 May 23 13:54:31.234203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f7bd8bb-d5db-4125-a369-911493237503 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085209 May 23 13:54:31.234522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 883/1685] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:31.234762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 803/1686] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:31 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:32.246293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a27aea4-f77b-45d1-abfe-b3124d5de4da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:32.247236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a27aea4-f77b-45d1-abfe-b3124d5de4da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:32.251132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dbeb7d32-4e60-438d-a374-6d5748fd3522 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:32.251749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dbeb7d32-4e60-438d-a374-6d5748fd3522 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:32.253951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a27aea4-f77b-45d1-abfe-b3124d5de4da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:32.254400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a27aea4-f77b-45d1-abfe-b3124d5de4da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:32.255176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a27aea4-f77b-45d1-abfe-b3124d5de4da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:32.255608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a27aea4-f77b-45d1-abfe-b3124d5de4da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:32.259036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbeb7d32-4e60-438d-a374-6d5748fd3522 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:32.259486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbeb7d32-4e60-438d-a374-6d5748fd3522 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:32.260267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbeb7d32-4e60-438d-a374-6d5748fd3522 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:32.260741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbeb7d32-4e60-438d-a374-6d5748fd3522 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:32.286427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a27aea4-f77b-45d1-abfe-b3124d5de4da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 May 23 13:54:32.287045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 884/1687] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:32 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:32.327873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbeb7d32-4e60-438d-a374-6d5748fd3522 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:32.335579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dbeb7d32-4e60-438d-a374-6d5748fd3522 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088364 May 23 13:54:32.336156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 804/1688] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:32 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:54:33.300188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-639a2804-312e-4422-a982-f766262a403c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:33.301421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-639a2804-312e-4422-a982-f766262a403c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:33.308959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-639a2804-312e-4422-a982-f766262a403c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:33.309409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-639a2804-312e-4422-a982-f766262a403c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:33.310185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-639a2804-312e-4422-a982-f766262a403c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:33.310616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-639a2804-312e-4422-a982-f766262a403c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:33.343545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-639a2804-312e-4422-a982-f766262a403c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047472 May 23 13:54:33.344105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 885/1689] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:33.354160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-27390b67-c7ad-4f55-9423-725ca873dc51 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:33.354767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-27390b67-c7ad-4f55-9423-725ca873dc51 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:33.361411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27390b67-c7ad-4f55-9423-725ca873dc51 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:33.361929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27390b67-c7ad-4f55-9423-725ca873dc51 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:33.362708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27390b67-c7ad-4f55-9423-725ca873dc51 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:33.363151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27390b67-c7ad-4f55-9423-725ca873dc51 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:33.444332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27390b67-c7ad-4f55-9423-725ca873dc51 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:33.449581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-27390b67-c7ad-4f55-9423-725ca873dc51 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.099118 May 23 13:54:33.450187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 805/1690] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:33 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:34.367164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a6cff43c-ffdf-40b3-94a8-d9cf9e8572b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:34.368252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a6cff43c-ffdf-40b3-94a8-d9cf9e8572b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:34.375267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6cff43c-ffdf-40b3-94a8-d9cf9e8572b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:34.375792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6cff43c-ffdf-40b3-94a8-d9cf9e8572b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:34.376611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6cff43c-ffdf-40b3-94a8-d9cf9e8572b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:34.377122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6cff43c-ffdf-40b3-94a8-d9cf9e8572b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:34.410135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a6cff43c-ffdf-40b3-94a8-d9cf9e8572b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055552 May 23 13:54:34.410959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 886/1691] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:34.466691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1423dba1-7f3a-4a9a-b510-ab7c48303e31 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:34.467641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1423dba1-7f3a-4a9a-b510-ab7c48303e31 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:34.474155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1423dba1-7f3a-4a9a-b510-ab7c48303e31 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:34.475583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1423dba1-7f3a-4a9a-b510-ab7c48303e31 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:34.476373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1423dba1-7f3a-4a9a-b510-ab7c48303e31 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:34.476829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1423dba1-7f3a-4a9a-b510-ab7c48303e31 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:34.547860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1423dba1-7f3a-4a9a-b510-ab7c48303e31 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:34.555438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1423dba1-7f3a-4a9a-b510-ab7c48303e31 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092779 May 23 13:54:34.556008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 806/1692] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:34 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:35.422359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d879e14a-e850-4179-b8b3-51b165e7c76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:35.423310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d879e14a-e850-4179-b8b3-51b165e7c76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:35.429817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d879e14a-e850-4179-b8b3-51b165e7c76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:35.430268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d879e14a-e850-4179-b8b3-51b165e7c76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:35.431033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d879e14a-e850-4179-b8b3-51b165e7c76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:35.431468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d879e14a-e850-4179-b8b3-51b165e7c76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:35.460901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d879e14a-e850-4179-b8b3-51b165e7c76b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042345 May 23 13:54:35.461387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 887/1693] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:35.572892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f450297-aa78-4b7c-b159-ecaf48d7712e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:35.573508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f450297-aa78-4b7c-b159-ecaf48d7712e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:35.580229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f450297-aa78-4b7c-b159-ecaf48d7712e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:35.580716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f450297-aa78-4b7c-b159-ecaf48d7712e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:35.581490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f450297-aa78-4b7c-b159-ecaf48d7712e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:35.581929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f450297-aa78-4b7c-b159-ecaf48d7712e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:35.649135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f450297-aa78-4b7c-b159-ecaf48d7712e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:35.657005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f450297-aa78-4b7c-b159-ecaf48d7712e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088051 May 23 13:54:35.657593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 807/1694] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:35 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:36.472616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ba78f61e-28a3-40f7-a88d-bfeaa591eaf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:36.473450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ba78f61e-28a3-40f7-a88d-bfeaa591eaf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:36.479921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba78f61e-28a3-40f7-a88d-bfeaa591eaf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:36.480372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba78f61e-28a3-40f7-a88d-bfeaa591eaf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:36.481177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba78f61e-28a3-40f7-a88d-bfeaa591eaf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:36.481612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba78f61e-28a3-40f7-a88d-bfeaa591eaf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:36.512472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ba78f61e-28a3-40f7-a88d-bfeaa591eaf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 May 23 13:54:36.513081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 888/1695] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:36.682089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eb95a765-b2fa-4be5-aefd-c6ca6b2b8892 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:36.682705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eb95a765-b2fa-4be5-aefd-c6ca6b2b8892 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:36.689306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb95a765-b2fa-4be5-aefd-c6ca6b2b8892 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:36.689764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb95a765-b2fa-4be5-aefd-c6ca6b2b8892 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:36.690536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb95a765-b2fa-4be5-aefd-c6ca6b2b8892 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:36.690976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb95a765-b2fa-4be5-aefd-c6ca6b2b8892 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:36.755549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eb95a765-b2fa-4be5-aefd-c6ca6b2b8892 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:36.768189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eb95a765-b2fa-4be5-aefd-c6ca6b2b8892 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090268 May 23 13:54:36.768816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 808/1696] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:36 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:37.524291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c5dec95-1e4d-47db-85c8-6cd4a213dbfa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:37.525155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c5dec95-1e4d-47db-85c8-6cd4a213dbfa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:37.531685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c5dec95-1e4d-47db-85c8-6cd4a213dbfa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:37.532142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c5dec95-1e4d-47db-85c8-6cd4a213dbfa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:37.532948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c5dec95-1e4d-47db-85c8-6cd4a213dbfa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:37.533393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c5dec95-1e4d-47db-85c8-6cd4a213dbfa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:37.566133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c5dec95-1e4d-47db-85c8-6cd4a213dbfa tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 May 23 13:54:37.566713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 889/1697] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:37.787134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ea2b27d-fab5-434e-8e49-c344cec5a10b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:37.788307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ea2b27d-fab5-434e-8e49-c344cec5a10b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:37.795096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ea2b27d-fab5-434e-8e49-c344cec5a10b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:37.795547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ea2b27d-fab5-434e-8e49-c344cec5a10b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:37.796332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ea2b27d-fab5-434e-8e49-c344cec5a10b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:37.796879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ea2b27d-fab5-434e-8e49-c344cec5a10b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:37.861014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ea2b27d-fab5-434e-8e49-c344cec5a10b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:37.869378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ea2b27d-fab5-434e-8e49-c344cec5a10b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086169 May 23 13:54:37.869963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 809/1698] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:37 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:38.578026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df60185e-b046-479f-88fc-af2416d6a125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:38.578859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df60185e-b046-479f-88fc-af2416d6a125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:38.586153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df60185e-b046-479f-88fc-af2416d6a125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:38.586596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df60185e-b046-479f-88fc-af2416d6a125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:38.587360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df60185e-b046-479f-88fc-af2416d6a125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:38.587796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df60185e-b046-479f-88fc-af2416d6a125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:38.617401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df60185e-b046-479f-88fc-af2416d6a125 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 May 23 13:54:38.617959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 890/1699] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:38.886738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36890b17-476c-4161-b036-37e7d7f91d99 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:38.894289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36890b17-476c-4161-b036-37e7d7f91d99 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:38.894289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36890b17-476c-4161-b036-37e7d7f91d99 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:38.894546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36890b17-476c-4161-b036-37e7d7f91d99 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:38.895209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36890b17-476c-4161-b036-37e7d7f91d99 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:38.895639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36890b17-476c-4161-b036-37e7d7f91d99 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:38.963516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36890b17-476c-4161-b036-37e7d7f91d99 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:38.972497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36890b17-476c-4161-b036-37e7d7f91d99 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.089159 May 23 13:54:38.978295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 810/1700] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:38 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:39.632428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b74ae243-2a42-4a42-910e-80568136c060 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:39.634477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b74ae243-2a42-4a42-910e-80568136c060 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:39.642767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74ae243-2a42-4a42-910e-80568136c060 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:39.643221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74ae243-2a42-4a42-910e-80568136c060 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:39.644031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74ae243-2a42-4a42-910e-80568136c060 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:39.644464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74ae243-2a42-4a42-910e-80568136c060 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:39.695175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b74ae243-2a42-4a42-910e-80568136c060 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070072 May 23 13:54:39.695769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 891/1701] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:39.991428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1ff1d0dd-03bb-4433-9a06-784cdb5cfbd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:39.991997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1ff1d0dd-03bb-4433-9a06-784cdb5cfbd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:40.000180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ff1d0dd-03bb-4433-9a06-784cdb5cfbd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:40.000936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ff1d0dd-03bb-4433-9a06-784cdb5cfbd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:40.001892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ff1d0dd-03bb-4433-9a06-784cdb5cfbd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:40.002326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ff1d0dd-03bb-4433-9a06-784cdb5cfbd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:40.084508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ff1d0dd-03bb-4433-9a06-784cdb5cfbd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:40.092867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1ff1d0dd-03bb-4433-9a06-784cdb5cfbd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.106148 May 23 13:54:40.093448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 811/1702] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:39 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:40.710804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dcd0a0d9-56da-42b1-b5ca-b56cc59f6716 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:40.711727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dcd0a0d9-56da-42b1-b5ca-b56cc59f6716 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:40.718216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dcd0a0d9-56da-42b1-b5ca-b56cc59f6716 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:40.718670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dcd0a0d9-56da-42b1-b5ca-b56cc59f6716 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:40.719436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dcd0a0d9-56da-42b1-b5ca-b56cc59f6716 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:40.719870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dcd0a0d9-56da-42b1-b5ca-b56cc59f6716 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:40.749824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dcd0a0d9-56da-42b1-b5ca-b56cc59f6716 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 May 23 13:54:40.750433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 892/1703] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:41.110906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7765eadc-7b70-4ccb-8493-e8f775f9c556 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:41.111517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7765eadc-7b70-4ccb-8493-e8f775f9c556 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:41.118746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7765eadc-7b70-4ccb-8493-e8f775f9c556 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:41.119196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7765eadc-7b70-4ccb-8493-e8f775f9c556 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:41.119960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7765eadc-7b70-4ccb-8493-e8f775f9c556 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:41.120399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7765eadc-7b70-4ccb-8493-e8f775f9c556 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:41.186503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7765eadc-7b70-4ccb-8493-e8f775f9c556 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:41.194648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7765eadc-7b70-4ccb-8493-e8f775f9c556 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087338 May 23 13:54:41.194991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 812/1704] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:41 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:41.761954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8dfd85f-d789-46a2-abf5-8847eb01535e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:41.762888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8dfd85f-d789-46a2-abf5-8847eb01535e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:41.769333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dfd85f-d789-46a2-abf5-8847eb01535e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:41.769831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dfd85f-d789-46a2-abf5-8847eb01535e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:41.770555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dfd85f-d789-46a2-abf5-8847eb01535e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:41.770992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8dfd85f-d789-46a2-abf5-8847eb01535e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:41.800353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8dfd85f-d789-46a2-abf5-8847eb01535e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042337 May 23 13:54:41.800942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 893/1705] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:42.211793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c60c1d1f-e165-467a-9745-3f3f4f7057a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:42.212408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c60c1d1f-e165-467a-9745-3f3f4f7057a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:42.218959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c60c1d1f-e165-467a-9745-3f3f4f7057a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:42.219415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c60c1d1f-e165-467a-9745-3f3f4f7057a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:42.220180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c60c1d1f-e165-467a-9745-3f3f4f7057a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:42.220650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c60c1d1f-e165-467a-9745-3f3f4f7057a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:42.282878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c60c1d1f-e165-467a-9745-3f3f4f7057a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:42.291158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c60c1d1f-e165-467a-9745-3f3f4f7057a5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083753 May 23 13:54:42.291735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 813/1706] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:42 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:42.812298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca47e259-31ae-4579-b44a-0023a9793ea5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:42.813249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ca47e259-31ae-4579-b44a-0023a9793ea5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:42.820181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca47e259-31ae-4579-b44a-0023a9793ea5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:42.820660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca47e259-31ae-4579-b44a-0023a9793ea5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:42.821446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca47e259-31ae-4579-b44a-0023a9793ea5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:42.821886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca47e259-31ae-4579-b44a-0023a9793ea5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:42.853546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ca47e259-31ae-4579-b44a-0023a9793ea5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 May 23 13:54:42.854111 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 894/1707] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:43.308285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8d96bed0-c087-4478-a735-345346082034 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:43.308956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8d96bed0-c087-4478-a735-345346082034 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:43.315493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d96bed0-c087-4478-a735-345346082034 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:43.315950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d96bed0-c087-4478-a735-345346082034 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:43.316751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d96bed0-c087-4478-a735-345346082034 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:43.317189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d96bed0-c087-4478-a735-345346082034 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:43.389039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8d96bed0-c087-4478-a735-345346082034 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:43.397956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8d96bed0-c087-4478-a735-345346082034 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093463 May 23 13:54:43.398536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 814/1708] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:43 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:43.868429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0c62bba2-cba3-4081-934b-e7c62743a5d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:43.869420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0c62bba2-cba3-4081-934b-e7c62743a5d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:43.876135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c62bba2-cba3-4081-934b-e7c62743a5d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:43.876621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c62bba2-cba3-4081-934b-e7c62743a5d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:43.877415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c62bba2-cba3-4081-934b-e7c62743a5d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:43.877863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c62bba2-cba3-4081-934b-e7c62743a5d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:43.904822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:43.909359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0c62bba2-cba3-4081-934b-e7c62743a5d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046799 May 23 13:54:43.909930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 895/1709] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:44.416640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae36442d-ba30-42a6-85f1-02df83478343 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:44.421886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae36442d-ba30-42a6-85f1-02df83478343 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:44.424584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae36442d-ba30-42a6-85f1-02df83478343 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:44.425052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae36442d-ba30-42a6-85f1-02df83478343 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:44.425845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae36442d-ba30-42a6-85f1-02df83478343 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:44.426284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae36442d-ba30-42a6-85f1-02df83478343 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:44.494691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae36442d-ba30-42a6-85f1-02df83478343 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:44.502545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae36442d-ba30-42a6-85f1-02df83478343 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090485 May 23 13:54:44.503125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 815/1710] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:44 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:44.922657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc878b34-7b78-4278-b25c-76d5a88e98de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:44.923584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc878b34-7b78-4278-b25c-76d5a88e98de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:44.932051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc878b34-7b78-4278-b25c-76d5a88e98de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:44.932509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc878b34-7b78-4278-b25c-76d5a88e98de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:44.934401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc878b34-7b78-4278-b25c-76d5a88e98de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:44.934401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc878b34-7b78-4278-b25c-76d5a88e98de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:44.965689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc878b34-7b78-4278-b25c-76d5a88e98de tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 May 23 13:54:44.966281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 896/1711] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:45.519423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f67be89b-b97c-48a4-b9ff-1caf9fc61a2a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:45.520020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f67be89b-b97c-48a4-b9ff-1caf9fc61a2a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:45.527420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f67be89b-b97c-48a4-b9ff-1caf9fc61a2a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:45.527869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f67be89b-b97c-48a4-b9ff-1caf9fc61a2a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:45.528681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f67be89b-b97c-48a4-b9ff-1caf9fc61a2a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:45.529118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f67be89b-b97c-48a4-b9ff-1caf9fc61a2a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:45.593460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f67be89b-b97c-48a4-b9ff-1caf9fc61a2a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:45.602030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f67be89b-b97c-48a4-b9ff-1caf9fc61a2a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086621 May 23 13:54:45.602730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 816/1712] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:45 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:45.978246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bad23b89-72dc-4a6a-b445-a9ad6f00eb12 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:45.979217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bad23b89-72dc-4a6a-b445-a9ad6f00eb12 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:45.986088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad23b89-72dc-4a6a-b445-a9ad6f00eb12 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:45.986528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad23b89-72dc-4a6a-b445-a9ad6f00eb12 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:45.987307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad23b89-72dc-4a6a-b445-a9ad6f00eb12 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:45.987735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad23b89-72dc-4a6a-b445-a9ad6f00eb12 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:46.020533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bad23b89-72dc-4a6a-b445-a9ad6f00eb12 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046750 May 23 13:54:46.021133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 897/1713] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:46.618592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca617cd6-4791-46f5-a64f-2a5c6a7d703a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:46.631921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ca617cd6-4791-46f5-a64f-2a5c6a7d703a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:46.631921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca617cd6-4791-46f5-a64f-2a5c6a7d703a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:46.631921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca617cd6-4791-46f5-a64f-2a5c6a7d703a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:46.631921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca617cd6-4791-46f5-a64f-2a5c6a7d703a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:46.632344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca617cd6-4791-46f5-a64f-2a5c6a7d703a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:46.694398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ca617cd6-4791-46f5-a64f-2a5c6a7d703a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:46.702843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ca617cd6-4791-46f5-a64f-2a5c6a7d703a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088313 May 23 13:54:46.703423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 817/1714] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:46 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:47.031444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65f79ae3-99ac-4635-b371-311223d87674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:47.032382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-65f79ae3-99ac-4635-b371-311223d87674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:47.040077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65f79ae3-99ac-4635-b371-311223d87674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:47.040536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65f79ae3-99ac-4635-b371-311223d87674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:47.041339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65f79ae3-99ac-4635-b371-311223d87674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:47.041782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65f79ae3-99ac-4635-b371-311223d87674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:47.073209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65f79ae3-99ac-4635-b371-311223d87674 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 May 23 13:54:47.073791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 898/1715] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:47.720730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ff397bf-e7d0-4595-b0bc-038fe9d3e146 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:47.721341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0ff397bf-e7d0-4595-b0bc-038fe9d3e146 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:47.728640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ff397bf-e7d0-4595-b0bc-038fe9d3e146 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:47.729098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ff397bf-e7d0-4595-b0bc-038fe9d3e146 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:47.729881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ff397bf-e7d0-4595-b0bc-038fe9d3e146 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:47.730469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ff397bf-e7d0-4595-b0bc-038fe9d3e146 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:47.794082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0ff397bf-e7d0-4595-b0bc-038fe9d3e146 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:47.801726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0ff397bf-e7d0-4595-b0bc-038fe9d3e146 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085089 May 23 13:54:47.802290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 818/1716] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:47 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:48.085360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-44b6c3e0-c091-4e4f-b374-93073ec4f839 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:48.086180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-44b6c3e0-c091-4e4f-b374-93073ec4f839 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:48.092716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44b6c3e0-c091-4e4f-b374-93073ec4f839 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:48.093162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44b6c3e0-c091-4e4f-b374-93073ec4f839 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:48.093928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44b6c3e0-c091-4e4f-b374-93073ec4f839 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:48.094358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44b6c3e0-c091-4e4f-b374-93073ec4f839 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:48.123634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-44b6c3e0-c091-4e4f-b374-93073ec4f839 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042854 May 23 13:54:48.124185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 899/1717] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:48.819614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1679344-c831-4438-827a-a8f1a0e7f68a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:48.820211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1679344-c831-4438-827a-a8f1a0e7f68a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:48.826690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1679344-c831-4438-827a-a8f1a0e7f68a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:48.827398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1679344-c831-4438-827a-a8f1a0e7f68a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:48.828162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1679344-c831-4438-827a-a8f1a0e7f68a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:48.828617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1679344-c831-4438-827a-a8f1a0e7f68a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:48.847399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:48.893713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1679344-c831-4438-827a-a8f1a0e7f68a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:48.903465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1679344-c831-4438-827a-a8f1a0e7f68a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087950 May 23 13:54:48.904065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 819/1718] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:48 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:49.135714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2ffe87d1-8144-4ff1-a2a0-b41cf1a3ef3b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:49.136650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2ffe87d1-8144-4ff1-a2a0-b41cf1a3ef3b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:49.143451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ffe87d1-8144-4ff1-a2a0-b41cf1a3ef3b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:49.143905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ffe87d1-8144-4ff1-a2a0-b41cf1a3ef3b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:49.144696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ffe87d1-8144-4ff1-a2a0-b41cf1a3ef3b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:49.145139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ffe87d1-8144-4ff1-a2a0-b41cf1a3ef3b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:49.174784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2ffe87d1-8144-4ff1-a2a0-b41cf1a3ef3b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 May 23 13:54:49.175371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 900/1719] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:49.920884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0bfb4de4-28e0-413f-abf3-55bfd39eab61 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:49.921496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0bfb4de4-28e0-413f-abf3-55bfd39eab61 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:49.928487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bfb4de4-28e0-413f-abf3-55bfd39eab61 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:49.928968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bfb4de4-28e0-413f-abf3-55bfd39eab61 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:49.929729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bfb4de4-28e0-413f-abf3-55bfd39eab61 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:49.930169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bfb4de4-28e0-413f-abf3-55bfd39eab61 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:49.991878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0bfb4de4-28e0-413f-abf3-55bfd39eab61 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:49.999424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0bfb4de4-28e0-413f-abf3-55bfd39eab61 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082537 May 23 13:54:49.999985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 820/1720] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:49 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:50.186734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5702ff5d-a7f8-4b77-b7f1-94d08df5c7ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:50.187671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5702ff5d-a7f8-4b77-b7f1-94d08df5c7ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:50.189992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=60 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:50.195984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5702ff5d-a7f8-4b77-b7f1-94d08df5c7ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:50.196441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5702ff5d-a7f8-4b77-b7f1-94d08df5c7ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:50.197262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5702ff5d-a7f8-4b77-b7f1-94d08df5c7ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:50.197709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5702ff5d-a7f8-4b77-b7f1-94d08df5c7ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:50.229174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5702ff5d-a7f8-4b77-b7f1-94d08df5c7ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 May 23 13:54:50.229740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 901/1721] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:51.017882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c97609c-ea03-4b75-a645-8d42417f5c85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:51.018440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c97609c-ea03-4b75-a645-8d42417f5c85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:51.024892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c97609c-ea03-4b75-a645-8d42417f5c85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:51.025345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c97609c-ea03-4b75-a645-8d42417f5c85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:51.026104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c97609c-ea03-4b75-a645-8d42417f5c85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:51.026556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c97609c-ea03-4b75-a645-8d42417f5c85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:51.088375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c97609c-ea03-4b75-a645-8d42417f5c85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:51.095888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c97609c-ea03-4b75-a645-8d42417f5c85 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082082 May 23 13:54:51.096444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 821/1722] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:51 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:51.240946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6bdffb0-fe59-4f34-8efb-ca4bb2896882 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:51.241884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6bdffb0-fe59-4f34-8efb-ca4bb2896882 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:51.248400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6bdffb0-fe59-4f34-8efb-ca4bb2896882 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:51.248889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6bdffb0-fe59-4f34-8efb-ca4bb2896882 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:51.249715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6bdffb0-fe59-4f34-8efb-ca4bb2896882 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:51.250163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6bdffb0-fe59-4f34-8efb-ca4bb2896882 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:51.282539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6bdffb0-fe59-4f34-8efb-ca4bb2896882 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046605 May 23 13:54:51.283021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 902/1723] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:52.113219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-300ee14f-dd99-4acb-9c96-0d9b70b029e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:52.113822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-300ee14f-dd99-4acb-9c96-0d9b70b029e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:52.121261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-300ee14f-dd99-4acb-9c96-0d9b70b029e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:52.121705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-300ee14f-dd99-4acb-9c96-0d9b70b029e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:52.122455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-300ee14f-dd99-4acb-9c96-0d9b70b029e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:52.122976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-300ee14f-dd99-4acb-9c96-0d9b70b029e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:52.186084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-300ee14f-dd99-4acb-9c96-0d9b70b029e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:52.194347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-300ee14f-dd99-4acb-9c96-0d9b70b029e9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084906 May 23 13:54:52.194932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 822/1724] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:52 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:52.294192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c1efd832-7cb9-4305-92f0-27728468ca6a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:52.295117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c1efd832-7cb9-4305-92f0-27728468ca6a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:52.301885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1efd832-7cb9-4305-92f0-27728468ca6a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:52.303560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1efd832-7cb9-4305-92f0-27728468ca6a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:52.304365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1efd832-7cb9-4305-92f0-27728468ca6a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:52.304849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1efd832-7cb9-4305-92f0-27728468ca6a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:52.335714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c1efd832-7cb9-4305-92f0-27728468ca6a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 May 23 13:54:52.336499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 903/1725] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:53.212440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64e58ba0-b027-48be-b842-9417d1e326dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:53.213088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64e58ba0-b027-48be-b842-9417d1e326dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:53.215544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=58 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:54:53.220753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64e58ba0-b027-48be-b842-9417d1e326dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:53.233455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64e58ba0-b027-48be-b842-9417d1e326dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:53.233455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64e58ba0-b027-48be-b842-9417d1e326dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:53.233455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64e58ba0-b027-48be-b842-9417d1e326dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:53.291176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64e58ba0-b027-48be-b842-9417d1e326dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:53.298800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64e58ba0-b027-48be-b842-9417d1e326dc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091063 May 23 13:54:53.299372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 823/1726] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:53 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:53.346796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d7b2cf0c-420f-475f-97d5-661e008fe273 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:53.347693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d7b2cf0c-420f-475f-97d5-661e008fe273 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:53.355304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf0c-420f-475f-97d5-661e008fe273 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:53.355754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf0c-420f-475f-97d5-661e008fe273 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:53.356649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf0c-420f-475f-97d5-661e008fe273 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:53.357097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7b2cf0c-420f-475f-97d5-661e008fe273 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:53.388222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d7b2cf0c-420f-475f-97d5-661e008fe273 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 May 23 13:54:53.388825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 904/1727] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:54.316623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-215a5b97-f85f-4e77-b693-cd64327aee6e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:54.317244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-215a5b97-f85f-4e77-b693-cd64327aee6e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:54.324643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-215a5b97-f85f-4e77-b693-cd64327aee6e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:54.325089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-215a5b97-f85f-4e77-b693-cd64327aee6e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:54.325852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-215a5b97-f85f-4e77-b693-cd64327aee6e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:54.326277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-215a5b97-f85f-4e77-b693-cd64327aee6e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:54.395683 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-215a5b97-f85f-4e77-b693-cd64327aee6e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:54.400442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2dbe0a80-9ba7-4d0d-87c7-b6f735272a1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:54.401746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2dbe0a80-9ba7-4d0d-87c7-b6f735272a1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:54.404919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-215a5b97-f85f-4e77-b693-cd64327aee6e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091954 May 23 13:54:54.405558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 824/1728] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:54 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:54.410155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2dbe0a80-9ba7-4d0d-87c7-b6f735272a1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:54.410612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2dbe0a80-9ba7-4d0d-87c7-b6f735272a1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:54.411949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2dbe0a80-9ba7-4d0d-87c7-b6f735272a1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:54.412686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2dbe0a80-9ba7-4d0d-87c7-b6f735272a1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:54.447035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2dbe0a80-9ba7-4d0d-87c7-b6f735272a1e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050881 May 23 13:54:54.447538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 905/1729] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:55.429277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c563e29c-8b4d-4379-9f8f-a60a598ec3ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:55.429889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c563e29c-8b4d-4379-9f8f-a60a598ec3ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:55.436732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c563e29c-8b4d-4379-9f8f-a60a598ec3ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:55.437177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c563e29c-8b4d-4379-9f8f-a60a598ec3ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:55.437944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c563e29c-8b4d-4379-9f8f-a60a598ec3ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:55.438377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c563e29c-8b4d-4379-9f8f-a60a598ec3ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:55.458504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91dd1b56-9579-46d6-a173-b7d034a0e46f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:55.460287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-91dd1b56-9579-46d6-a173-b7d034a0e46f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:55.468430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91dd1b56-9579-46d6-a173-b7d034a0e46f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:55.469045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91dd1b56-9579-46d6-a173-b7d034a0e46f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:55.469944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91dd1b56-9579-46d6-a173-b7d034a0e46f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:55.470639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91dd1b56-9579-46d6-a173-b7d034a0e46f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:55.507552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c563e29c-8b4d-4379-9f8f-a60a598ec3ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:55.513336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-91dd1b56-9579-46d6-a173-b7d034a0e46f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058791 May 23 13:54:55.513926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 906/1730] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:54:55.515459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c563e29c-8b4d-4379-9f8f-a60a598ec3ab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090474 May 23 13:54:55.516015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 825/1731] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:55 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:56.526098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-506db918-1bc5-4f54-be4e-1c09cef22b46 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:56.526935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-506db918-1bc5-4f54-be4e-1c09cef22b46 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:56.532821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b1ad741-0757-450b-be31-2d3155b2ae88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:56.533430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b1ad741-0757-450b-be31-2d3155b2ae88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:56.533873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-506db918-1bc5-4f54-be4e-1c09cef22b46 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:56.534389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-506db918-1bc5-4f54-be4e-1c09cef22b46 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:56.535198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-506db918-1bc5-4f54-be4e-1c09cef22b46 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:56.535640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-506db918-1bc5-4f54-be4e-1c09cef22b46 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:56.540528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b1ad741-0757-450b-be31-2d3155b2ae88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:56.541016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b1ad741-0757-450b-be31-2d3155b2ae88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:56.541773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b1ad741-0757-450b-be31-2d3155b2ae88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:56.542210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b1ad741-0757-450b-be31-2d3155b2ae88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:56.567253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-506db918-1bc5-4f54-be4e-1c09cef22b46 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046003 May 23 13:54:56.568205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 907/1732] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:56.606431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b1ad741-0757-450b-be31-2d3155b2ae88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:56.614568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b1ad741-0757-450b-be31-2d3155b2ae88 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085676 May 23 13:54:56.615144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 826/1733] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:56 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:54:57.580429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9cf1ad2-8399-47dd-a721-274e50acdb26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:57.582201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9cf1ad2-8399-47dd-a721-274e50acdb26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:57.589689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ad2-8399-47dd-a721-274e50acdb26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:57.590252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ad2-8399-47dd-a721-274e50acdb26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:57.591124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ad2-8399-47dd-a721-274e50acdb26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:57.591567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ad2-8399-47dd-a721-274e50acdb26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:57.626174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9cf1ad2-8399-47dd-a721-274e50acdb26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050220 May 23 13:54:57.626771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 908/1734] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:57.631325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-83605043-d972-4020-92da-22839ea2515c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:57.631944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-83605043-d972-4020-92da-22839ea2515c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:57.639209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83605043-d972-4020-92da-22839ea2515c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:57.639662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83605043-d972-4020-92da-22839ea2515c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:57.640445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83605043-d972-4020-92da-22839ea2515c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:57.640917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83605043-d972-4020-92da-22839ea2515c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:57.710204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-83605043-d972-4020-92da-22839ea2515c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:57.719253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-83605043-d972-4020-92da-22839ea2515c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091849 May 23 13:54:57.719832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 827/1735] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:57 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:54:58.638045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d10ac735-3f33-4a67-97c4-fe832694a28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:58.638969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d10ac735-3f33-4a67-97c4-fe832694a28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:58.645535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d10ac735-3f33-4a67-97c4-fe832694a28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:58.645984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d10ac735-3f33-4a67-97c4-fe832694a28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:58.646745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d10ac735-3f33-4a67-97c4-fe832694a28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:58.647184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d10ac735-3f33-4a67-97c4-fe832694a28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:58.681024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d10ac735-3f33-4a67-97c4-fe832694a28d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046815 May 23 13:54:58.681630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 909/1736] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:58 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:58.737071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94650ef5-d62c-4a22-bc09-f4a24d6db732 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:58.737682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94650ef5-d62c-4a22-bc09-f4a24d6db732 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:58.744550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94650ef5-d62c-4a22-bc09-f4a24d6db732 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:58.745028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94650ef5-d62c-4a22-bc09-f4a24d6db732 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:58.745795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94650ef5-d62c-4a22-bc09-f4a24d6db732 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:58.746223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94650ef5-d62c-4a22-bc09-f4a24d6db732 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:58.816059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94650ef5-d62c-4a22-bc09-f4a24d6db732 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:58.824384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94650ef5-d62c-4a22-bc09-f4a24d6db732 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091160 May 23 13:54:58.824995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 828/1737] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:58 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:54:59.693407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1feb9d65-e64a-445a-9864-d71b5be40f3f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:59.694348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1feb9d65-e64a-445a-9864-d71b5be40f3f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:59.701914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1feb9d65-e64a-445a-9864-d71b5be40f3f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:59.702368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1feb9d65-e64a-445a-9864-d71b5be40f3f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:59.703159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1feb9d65-e64a-445a-9864-d71b5be40f3f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:59.703600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1feb9d65-e64a-445a-9864-d71b5be40f3f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:59.735497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1feb9d65-e64a-445a-9864-d71b5be40f3f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 May 23 13:54:59.736081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 910/1738] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:54:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:54:59.842251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c03b55c0-2e8c-42a1-990e-ea265122c93a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:54:59.842919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c03b55c0-2e8c-42a1-990e-ea265122c93a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:54:59.849141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c03b55c0-2e8c-42a1-990e-ea265122c93a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:59.849592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c03b55c0-2e8c-42a1-990e-ea265122c93a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:59.850355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c03b55c0-2e8c-42a1-990e-ea265122c93a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:54:59.850792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c03b55c0-2e8c-42a1-990e-ea265122c93a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:54:59.912922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c03b55c0-2e8c-42a1-990e-ea265122c93a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:54:59.921250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c03b55c0-2e8c-42a1-990e-ea265122c93a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082919 May 23 13:54:59.921828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 829/1739] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:54:59 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:00.748063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1025adaa-d425-4481-bfdf-20a80a0490ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:00.749063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1025adaa-d425-4481-bfdf-20a80a0490ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:00.755944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1025adaa-d425-4481-bfdf-20a80a0490ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:00.756402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1025adaa-d425-4481-bfdf-20a80a0490ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:00.757307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1025adaa-d425-4481-bfdf-20a80a0490ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:00.758490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1025adaa-d425-4481-bfdf-20a80a0490ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:00.791063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1025adaa-d425-4481-bfdf-20a80a0490ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047059 May 23 13:55:00.791652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 911/1740] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:00.938271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aaf42725-cd97-44e7-9e68-828ee44b3915 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:00.938886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aaf42725-cd97-44e7-9e68-828ee44b3915 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:00.946270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaf42725-cd97-44e7-9e68-828ee44b3915 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:00.946721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaf42725-cd97-44e7-9e68-828ee44b3915 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:00.947498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaf42725-cd97-44e7-9e68-828ee44b3915 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:00.947968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aaf42725-cd97-44e7-9e68-828ee44b3915 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:01.021550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aaf42725-cd97-44e7-9e68-828ee44b3915 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:01.031871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aaf42725-cd97-44e7-9e68-828ee44b3915 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.097121 May 23 13:55:01.032880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 830/1741] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:00 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:01.802716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-878dbbf2-5761-4ffc-aa74-23af86884531 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:01.803676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-878dbbf2-5761-4ffc-aa74-23af86884531 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:01.810927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878dbbf2-5761-4ffc-aa74-23af86884531 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:01.811387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878dbbf2-5761-4ffc-aa74-23af86884531 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:01.812156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878dbbf2-5761-4ffc-aa74-23af86884531 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:01.812626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878dbbf2-5761-4ffc-aa74-23af86884531 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:01.831489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:01.845201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-878dbbf2-5761-4ffc-aa74-23af86884531 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 May 23 13:55:01.845781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 912/1742] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:02.050228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-32c77951-bc76-4864-b733-9ce4578257b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:02.050803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-32c77951-bc76-4864-b733-9ce4578257b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:02.057661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32c77951-bc76-4864-b733-9ce4578257b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:02.058141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32c77951-bc76-4864-b733-9ce4578257b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:02.058914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32c77951-bc76-4864-b733-9ce4578257b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:02.059356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32c77951-bc76-4864-b733-9ce4578257b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:02.128051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-32c77951-bc76-4864-b733-9ce4578257b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:02.136597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-32c77951-bc76-4864-b733-9ce4578257b4 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090246 May 23 13:55:02.137181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 831/1743] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:02 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:02.487797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:55:02.488062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:55:02.858001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d3e9494e-33c9-4999-b6a8-de37e8add054 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:02.858942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d3e9494e-33c9-4999-b6a8-de37e8add054 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:02.865533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3e9494e-33c9-4999-b6a8-de37e8add054 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:02.866047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3e9494e-33c9-4999-b6a8-de37e8add054 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:02.867511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3e9494e-33c9-4999-b6a8-de37e8add054 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:02.867942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3e9494e-33c9-4999-b6a8-de37e8add054 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:02.897888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d3e9494e-33c9-4999-b6a8-de37e8add054 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 May 23 13:55:02.898500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 913/1744] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:03.154548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-98dde516-3f16-4cc8-8b1b-321d1c45a37e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:03.155146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-98dde516-3f16-4cc8-8b1b-321d1c45a37e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:03.161660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98dde516-3f16-4cc8-8b1b-321d1c45a37e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:03.162099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98dde516-3f16-4cc8-8b1b-321d1c45a37e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:03.162869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98dde516-3f16-4cc8-8b1b-321d1c45a37e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:03.163341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98dde516-3f16-4cc8-8b1b-321d1c45a37e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:03.232431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-98dde516-3f16-4cc8-8b1b-321d1c45a37e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:03.241920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-98dde516-3f16-4cc8-8b1b-321d1c45a37e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091305 May 23 13:55:03.242494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 832/1745] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:03 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:03.909822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f9cf37a-63a1-4f69-8bff-75dc8ddfc3be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:03.910685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f9cf37a-63a1-4f69-8bff-75dc8ddfc3be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:03.917562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f9cf37a-63a1-4f69-8bff-75dc8ddfc3be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:03.918018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f9cf37a-63a1-4f69-8bff-75dc8ddfc3be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:03.918785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f9cf37a-63a1-4f69-8bff-75dc8ddfc3be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:03.919224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f9cf37a-63a1-4f69-8bff-75dc8ddfc3be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:03.950849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f9cf37a-63a1-4f69-8bff-75dc8ddfc3be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045088 May 23 13:55:03.951690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 914/1746] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:04.259033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-80eb478b-b48a-4574-a5c0-5002a63988f9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:04.259630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-80eb478b-b48a-4574-a5c0-5002a63988f9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:04.266797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80eb478b-b48a-4574-a5c0-5002a63988f9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:04.267345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80eb478b-b48a-4574-a5c0-5002a63988f9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:04.268366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80eb478b-b48a-4574-a5c0-5002a63988f9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:04.268838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-80eb478b-b48a-4574-a5c0-5002a63988f9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:04.333616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-80eb478b-b48a-4574-a5c0-5002a63988f9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:04.341351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-80eb478b-b48a-4574-a5c0-5002a63988f9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086278 May 23 13:55:04.341911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 833/1747] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:04 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:55:04.963060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-427573f3-b85b-483e-8d33-80e292458b61 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:04.963983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-427573f3-b85b-483e-8d33-80e292458b61 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:04.971324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-427573f3-b85b-483e-8d33-80e292458b61 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:04.971772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-427573f3-b85b-483e-8d33-80e292458b61 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:04.972899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-427573f3-b85b-483e-8d33-80e292458b61 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:04.973594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-427573f3-b85b-483e-8d33-80e292458b61 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:05.006674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-427573f3-b85b-483e-8d33-80e292458b61 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 May 23 13:55:05.007239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 915/1748] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:05.358762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-700c3f98-48bd-4b3b-9cc3-1d40d4dedfc0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:05.359475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-700c3f98-48bd-4b3b-9cc3-1d40d4dedfc0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:05.365977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-700c3f98-48bd-4b3b-9cc3-1d40d4dedfc0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:05.366422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-700c3f98-48bd-4b3b-9cc3-1d40d4dedfc0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:05.367243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-700c3f98-48bd-4b3b-9cc3-1d40d4dedfc0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:05.367781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-700c3f98-48bd-4b3b-9cc3-1d40d4dedfc0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:05.433423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-700c3f98-48bd-4b3b-9cc3-1d40d4dedfc0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:05.441253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-700c3f98-48bd-4b3b-9cc3-1d40d4dedfc0 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086519 May 23 13:55:05.441820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 834/1749] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:05 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:06.019046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-79152f55-3b48-4555-8d65-c8478496f276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:06.019917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-79152f55-3b48-4555-8d65-c8478496f276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:06.026523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79152f55-3b48-4555-8d65-c8478496f276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:06.026972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79152f55-3b48-4555-8d65-c8478496f276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:06.027736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79152f55-3b48-4555-8d65-c8478496f276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:06.028174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79152f55-3b48-4555-8d65-c8478496f276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:06.058687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-79152f55-3b48-4555-8d65-c8478496f276 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043656 May 23 13:55:06.059523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 916/1750] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:06.460301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-332d59b4-4cb0-47dd-942e-95bdd64217d1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:06.461056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-332d59b4-4cb0-47dd-942e-95bdd64217d1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:06.467819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-332d59b4-4cb0-47dd-942e-95bdd64217d1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:06.468264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-332d59b4-4cb0-47dd-942e-95bdd64217d1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:06.469133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-332d59b4-4cb0-47dd-942e-95bdd64217d1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:06.469551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-332d59b4-4cb0-47dd-942e-95bdd64217d1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:06.537003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-332d59b4-4cb0-47dd-942e-95bdd64217d1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:06.545024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-332d59b4-4cb0-47dd-942e-95bdd64217d1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088579 May 23 13:55:06.545639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 835/1751] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:06 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:07.070059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff298c80-cc4b-4247-9401-b6df61e7fe8d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:07.071012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff298c80-cc4b-4247-9401-b6df61e7fe8d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:07.078364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff298c80-cc4b-4247-9401-b6df61e7fe8d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:07.078815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff298c80-cc4b-4247-9401-b6df61e7fe8d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:07.079577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff298c80-cc4b-4247-9401-b6df61e7fe8d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:07.080007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff298c80-cc4b-4247-9401-b6df61e7fe8d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:07.111615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff298c80-cc4b-4247-9401-b6df61e7fe8d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 May 23 13:55:07.112187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 917/1752] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:07.562603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7b26d172-fefb-49ad-a583-9c1c9ebfa9fd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:07.563248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7b26d172-fefb-49ad-a583-9c1c9ebfa9fd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:07.569956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b26d172-fefb-49ad-a583-9c1c9ebfa9fd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:07.570404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b26d172-fefb-49ad-a583-9c1c9ebfa9fd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:07.571205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b26d172-fefb-49ad-a583-9c1c9ebfa9fd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:07.571677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b26d172-fefb-49ad-a583-9c1c9ebfa9fd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:07.577181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:07.643725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7b26d172-fefb-49ad-a583-9c1c9ebfa9fd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:07.652914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7b26d172-fefb-49ad-a583-9c1c9ebfa9fd tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.094132 May 23 13:55:07.653485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 836/1753] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:07 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:08.124158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d2740f7-611d-4c3b-8a7a-52c48d26f02f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:08.125128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d2740f7-611d-4c3b-8a7a-52c48d26f02f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:08.131500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d2740f7-611d-4c3b-8a7a-52c48d26f02f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:08.131944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d2740f7-611d-4c3b-8a7a-52c48d26f02f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:08.132733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d2740f7-611d-4c3b-8a7a-52c48d26f02f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:08.133167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d2740f7-611d-4c3b-8a7a-52c48d26f02f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:08.164047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d2740f7-611d-4c3b-8a7a-52c48d26f02f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043821 May 23 13:55:08.164628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 918/1754] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:55:08.669825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6209295-0854-4c55-905e-dd7b6acdf09b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:08.670430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c6209295-0854-4c55-905e-dd7b6acdf09b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:08.678011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6209295-0854-4c55-905e-dd7b6acdf09b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:08.678455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6209295-0854-4c55-905e-dd7b6acdf09b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:08.679239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6209295-0854-4c55-905e-dd7b6acdf09b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:08.679667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6209295-0854-4c55-905e-dd7b6acdf09b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:08.747381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c6209295-0854-4c55-905e-dd7b6acdf09b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:08.755125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c6209295-0854-4c55-905e-dd7b6acdf09b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.089303 May 23 13:55:08.755689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 837/1755] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:08 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:09.175811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3fb6d211-88d0-4a0c-8a12-c8c4a3bf7305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:09.176812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3fb6d211-88d0-4a0c-8a12-c8c4a3bf7305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:09.185430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3fb6d211-88d0-4a0c-8a12-c8c4a3bf7305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:09.185884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3fb6d211-88d0-4a0c-8a12-c8c4a3bf7305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:09.186709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3fb6d211-88d0-4a0c-8a12-c8c4a3bf7305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:09.187154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3fb6d211-88d0-4a0c-8a12-c8c4a3bf7305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:09.219558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3fb6d211-88d0-4a0c-8a12-c8c4a3bf7305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047661 May 23 13:55:09.220135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 919/1756] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:09.774283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f21fafdb-7ff1-4283-9bd5-fe06b4e6c617 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:09.775071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f21fafdb-7ff1-4283-9bd5-fe06b4e6c617 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:09.781924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f21fafdb-7ff1-4283-9bd5-fe06b4e6c617 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:09.782760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f21fafdb-7ff1-4283-9bd5-fe06b4e6c617 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:09.784000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f21fafdb-7ff1-4283-9bd5-fe06b4e6c617 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:09.784476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f21fafdb-7ff1-4283-9bd5-fe06b4e6c617 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:09.847583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f21fafdb-7ff1-4283-9bd5-fe06b4e6c617 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:09.855353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f21fafdb-7ff1-4283-9bd5-fe06b4e6c617 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085942 May 23 13:55:09.855911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 838/1757] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:09 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:10.231921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9afcd080-1dd2-4422-ba2e-34a20c4065fd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:10.232863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9afcd080-1dd2-4422-ba2e-34a20c4065fd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:10.239267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9afcd080-1dd2-4422-ba2e-34a20c4065fd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:10.239709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9afcd080-1dd2-4422-ba2e-34a20c4065fd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:10.240471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9afcd080-1dd2-4422-ba2e-34a20c4065fd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:10.240930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9afcd080-1dd2-4422-ba2e-34a20c4065fd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:10.274551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9afcd080-1dd2-4422-ba2e-34a20c4065fd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 May 23 13:55:10.276366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 920/1758] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:10.874847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72e87920-a718-45a8-980a-7ef55b518400 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:10.875488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72e87920-a718-45a8-980a-7ef55b518400 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:10.882081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72e87920-a718-45a8-980a-7ef55b518400 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:10.882526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72e87920-a718-45a8-980a-7ef55b518400 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:10.883289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72e87920-a718-45a8-980a-7ef55b518400 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:10.883721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72e87920-a718-45a8-980a-7ef55b518400 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:10.954441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72e87920-a718-45a8-980a-7ef55b518400 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:10.962098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72e87920-a718-45a8-980a-7ef55b518400 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091196 May 23 13:55:10.962685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 839/1759] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:10 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:11.287007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4ce790e6-cb75-46a6-92f2-904dcba78f26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:11.287931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4ce790e6-cb75-46a6-92f2-904dcba78f26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:11.295292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ce790e6-cb75-46a6-92f2-904dcba78f26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:11.295738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ce790e6-cb75-46a6-92f2-904dcba78f26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:11.296601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ce790e6-cb75-46a6-92f2-904dcba78f26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:11.297046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ce790e6-cb75-46a6-92f2-904dcba78f26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:11.328111 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4ce790e6-cb75-46a6-92f2-904dcba78f26 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 May 23 13:55:11.328685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 921/1760] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:11.980242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b739943e-fd2b-466a-b2f4-f023294ab8b9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:11.980913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b739943e-fd2b-466a-b2f4-f023294ab8b9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:11.987567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b739943e-fd2b-466a-b2f4-f023294ab8b9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:11.988023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b739943e-fd2b-466a-b2f4-f023294ab8b9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:11.988833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b739943e-fd2b-466a-b2f4-f023294ab8b9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:11.989276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b739943e-fd2b-466a-b2f4-f023294ab8b9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:12.054652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b739943e-fd2b-466a-b2f4-f023294ab8b9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:12.062836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b739943e-fd2b-466a-b2f4-f023294ab8b9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087167 May 23 13:55:12.063400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 840/1761] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:11 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:12.339692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-230916b2-3913-4e7c-b8b4-b1d4f6b19ac6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:12.340591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-230916b2-3913-4e7c-b8b4-b1d4f6b19ac6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:12.347368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-230916b2-3913-4e7c-b8b4-b1d4f6b19ac6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:12.347813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-230916b2-3913-4e7c-b8b4-b1d4f6b19ac6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:12.348589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-230916b2-3913-4e7c-b8b4-b1d4f6b19ac6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:12.349033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-230916b2-3913-4e7c-b8b4-b1d4f6b19ac6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:12.447606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-230916b2-3913-4e7c-b8b4-b1d4f6b19ac6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053892 May 23 13:55:12.447606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 922/1762] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:12.486863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:55:12.487099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:55:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:55:13.082998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d5035326-a023-47ce-bd37-e6c7c75b9a79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:13.083793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d5035326-a023-47ce-bd37-e6c7c75b9a79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:13.090655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5035326-a023-47ce-bd37-e6c7c75b9a79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:13.091099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5035326-a023-47ce-bd37-e6c7c75b9a79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:13.091865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5035326-a023-47ce-bd37-e6c7c75b9a79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:13.092291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5035326-a023-47ce-bd37-e6c7c75b9a79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:13.160022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d5035326-a023-47ce-bd37-e6c7c75b9a79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:13.168097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d5035326-a023-47ce-bd37-e6c7c75b9a79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091237 May 23 13:55:13.168757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 841/1763] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:13 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:13.401215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff8e61a2-a8c8-44d4-812a-b02e6845be45 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:13.402129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff8e61a2-a8c8-44d4-812a-b02e6845be45 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:13.409508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff8e61a2-a8c8-44d4-812a-b02e6845be45 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:13.410061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff8e61a2-a8c8-44d4-812a-b02e6845be45 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:13.410889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff8e61a2-a8c8-44d4-812a-b02e6845be45 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:13.411492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff8e61a2-a8c8-44d4-812a-b02e6845be45 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:13.441303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff8e61a2-a8c8-44d4-812a-b02e6845be45 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 May 23 13:55:13.441853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 923/1764] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:14.187359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52c21d80-7aa3-4cb2-89e4-4045180dee13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:14.188084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-52c21d80-7aa3-4cb2-89e4-4045180dee13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:14.194988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52c21d80-7aa3-4cb2-89e4-4045180dee13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:14.195434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52c21d80-7aa3-4cb2-89e4-4045180dee13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:14.196248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52c21d80-7aa3-4cb2-89e4-4045180dee13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:14.196927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52c21d80-7aa3-4cb2-89e4-4045180dee13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:14.271375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52c21d80-7aa3-4cb2-89e4-4045180dee13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:14.279677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-52c21d80-7aa3-4cb2-89e4-4045180dee13 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.097939 May 23 13:55:14.280233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 842/1765] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:14 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:55:14.466696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efed8715-45ed-437d-b2dd-d17b586e5ca0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:14.467548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efed8715-45ed-437d-b2dd-d17b586e5ca0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:14.474254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efed8715-45ed-437d-b2dd-d17b586e5ca0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:14.474713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efed8715-45ed-437d-b2dd-d17b586e5ca0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:14.475486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efed8715-45ed-437d-b2dd-d17b586e5ca0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:14.475928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efed8715-45ed-437d-b2dd-d17b586e5ca0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:14.508282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efed8715-45ed-437d-b2dd-d17b586e5ca0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046305 May 23 13:55:14.509518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 924/1766] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:15.297448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c8375f92-c98a-4af0-88fb-6367d88d30b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:15.298288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c8375f92-c98a-4af0-88fb-6367d88d30b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:15.304648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8375f92-c98a-4af0-88fb-6367d88d30b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:15.305114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8375f92-c98a-4af0-88fb-6367d88d30b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:15.306488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8375f92-c98a-4af0-88fb-6367d88d30b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:15.306925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8375f92-c98a-4af0-88fb-6367d88d30b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:15.372066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8375f92-c98a-4af0-88fb-6367d88d30b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:15.379799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c8375f92-c98a-4af0-88fb-6367d88d30b6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086306 May 23 13:55:15.380366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 843/1767] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:15 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:15.521090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87d90c53-d84c-4fea-a308-cd78348d2527 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:15.521925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87d90c53-d84c-4fea-a308-cd78348d2527 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:15.528659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87d90c53-d84c-4fea-a308-cd78348d2527 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:15.529114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87d90c53-d84c-4fea-a308-cd78348d2527 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:15.529885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87d90c53-d84c-4fea-a308-cd78348d2527 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:15.530388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87d90c53-d84c-4fea-a308-cd78348d2527 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:15.724871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87d90c53-d84c-4fea-a308-cd78348d2527 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208011 May 23 13:55:15.725426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 925/1768] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:16.397302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1e26bc8-27ff-40ee-9485-ef6a9ac9576b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:16.397914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1e26bc8-27ff-40ee-9485-ef6a9ac9576b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:16.405173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1e26bc8-27ff-40ee-9485-ef6a9ac9576b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:16.405631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1e26bc8-27ff-40ee-9485-ef6a9ac9576b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:16.406415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1e26bc8-27ff-40ee-9485-ef6a9ac9576b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:16.406861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1e26bc8-27ff-40ee-9485-ef6a9ac9576b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:16.473213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1e26bc8-27ff-40ee-9485-ef6a9ac9576b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:16.481181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1e26bc8-27ff-40ee-9485-ef6a9ac9576b tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087804 May 23 13:55:16.481741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 844/1769] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:16 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:55:16.737209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-713519b1-9102-472b-b88f-4e35abfcb8ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:16.738047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-713519b1-9102-472b-b88f-4e35abfcb8ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:16.745632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-713519b1-9102-472b-b88f-4e35abfcb8ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:16.746158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-713519b1-9102-472b-b88f-4e35abfcb8ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:16.747004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-713519b1-9102-472b-b88f-4e35abfcb8ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:16.747483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-713519b1-9102-472b-b88f-4e35abfcb8ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:16.779132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-713519b1-9102-472b-b88f-4e35abfcb8ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045834 May 23 13:55:16.779800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 926/1770] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:16 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:16.862378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:55:16.862626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:55:17.500292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a3a5d643-a2d7-4c66-958b-2447a9b1f9db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:17.500861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a3a5d643-a2d7-4c66-958b-2447a9b1f9db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:17.507374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3a5d643-a2d7-4c66-958b-2447a9b1f9db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:17.507825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3a5d643-a2d7-4c66-958b-2447a9b1f9db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:17.509224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3a5d643-a2d7-4c66-958b-2447a9b1f9db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:17.510119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3a5d643-a2d7-4c66-958b-2447a9b1f9db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:17.574218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a3a5d643-a2d7-4c66-958b-2447a9b1f9db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:17.582125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a3a5d643-a2d7-4c66-958b-2447a9b1f9db tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085837 May 23 13:55:17.582694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 845/1771] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:17 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:17.791593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d370ad3-42bf-4865-98e2-28f4ebe4319a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:17.792637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d370ad3-42bf-4865-98e2-28f4ebe4319a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:17.800171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d370ad3-42bf-4865-98e2-28f4ebe4319a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:17.800644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d370ad3-42bf-4865-98e2-28f4ebe4319a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:17.801406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d370ad3-42bf-4865-98e2-28f4ebe4319a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:17.801859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d370ad3-42bf-4865-98e2-28f4ebe4319a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:17.831936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d370ad3-42bf-4865-98e2-28f4ebe4319a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 May 23 13:55:17.832486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 927/1772] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:18.600242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d3680a56-1263-42e8-83a5-5e2db7433f2e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:18.600846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d3680a56-1263-42e8-83a5-5e2db7433f2e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:18.609235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3680a56-1263-42e8-83a5-5e2db7433f2e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:18.609800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3680a56-1263-42e8-83a5-5e2db7433f2e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:18.610604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3680a56-1263-42e8-83a5-5e2db7433f2e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:18.611078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3680a56-1263-42e8-83a5-5e2db7433f2e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:18.675162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d3680a56-1263-42e8-83a5-5e2db7433f2e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:18.682850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d3680a56-1263-42e8-83a5-5e2db7433f2e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086565 May 23 13:55:18.683404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 846/1773] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:18 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:18.844321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50aa38d6-13ce-4c97-8e65-91a799e90c13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:18.845250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50aa38d6-13ce-4c97-8e65-91a799e90c13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:18.851689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50aa38d6-13ce-4c97-8e65-91a799e90c13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:18.852077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50aa38d6-13ce-4c97-8e65-91a799e90c13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:18.852865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50aa38d6-13ce-4c97-8e65-91a799e90c13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:18.853919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50aa38d6-13ce-4c97-8e65-91a799e90c13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:18.882258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50aa38d6-13ce-4c97-8e65-91a799e90c13 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041891 May 23 13:55:18.882802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 928/1774] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:19.700889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-673a8830-695a-4361-9ae8-64bec9918060 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:19.701497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-673a8830-695a-4361-9ae8-64bec9918060 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:19.713950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-673a8830-695a-4361-9ae8-64bec9918060 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:19.714476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-673a8830-695a-4361-9ae8-64bec9918060 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:19.715215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-673a8830-695a-4361-9ae8-64bec9918060 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:19.715646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-673a8830-695a-4361-9ae8-64bec9918060 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:19.781493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-673a8830-695a-4361-9ae8-64bec9918060 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:19.789259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-673a8830-695a-4361-9ae8-64bec9918060 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093163 May 23 13:55:19.789827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 847/1775] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:19 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:19.894665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a2928d1-4453-41c2-bab4-36d7f01a3b53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:19.895579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a2928d1-4453-41c2-bab4-36d7f01a3b53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:19.902925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a2928d1-4453-41c2-bab4-36d7f01a3b53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:19.903373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a2928d1-4453-41c2-bab4-36d7f01a3b53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:19.904177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a2928d1-4453-41c2-bab4-36d7f01a3b53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:19.904639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a2928d1-4453-41c2-bab4-36d7f01a3b53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:19.908390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:19.936488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a2928d1-4453-41c2-bab4-36d7f01a3b53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 May 23 13:55:19.937083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 929/1776] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:20.806866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-887753f2-1de2-459c-9da8-5978c4f27554 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:20.807466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-887753f2-1de2-459c-9da8-5978c4f27554 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:20.813978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-887753f2-1de2-459c-9da8-5978c4f27554 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:20.814420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-887753f2-1de2-459c-9da8-5978c4f27554 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:20.815174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-887753f2-1de2-459c-9da8-5978c4f27554 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:20.815741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-887753f2-1de2-459c-9da8-5978c4f27554 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:20.886284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-887753f2-1de2-459c-9da8-5978c4f27554 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:20.894276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-887753f2-1de2-459c-9da8-5978c4f27554 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091301 May 23 13:55:20.894852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 848/1777] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:20 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:20.949059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-00748695-5b21-4fde-98b2-a8bbd9689737 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:20.950017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-00748695-5b21-4fde-98b2-a8bbd9689737 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:20.957380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00748695-5b21-4fde-98b2-a8bbd9689737 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:20.957832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00748695-5b21-4fde-98b2-a8bbd9689737 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:20.958709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00748695-5b21-4fde-98b2-a8bbd9689737 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:20.959094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00748695-5b21-4fde-98b2-a8bbd9689737 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:20.988922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-00748695-5b21-4fde-98b2-a8bbd9689737 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 May 23 13:55:20.989486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 930/1778] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:55:21.911735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55d94e69-f8f6-4561-8ae5-6ce128eae25a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:21.912348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55d94e69-f8f6-4561-8ae5-6ce128eae25a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:21.920162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55d94e69-f8f6-4561-8ae5-6ce128eae25a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:21.920635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55d94e69-f8f6-4561-8ae5-6ce128eae25a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:21.921403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55d94e69-f8f6-4561-8ae5-6ce128eae25a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:21.921856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55d94e69-f8f6-4561-8ae5-6ce128eae25a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:21.987842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55d94e69-f8f6-4561-8ae5-6ce128eae25a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:21.995985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55d94e69-f8f6-4561-8ae5-6ce128eae25a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088056 May 23 13:55:21.996558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 849/1779] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:21 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:22.000985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c459391-cbaa-4577-87be-6693f4f07696 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:22.001904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c459391-cbaa-4577-87be-6693f4f07696 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:22.003722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=60 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:22.008524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c459391-cbaa-4577-87be-6693f4f07696 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:22.012430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c459391-cbaa-4577-87be-6693f4f07696 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:22.012430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c459391-cbaa-4577-87be-6693f4f07696 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:22.012430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c459391-cbaa-4577-87be-6693f4f07696 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:22.042328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c459391-cbaa-4577-87be-6693f4f07696 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045672 May 23 13:55:22.042797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 931/1780] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:55:23.013310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9bb89ccd-bf10-43cd-a34b-8f6a751e7098 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:23.013962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9bb89ccd-bf10-43cd-a34b-8f6a751e7098 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:23.020671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bb89ccd-bf10-43cd-a34b-8f6a751e7098 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:23.021231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bb89ccd-bf10-43cd-a34b-8f6a751e7098 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:23.022021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bb89ccd-bf10-43cd-a34b-8f6a751e7098 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:23.022563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bb89ccd-bf10-43cd-a34b-8f6a751e7098 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:23.053851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7278089a-1174-4840-bc35-e7c99be95803 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:23.054744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7278089a-1174-4840-bc35-e7c99be95803 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:23.062539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7278089a-1174-4840-bc35-e7c99be95803 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:23.062995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7278089a-1174-4840-bc35-e7c99be95803 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:23.063773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7278089a-1174-4840-bc35-e7c99be95803 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:23.064212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7278089a-1174-4840-bc35-e7c99be95803 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:23.098810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9bb89ccd-bf10-43cd-a34b-8f6a751e7098 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:23.099524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7278089a-1174-4840-bc35-e7c99be95803 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049660 May 23 13:55:23.100109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 932/1781] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:55:23.107792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9bb89ccd-bf10-43cd-a34b-8f6a751e7098 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.098839 May 23 13:55:23.108352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 850/1782] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:23 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:24.112879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-26d58a0c-004f-47fd-83d0-75e58159191e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:24.113809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-26d58a0c-004f-47fd-83d0-75e58159191e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:24.121309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26d58a0c-004f-47fd-83d0-75e58159191e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:24.121727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26d58a0c-004f-47fd-83d0-75e58159191e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:24.122575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26d58a0c-004f-47fd-83d0-75e58159191e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:24.123040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26d58a0c-004f-47fd-83d0-75e58159191e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:24.124914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bca52a3f-ce49-45c7-9c9a-27ded5f74aa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:24.125674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bca52a3f-ce49-45c7-9c9a-27ded5f74aa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:24.128764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=56 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:24.134157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bca52a3f-ce49-45c7-9c9a-27ded5f74aa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:24.134620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bca52a3f-ce49-45c7-9c9a-27ded5f74aa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:24.136256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bca52a3f-ce49-45c7-9c9a-27ded5f74aa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:24.136412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bca52a3f-ce49-45c7-9c9a-27ded5f74aa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:24.155818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-26d58a0c-004f-47fd-83d0-75e58159191e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047278 May 23 13:55:24.156647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 933/1783] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:24.204487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bca52a3f-ce49-45c7-9c9a-27ded5f74aa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:24.214335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bca52a3f-ce49-45c7-9c9a-27ded5f74aa5 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.092754 May 23 13:55:24.215370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 851/1784] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:24 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:55:25.168274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a62b7be0-5021-4730-b33d-f518e5b08a8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:25.169237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a62b7be0-5021-4730-b33d-f518e5b08a8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:25.176219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a62b7be0-5021-4730-b33d-f518e5b08a8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:25.176712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a62b7be0-5021-4730-b33d-f518e5b08a8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:25.177500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a62b7be0-5021-4730-b33d-f518e5b08a8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:25.177941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a62b7be0-5021-4730-b33d-f518e5b08a8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:25.209091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a62b7be0-5021-4730-b33d-f518e5b08a8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 May 23 13:55:25.209691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 934/1785] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:25.238738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f192734d-2cd3-43bc-b20e-1a9cef57d15d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:25.239384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f192734d-2cd3-43bc-b20e-1a9cef57d15d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:25.246766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f192734d-2cd3-43bc-b20e-1a9cef57d15d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:25.247220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f192734d-2cd3-43bc-b20e-1a9cef57d15d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:25.247995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f192734d-2cd3-43bc-b20e-1a9cef57d15d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:25.248436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f192734d-2cd3-43bc-b20e-1a9cef57d15d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:25.310892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f192734d-2cd3-43bc-b20e-1a9cef57d15d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:25.314385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:25.318860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f192734d-2cd3-43bc-b20e-1a9cef57d15d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083990 May 23 13:55:25.319432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 852/1786] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:25 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:26.221984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0bb6c0b4-cdd2-4dda-b50e-afbfb70324cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:26.222905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0bb6c0b4-cdd2-4dda-b50e-afbfb70324cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:26.229496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb6c0b4-cdd2-4dda-b50e-afbfb70324cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:26.230665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb6c0b4-cdd2-4dda-b50e-afbfb70324cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:26.231708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb6c0b4-cdd2-4dda-b50e-afbfb70324cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:26.232167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb6c0b4-cdd2-4dda-b50e-afbfb70324cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:26.264267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0bb6c0b4-cdd2-4dda-b50e-afbfb70324cf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047390 May 23 13:55:26.265019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 935/1787] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:26.336976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-91d6cff9-821c-4bd0-a63a-3a9d27169320 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:26.337587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-91d6cff9-821c-4bd0-a63a-3a9d27169320 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:26.344419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91d6cff9-821c-4bd0-a63a-3a9d27169320 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:26.344924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91d6cff9-821c-4bd0-a63a-3a9d27169320 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:26.345685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91d6cff9-821c-4bd0-a63a-3a9d27169320 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:26.346120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91d6cff9-821c-4bd0-a63a-3a9d27169320 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:26.409790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-91d6cff9-821c-4bd0-a63a-3a9d27169320 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:26.418243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-91d6cff9-821c-4bd0-a63a-3a9d27169320 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085836 May 23 13:55:26.418811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 853/1788] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:26 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:27.276145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-79670e3f-953f-4a12-8bfe-aab04d64de83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:27.277718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-79670e3f-953f-4a12-8bfe-aab04d64de83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:27.284358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79670e3f-953f-4a12-8bfe-aab04d64de83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:27.284863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79670e3f-953f-4a12-8bfe-aab04d64de83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:27.285654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79670e3f-953f-4a12-8bfe-aab04d64de83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:27.286106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79670e3f-953f-4a12-8bfe-aab04d64de83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:27.318298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-79670e3f-953f-4a12-8bfe-aab04d64de83 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046142 May 23 13:55:27.318882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 936/1789] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:27.435421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-02d18ff2-8273-4055-a772-6d4a0ff648cc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:27.435974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-02d18ff2-8273-4055-a772-6d4a0ff648cc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:27.442766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02d18ff2-8273-4055-a772-6d4a0ff648cc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:27.443226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02d18ff2-8273-4055-a772-6d4a0ff648cc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:27.444008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02d18ff2-8273-4055-a772-6d4a0ff648cc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:27.444450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02d18ff2-8273-4055-a772-6d4a0ff648cc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:27.512252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02d18ff2-8273-4055-a772-6d4a0ff648cc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:27.519963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-02d18ff2-8273-4055-a772-6d4a0ff648cc tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.088881 May 23 13:55:27.520529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 854/1790] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:27 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:28.331712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-461ab559-8c6e-4e42-963e-fbbfa3ccbbca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:28.332732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-461ab559-8c6e-4e42-963e-fbbfa3ccbbca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:28.340259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-461ab559-8c6e-4e42-963e-fbbfa3ccbbca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:28.340749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-461ab559-8c6e-4e42-963e-fbbfa3ccbbca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:28.341532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-461ab559-8c6e-4e42-963e-fbbfa3ccbbca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:28.341972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-461ab559-8c6e-4e42-963e-fbbfa3ccbbca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:28.374527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-461ab559-8c6e-4e42-963e-fbbfa3ccbbca tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047136 May 23 13:55:28.375112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 937/1791] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:28.538487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f98e2ff4-95bc-43e3-9537-26a816d12bd6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:28.539158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f98e2ff4-95bc-43e3-9537-26a816d12bd6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:28.546109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f98e2ff4-95bc-43e3-9537-26a816d12bd6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:28.546556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f98e2ff4-95bc-43e3-9537-26a816d12bd6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:28.547342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f98e2ff4-95bc-43e3-9537-26a816d12bd6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:28.547775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f98e2ff4-95bc-43e3-9537-26a816d12bd6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:28.619837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f98e2ff4-95bc-43e3-9537-26a816d12bd6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:28.627803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f98e2ff4-95bc-43e3-9537-26a816d12bd6 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.093414 May 23 13:55:28.628392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 855/1792] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:28 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:29.387594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7327a8db-f4f3-4bb2-a9eb-9c2e0f48b06b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:29.388538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7327a8db-f4f3-4bb2-a9eb-9c2e0f48b06b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:29.395806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7327a8db-f4f3-4bb2-a9eb-9c2e0f48b06b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:29.396258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7327a8db-f4f3-4bb2-a9eb-9c2e0f48b06b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:29.397251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7327a8db-f4f3-4bb2-a9eb-9c2e0f48b06b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:29.397693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7327a8db-f4f3-4bb2-a9eb-9c2e0f48b06b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:29.431058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7327a8db-f4f3-4bb2-a9eb-9c2e0f48b06b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048396 May 23 13:55:29.431638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 938/1793] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:29.645873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8cd3e444-323e-4fc9-b90c-527063216c9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:29.646474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8cd3e444-323e-4fc9-b90c-527063216c9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:29.655303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cd3e444-323e-4fc9-b90c-527063216c9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:29.655759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cd3e444-323e-4fc9-b90c-527063216c9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:29.656535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cd3e444-323e-4fc9-b90c-527063216c9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:29.657007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cd3e444-323e-4fc9-b90c-527063216c9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:29.720030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8cd3e444-323e-4fc9-b90c-527063216c9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:29.727784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8cd3e444-323e-4fc9-b90c-527063216c9c tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085976 May 23 13:55:29.728358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 856/1794] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:29 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:29.774722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:55:29.774978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:55:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:55:30.443747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-84682c3d-2bc1-48a9-bd52-d9c004f0b660 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:30.444688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-84682c3d-2bc1-48a9-bd52-d9c004f0b660 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:30.452286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84682c3d-2bc1-48a9-bd52-d9c004f0b660 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:30.452775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84682c3d-2bc1-48a9-bd52-d9c004f0b660 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:30.453553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84682c3d-2bc1-48a9-bd52-d9c004f0b660 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:30.453989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84682c3d-2bc1-48a9-bd52-d9c004f0b660 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:30.484706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-84682c3d-2bc1-48a9-bd52-d9c004f0b660 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 May 23 13:55:30.485264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 939/1795] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:30.746372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8d758f6-b2ae-4791-8a87-c24e1faaef4a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:30.746940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8d758f6-b2ae-4791-8a87-c24e1faaef4a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:30.753555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d758f6-b2ae-4791-8a87-c24e1faaef4a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:30.755572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d758f6-b2ae-4791-8a87-c24e1faaef4a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:30.755572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d758f6-b2ae-4791-8a87-c24e1faaef4a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:30.755572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8d758f6-b2ae-4791-8a87-c24e1faaef4a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:30.817726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a8d758f6-b2ae-4791-8a87-c24e1faaef4a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:30.826769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8d758f6-b2ae-4791-8a87-c24e1faaef4a tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085454 May 23 13:55:30.827337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 857/1796] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:30 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:31.496851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e4ab5a2e-bfeb-4c19-a066-7c246ef80460 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:31.497684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e4ab5a2e-bfeb-4c19-a066-7c246ef80460 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:31.504315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4ab5a2e-bfeb-4c19-a066-7c246ef80460 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:31.504816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4ab5a2e-bfeb-4c19-a066-7c246ef80460 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:31.505590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4ab5a2e-bfeb-4c19-a066-7c246ef80460 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:31.506029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4ab5a2e-bfeb-4c19-a066-7c246ef80460 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:31.537261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e4ab5a2e-bfeb-4c19-a066-7c246ef80460 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 May 23 13:55:31.537839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 940/1797] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:31.844065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-030da6fb-3fe7-41a4-824b-375ca02ab822 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:31.844691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-030da6fb-3fe7-41a4-824b-375ca02ab822 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:31.851369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-030da6fb-3fe7-41a4-824b-375ca02ab822 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:31.851812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-030da6fb-3fe7-41a4-824b-375ca02ab822 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:31.852591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-030da6fb-3fe7-41a4-824b-375ca02ab822 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:31.853028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-030da6fb-3fe7-41a4-824b-375ca02ab822 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:31.914696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-030da6fb-3fe7-41a4-824b-375ca02ab822 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:31.923019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-030da6fb-3fe7-41a4-824b-375ca02ab822 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.082749 May 23 13:55:31.923591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 858/1798] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:31 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:32.549319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be90391a-7f8e-479c-9246-47952580e888 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:32.550167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be90391a-7f8e-479c-9246-47952580e888 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:32.556763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be90391a-7f8e-479c-9246-47952580e888 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:32.557311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be90391a-7f8e-479c-9246-47952580e888 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:32.558738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be90391a-7f8e-479c-9246-47952580e888 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:32.559187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be90391a-7f8e-479c-9246-47952580e888 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:32.591134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be90391a-7f8e-479c-9246-47952580e888 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 May 23 13:55:32.591737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 941/1799] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:32 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:32.942186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-361d0d83-0db7-4d97-b3a3-8de0dfbf1cd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:32.942791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-361d0d83-0db7-4d97-b3a3-8de0dfbf1cd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:32.950819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-361d0d83-0db7-4d97-b3a3-8de0dfbf1cd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:32.951271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-361d0d83-0db7-4d97-b3a3-8de0dfbf1cd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:32.952050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-361d0d83-0db7-4d97-b3a3-8de0dfbf1cd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:32.952497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-361d0d83-0db7-4d97-b3a3-8de0dfbf1cd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:33.025659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-361d0d83-0db7-4d97-b3a3-8de0dfbf1cd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:33.034420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-361d0d83-0db7-4d97-b3a3-8de0dfbf1cd9 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.096144 May 23 13:55:33.034998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 859/1800] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:32 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:33.603145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dd14e78f-58a9-4a87-af01-62799b56c8a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:33.604139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd14e78f-58a9-4a87-af01-62799b56c8a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:33.610839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd14e78f-58a9-4a87-af01-62799b56c8a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:33.611296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd14e78f-58a9-4a87-af01-62799b56c8a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:33.616276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd14e78f-58a9-4a87-af01-62799b56c8a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:33.616276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd14e78f-58a9-4a87-af01-62799b56c8a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:33.651090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dd14e78f-58a9-4a87-af01-62799b56c8a8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052008 May 23 13:55:33.651672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 942/1801] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:34.052599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7ca7161c-fc26-4c1b-8015-8d5756a046eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:34.053245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7ca7161c-fc26-4c1b-8015-8d5756a046eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:34.060685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7ca7161c-fc26-4c1b-8015-8d5756a046eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:34.061129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7ca7161c-fc26-4c1b-8015-8d5756a046eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:34.061895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7ca7161c-fc26-4c1b-8015-8d5756a046eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:34.062325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7ca7161c-fc26-4c1b-8015-8d5756a046eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:34.124926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7ca7161c-fc26-4c1b-8015-8d5756a046eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:34.132478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7ca7161c-fc26-4c1b-8015-8d5756a046eb tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083808 May 23 13:55:34.133309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 860/1802] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:34 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:34.663108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a6725662-37d7-4d02-ab87-e3331cc9d111 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:34.664030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a6725662-37d7-4d02-ab87-e3331cc9d111 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:34.671525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6725662-37d7-4d02-ab87-e3331cc9d111 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:34.671980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6725662-37d7-4d02-ab87-e3331cc9d111 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:34.672814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6725662-37d7-4d02-ab87-e3331cc9d111 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:34.673263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6725662-37d7-4d02-ab87-e3331cc9d111 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:34.703674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a6725662-37d7-4d02-ab87-e3331cc9d111 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 May 23 13:55:34.704252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 943/1803] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:35.149460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f707fb40-31f3-4170-b286-bd36745efd79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:35.150145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f707fb40-31f3-4170-b286-bd36745efd79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:35.158110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f707fb40-31f3-4170-b286-bd36745efd79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:35.158566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f707fb40-31f3-4170-b286-bd36745efd79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:35.159339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f707fb40-31f3-4170-b286-bd36745efd79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:35.159776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f707fb40-31f3-4170-b286-bd36745efd79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:35.223033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f707fb40-31f3-4170-b286-bd36745efd79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:35.231959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f707fb40-31f3-4170-b286-bd36745efd79 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086478 May 23 13:55:35.234632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 861/1804] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:35 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:35.716196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e79cf616-59d4-4ff7-8278-fc49b6acdb08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:35.717151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e79cf616-59d4-4ff7-8278-fc49b6acdb08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:35.724414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e79cf616-59d4-4ff7-8278-fc49b6acdb08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:35.724898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e79cf616-59d4-4ff7-8278-fc49b6acdb08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:35.725677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e79cf616-59d4-4ff7-8278-fc49b6acdb08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:35.726121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e79cf616-59d4-4ff7-8278-fc49b6acdb08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:35.755542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e79cf616-59d4-4ff7-8278-fc49b6acdb08 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 May 23 13:55:35.756099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 944/1805] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:55:36.250300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3852e5d3-2022-4ea9-aee6-7d60fea78695 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:36.250919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3852e5d3-2022-4ea9-aee6-7d60fea78695 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:36.257652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3852e5d3-2022-4ea9-aee6-7d60fea78695 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:36.258107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3852e5d3-2022-4ea9-aee6-7d60fea78695 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:36.258889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3852e5d3-2022-4ea9-aee6-7d60fea78695 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:36.259325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3852e5d3-2022-4ea9-aee6-7d60fea78695 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:36.327541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3852e5d3-2022-4ea9-aee6-7d60fea78695 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:36.335903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3852e5d3-2022-4ea9-aee6-7d60fea78695 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090482 May 23 13:55:36.336471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 862/1806] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:36 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:36.767274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-900776b1-2de0-4170-b2fb-2dc70cbaae97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:36.778618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-900776b1-2de0-4170-b2fb-2dc70cbaae97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:36.778618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-900776b1-2de0-4170-b2fb-2dc70cbaae97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:36.778618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-900776b1-2de0-4170-b2fb-2dc70cbaae97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:36.778618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-900776b1-2de0-4170-b2fb-2dc70cbaae97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:36.779133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-900776b1-2de0-4170-b2fb-2dc70cbaae97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:36.801930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:36.806347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-900776b1-2de0-4170-b2fb-2dc70cbaae97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043108 May 23 13:55:36.806899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 945/1807] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:37.352862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-658ec8f7-023f-4c13-8d21-5cd533e2cce2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:37.353535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-658ec8f7-023f-4c13-8d21-5cd533e2cce2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:37.360200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-658ec8f7-023f-4c13-8d21-5cd533e2cce2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:37.360689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-658ec8f7-023f-4c13-8d21-5cd533e2cce2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:37.361457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-658ec8f7-023f-4c13-8d21-5cd533e2cce2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:37.361890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-658ec8f7-023f-4c13-8d21-5cd533e2cce2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:37.435505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-658ec8f7-023f-4c13-8d21-5cd533e2cce2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:37.443418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-658ec8f7-023f-4c13-8d21-5cd533e2cce2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.094383 May 23 13:55:37.444000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 863/1808] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:37 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:37.818328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-36e23811-2c74-4ab2-8cc0-fc1e6f90fdee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:37.819351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-36e23811-2c74-4ab2-8cc0-fc1e6f90fdee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:37.827436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36e23811-2c74-4ab2-8cc0-fc1e6f90fdee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:37.827890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36e23811-2c74-4ab2-8cc0-fc1e6f90fdee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:37.828774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36e23811-2c74-4ab2-8cc0-fc1e6f90fdee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:37.829216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36e23811-2c74-4ab2-8cc0-fc1e6f90fdee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:37.860151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-36e23811-2c74-4ab2-8cc0-fc1e6f90fdee tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045822 May 23 13:55:37.860743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 946/1809] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:38.461493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da2feba3-db81-436f-9e9b-ed7900b49b67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:38.462025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da2feba3-db81-436f-9e9b-ed7900b49b67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:38.468846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da2feba3-db81-436f-9e9b-ed7900b49b67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:38.469297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da2feba3-db81-436f-9e9b-ed7900b49b67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:38.470056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da2feba3-db81-436f-9e9b-ed7900b49b67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:38.470486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da2feba3-db81-436f-9e9b-ed7900b49b67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:38.534103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da2feba3-db81-436f-9e9b-ed7900b49b67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:38.543634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da2feba3-db81-436f-9e9b-ed7900b49b67 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.086582 May 23 13:55:38.544292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 864/1810] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:38 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:38.871970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-346e4518-a463-45a7-bafe-ffcbeee9b7a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:38.872933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-346e4518-a463-45a7-bafe-ffcbeee9b7a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:38.879549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-346e4518-a463-45a7-bafe-ffcbeee9b7a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:38.879986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-346e4518-a463-45a7-bafe-ffcbeee9b7a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:38.880812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-346e4518-a463-45a7-bafe-ffcbeee9b7a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:38.881254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-346e4518-a463-45a7-bafe-ffcbeee9b7a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:38.912322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-346e4518-a463-45a7-bafe-ffcbeee9b7a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 May 23 13:55:38.912912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 947/1811] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:39.562315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-66c758d8-48d6-4d84-9d2a-5aa93d915ed2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:39.562906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-66c758d8-48d6-4d84-9d2a-5aa93d915ed2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:39.573577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66c758d8-48d6-4d84-9d2a-5aa93d915ed2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:39.574023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66c758d8-48d6-4d84-9d2a-5aa93d915ed2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:39.575750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66c758d8-48d6-4d84-9d2a-5aa93d915ed2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:39.575750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66c758d8-48d6-4d84-9d2a-5aa93d915ed2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:39.661202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-66c758d8-48d6-4d84-9d2a-5aa93d915ed2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:39.671108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-66c758d8-48d6-4d84-9d2a-5aa93d915ed2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.113763 May 23 13:55:39.672722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 865/1812] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:39 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:39.924268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c0451cef-981d-4fb0-8195-91d4667225f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:39.925307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c0451cef-981d-4fb0-8195-91d4667225f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:39.933544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0451cef-981d-4fb0-8195-91d4667225f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:39.933996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0451cef-981d-4fb0-8195-91d4667225f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:39.935119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0451cef-981d-4fb0-8195-91d4667225f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:39.935751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0451cef-981d-4fb0-8195-91d4667225f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:39.968304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c0451cef-981d-4fb0-8195-91d4667225f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048024 May 23 13:55:39.968903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 948/1813] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:40.689938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-28c8f7b4-a8bf-495b-aae1-4ae87aba353e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:40.690551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-28c8f7b4-a8bf-495b-aae1-4ae87aba353e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:40.697117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28c8f7b4-a8bf-495b-aae1-4ae87aba353e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:40.698157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28c8f7b4-a8bf-495b-aae1-4ae87aba353e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:40.698956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28c8f7b4-a8bf-495b-aae1-4ae87aba353e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:40.699653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28c8f7b4-a8bf-495b-aae1-4ae87aba353e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:40.761617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-28c8f7b4-a8bf-495b-aae1-4ae87aba353e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:40.769049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-28c8f7b4-a8bf-495b-aae1-4ae87aba353e tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.083085 May 23 13:55:40.769616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 866/1814] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:40 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:40.980399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2eb60de-c4b0-4453-aafd-a8ffef5c2aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:40.981345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2eb60de-c4b0-4453-aafd-a8ffef5c2aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:40.992018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2eb60de-c4b0-4453-aafd-a8ffef5c2aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:40.992561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2eb60de-c4b0-4453-aafd-a8ffef5c2aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:40.993304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2eb60de-c4b0-4453-aafd-a8ffef5c2aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:40.993914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2eb60de-c4b0-4453-aafd-a8ffef5c2aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:41.024944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2eb60de-c4b0-4453-aafd-a8ffef5c2aff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048749 May 23 13:55:41.025600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 949/1815] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:41.786942 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6768a9e6-4157-47f1-8759-e43625087a97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:41.787557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6768a9e6-4157-47f1-8759-e43625087a97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:41.794885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6768a9e6-4157-47f1-8759-e43625087a97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:41.795332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6768a9e6-4157-47f1-8759-e43625087a97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:41.796091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6768a9e6-4157-47f1-8759-e43625087a97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:41.796530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6768a9e6-4157-47f1-8759-e43625087a97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:41.860317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6768a9e6-4157-47f1-8759-e43625087a97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:41.868262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6768a9e6-4157-47f1-8759-e43625087a97 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.085272 May 23 13:55:41.868864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 867/1816] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:41 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:42.037408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5cf8dedf-be3c-403a-822a-71c25dcceed4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:42.038533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5cf8dedf-be3c-403a-822a-71c25dcceed4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:42.045836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5cf8dedf-be3c-403a-822a-71c25dcceed4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:42.046293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5cf8dedf-be3c-403a-822a-71c25dcceed4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:42.047073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5cf8dedf-be3c-403a-822a-71c25dcceed4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:42.047518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5cf8dedf-be3c-403a-822a-71c25dcceed4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:42.078097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5cf8dedf-be3c-403a-822a-71c25dcceed4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 May 23 13:55:42.078674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 950/1817] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:42.885778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-efd1825b-3b67-4cfa-b593-9cc262bb174f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:42.886393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-efd1825b-3b67-4cfa-b593-9cc262bb174f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:42.893629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efd1825b-3b67-4cfa-b593-9cc262bb174f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:42.894088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efd1825b-3b67-4cfa-b593-9cc262bb174f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:42.894884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efd1825b-3b67-4cfa-b593-9cc262bb174f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:42.895324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-efd1825b-3b67-4cfa-b593-9cc262bb174f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:42.961246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-efd1825b-3b67-4cfa-b593-9cc262bb174f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:42.969531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-efd1825b-3b67-4cfa-b593-9cc262bb174f tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.087812 May 23 13:55:42.970111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 868/1818] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:42 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:43.090407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-117ec2f3-2a9a-45d9-bded-f3bb3586ed97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:43.091316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-117ec2f3-2a9a-45d9-bded-f3bb3586ed97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:43.097838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-117ec2f3-2a9a-45d9-bded-f3bb3586ed97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:43.098283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-117ec2f3-2a9a-45d9-bded-f3bb3586ed97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:43.099072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-117ec2f3-2a9a-45d9-bded-f3bb3586ed97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:43.099503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-117ec2f3-2a9a-45d9-bded-f3bb3586ed97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:43.131023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-117ec2f3-2a9a-45d9-bded-f3bb3586ed97 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045211 May 23 13:55:43.131597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 951/1819] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:43.807861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:55:43.808106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:55:43.987600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c4963f2b-a6e7-464e-ac4f-acfcc22896ca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:43.988277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c4963f2b-a6e7-464e-ac4f-acfcc22896ca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:43.997142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4963f2b-a6e7-464e-ac4f-acfcc22896ca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:43.997600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4963f2b-a6e7-464e-ac4f-acfcc22896ca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:43.998378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4963f2b-a6e7-464e-ac4f-acfcc22896ca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:43.998822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4963f2b-a6e7-464e-ac4f-acfcc22896ca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:44.022578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:44.066746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4963f2b-a6e7-464e-ac4f-acfcc22896ca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:44.075253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c4963f2b-a6e7-464e-ac4f-acfcc22896ca tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.091516 May 23 13:55:44.075810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 869/1820] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:43 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:44.143447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-833e6101-8686-4e81-b3f6-2b1a088a4b89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:44.144404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-833e6101-8686-4e81-b3f6-2b1a088a4b89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:44.151468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-833e6101-8686-4e81-b3f6-2b1a088a4b89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:44.151917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-833e6101-8686-4e81-b3f6-2b1a088a4b89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:44.152712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-833e6101-8686-4e81-b3f6-2b1a088a4b89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:44.153150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-833e6101-8686-4e81-b3f6-2b1a088a4b89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:44.184186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-833e6101-8686-4e81-b3f6-2b1a088a4b89 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 May 23 13:55:44.184793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 952/1821] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:45.092234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2eeca00-c0e3-4dc7-82e9-a05e437f43f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:45.092873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c2eeca00-c0e3-4dc7-82e9-a05e437f43f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:45.099400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2eeca00-c0e3-4dc7-82e9-a05e437f43f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:45.099858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2eeca00-c0e3-4dc7-82e9-a05e437f43f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:45.100643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2eeca00-c0e3-4dc7-82e9-a05e437f43f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:45.101082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2eeca00-c0e3-4dc7-82e9-a05e437f43f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:45.164291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c2eeca00-c0e3-4dc7-82e9-a05e437f43f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:45.172474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c2eeca00-c0e3-4dc7-82e9-a05e437f43f1 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084107 May 23 13:55:45.173070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 870/1822] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:45 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:45.195979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a8116ac-d307-45c8-bc87-b06fafdb4b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:45.196953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a8116ac-d307-45c8-bc87-b06fafdb4b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:45.203820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a8116ac-d307-45c8-bc87-b06fafdb4b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:45.204295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a8116ac-d307-45c8-bc87-b06fafdb4b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:45.205108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a8116ac-d307-45c8-bc87-b06fafdb4b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:45.205539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a8116ac-d307-45c8-bc87-b06fafdb4b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:45.235744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a8116ac-d307-45c8-bc87-b06fafdb4b23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 May 23 13:55:45.236302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 953/1823] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:46.193490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5917666c-7c02-4a63-a202-6b093bf65f8d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:46.194092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5917666c-7c02-4a63-a202-6b093bf65f8d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:46.201689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5917666c-7c02-4a63-a202-6b093bf65f8d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:46.202048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5917666c-7c02-4a63-a202-6b093bf65f8d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:46.202828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5917666c-7c02-4a63-a202-6b093bf65f8d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:46.203243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5917666c-7c02-4a63-a202-6b093bf65f8d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:46.247370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9749362d-11e8-43eb-bb59-6651984f7d85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:46.248304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9749362d-11e8-43eb-bb59-6651984f7d85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:46.254913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9749362d-11e8-43eb-bb59-6651984f7d85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:46.255374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9749362d-11e8-43eb-bb59-6651984f7d85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:46.256162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9749362d-11e8-43eb-bb59-6651984f7d85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:46.256653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9749362d-11e8-43eb-bb59-6651984f7d85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:46.289027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9749362d-11e8-43eb-bb59-6651984f7d85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045559 May 23 13:55:46.289502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 954/1824] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 13:55:46.446270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5917666c-7c02-4a63-a202-6b093bf65f8d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:46.455004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5917666c-7c02-4a63-a202-6b093bf65f8d tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.265390 May 23 13:55:46.455555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 871/1825] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:46 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:47.301428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d7ff6887-a7e0-4bb0-9d74-af8ad69da9d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:47.302387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d7ff6887-a7e0-4bb0-9d74-af8ad69da9d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:47.309557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ff6887-a7e0-4bb0-9d74-af8ad69da9d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:47.310012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ff6887-a7e0-4bb0-9d74-af8ad69da9d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:47.310787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ff6887-a7e0-4bb0-9d74-af8ad69da9d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:47.311228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ff6887-a7e0-4bb0-9d74-af8ad69da9d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:47.342116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d7ff6887-a7e0-4bb0-9d74-af8ad69da9d6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 May 23 13:55:47.342681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 955/1826] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:47.472140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc7b02c2-130f-46aa-bc81-ed59c8b756c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:47.472715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc7b02c2-130f-46aa-bc81-ed59c8b756c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:47.479070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc7b02c2-130f-46aa-bc81-ed59c8b756c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:47.479513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc7b02c2-130f-46aa-bc81-ed59c8b756c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:47.480271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc7b02c2-130f-46aa-bc81-ed59c8b756c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:47.480728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc7b02c2-130f-46aa-bc81-ed59c8b756c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:47.542583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dc7b02c2-130f-46aa-bc81-ed59c8b756c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:47.550084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc7b02c2-130f-46aa-bc81-ed59c8b756c2 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.081893 May 23 13:55:47.550647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 872/1827] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:47 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:48.354395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a4d8e49-362b-4d3f-ae9f-991caca62c5f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:48.355333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a4d8e49-362b-4d3f-ae9f-991caca62c5f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:48.361869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a4d8e49-362b-4d3f-ae9f-991caca62c5f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:48.362315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a4d8e49-362b-4d3f-ae9f-991caca62c5f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:48.363147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a4d8e49-362b-4d3f-ae9f-991caca62c5f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:48.363581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a4d8e49-362b-4d3f-ae9f-991caca62c5f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:48.392445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a4d8e49-362b-4d3f-ae9f-991caca62c5f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 May 23 13:55:48.393031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 956/1828] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 13:55:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:55:48.568707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e5080af6-05b1-41e8-b089-f2f78569a904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:48.569370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e5080af6-05b1-41e8-b089-f2f78569a904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:48.576291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5080af6-05b1-41e8-b089-f2f78569a904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:48.576782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5080af6-05b1-41e8-b089-f2f78569a904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:48.577560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5080af6-05b1-41e8-b089-f2f78569a904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:48.577999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5080af6-05b1-41e8-b089-f2f78569a904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:48.641373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e5080af6-05b1-41e8-b089-f2f78569a904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:48.649266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e5080af6-05b1-41e8-b089-f2f78569a904 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.084662 May 23 13:55:48.649829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 873/1829] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:48 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:49.404147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7e08a7f-12f9-4c66-813a-039e3bb17fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:55:49.405101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7e08a7f-12f9-4c66-813a-039e3bb17fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:49.411826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e08a7f-12f9-4c66-813a-039e3bb17fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:49.412284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e08a7f-12f9-4c66-813a-039e3bb17fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:49.413096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e08a7f-12f9-4c66-813a-039e3bb17fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:49.413538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e08a7f-12f9-4c66-813a-039e3bb17fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:49.514721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7e08a7f-12f9-4c66-813a-039e3bb17fd2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "POST /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/action" status: 200 len: 75920 microversion: 2.1 time: 0.114841 May 23 13:55:49.515302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 957/1830] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 23 13:55:49 2022] POST /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7/action => generated 75920 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 13:55:49.667483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1f8d606c-36cc-49e7-8ff9-13959834edab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:49.668095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1f8d606c-36cc-49e7-8ff9-13959834edab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:49.675086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f8d606c-36cc-49e7-8ff9-13959834edab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:49.675531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f8d606c-36cc-49e7-8ff9-13959834edab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:49.676288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f8d606c-36cc-49e7-8ff9-13959834edab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:49.676766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f8d606c-36cc-49e7-8ff9-13959834edab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:49.745312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1f8d606c-36cc-49e7-8ff9-13959834edab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:49.752905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1f8d606c-36cc-49e7-8ff9-13959834edab tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.090007 May 23 13:55:49.753473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 874/1831] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:49 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:50.771063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-62d8ca60-531b-4e25-84ec-965226eb3c73 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:50.771686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-62d8ca60-531b-4e25-84ec-965226eb3c73 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] [instance: f83ea9db-9db3-48c0-83a5-c423a1151195] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:50.779691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62d8ca60-531b-4e25-84ec-965226eb3c73 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:50.780145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62d8ca60-531b-4e25-84ec-965226eb3c73 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:50.780948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62d8ca60-531b-4e25-84ec-965226eb3c73 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:50.781397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62d8ca60-531b-4e25-84ec-965226eb3c73 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:51.010044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-62d8ca60-531b-4e25-84ec-965226eb3c73 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ffd5c4601c4ccf90d09be72f41a33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441389e662041a1945ee7164ad17159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:51.017773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-62d8ca60-531b-4e25-84ec-965226eb3c73 tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195" status: 200 len: 1220 microversion: 2.1 time: 0.250976 May 23 13:55:51.018378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 958/1832] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:50 2022] GET /compute/v2.1/servers/f83ea9db-9db3-48c0-83a5-c423a1151195 => generated 1220 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:51.334571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c90f35c4-7492-4387-a06a-09e80dabdead tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] Calling method '.version_select at 0x7effb272d040>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:51.451427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c90f35c4-7492-4387-a06a-09e80dabdead tempest-TestShelveInstance-1604072456 tempest-TestShelveInstance-1604072456-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1405250442" status: 202 len: 0 microversion: 2.1 time: 0.120924 May 23 13:55:51.452006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 875/1833] 10.222.0.70 () {58 vars in 1253 bytes} [Mon May 23 13:55:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1405250442 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 13:55:54.624297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dd35c10c-cb03-45a7-baef-865d574f858d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:54.624297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd35c10c-cb03-45a7-baef-865d574f858d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:54.630183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=56 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:54.632985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd35c10c-cb03-45a7-baef-865d574f858d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:54.633475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd35c10c-cb03-45a7-baef-865d574f858d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:54.635895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd35c10c-cb03-45a7-baef-865d574f858d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:54.636540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd35c10c-cb03-45a7-baef-865d574f858d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:54.667198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd35c10c-cb03-45a7-baef-865d574f858d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:55:54.696177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ec87a09-20b5-4d69-95da-097a09b37355 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:54.697942 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ec87a09-20b5-4d69-95da-097a09b37355 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:54.701461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:54.709479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ec87a09-20b5-4d69-95da-097a09b37355 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:54.710253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ec87a09-20b5-4d69-95da-097a09b37355 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:54.711060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ec87a09-20b5-4d69-95da-097a09b37355 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:54.711812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ec87a09-20b5-4d69-95da-097a09b37355 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:54.746262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ec87a09-20b5-4d69-95da-097a09b37355 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:55:55.094998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dd35c10c-cb03-45a7-baef-865d574f858d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 204 len: 0 microversion: 2.1 time: 0.477916 May 23 13:55:55.095594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 959/1834] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:55:54 2022] DELETE /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 13:55:55.101219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bdadcd9f-4e8b-4aad-8be0-7ad759a72a90 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:55.101824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bdadcd9f-4e8b-4aad-8be0-7ad759a72a90 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:55.109395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdadcd9f-4e8b-4aad-8be0-7ad759a72a90 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.110135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdadcd9f-4e8b-4aad-8be0-7ad759a72a90 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:55.111113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdadcd9f-4e8b-4aad-8be0-7ad759a72a90 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.111710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdadcd9f-4e8b-4aad-8be0-7ad759a72a90 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:55.142460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bdadcd9f-4e8b-4aad-8be0-7ad759a72a90 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:55:55.158547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:55.192446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ec87a09-20b5-4d69-95da-097a09b37355 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 204 len: 0 microversion: 2.20 time: 0.501484 May 23 13:55:55.193098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 876/1835] 10.222.0.70 () {60 vars in 1279 bytes} [Mon May 23 13:55:54 2022] DELETE /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 13:55:55.198456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a577eda5-6742-4254-86ed-ffc8d4c47655 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:55.199308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a577eda5-6742-4254-86ed-ffc8d4c47655 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:55.205918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a577eda5-6742-4254-86ed-ffc8d4c47655 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.206417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a577eda5-6742-4254-86ed-ffc8d4c47655 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:55.207154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a577eda5-6742-4254-86ed-ffc8d4c47655 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.207605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a577eda5-6742-4254-86ed-ffc8d4c47655 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:55.239475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a577eda5-6742-4254-86ed-ffc8d4c47655 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:55:55.672025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bdadcd9f-4e8b-4aad-8be0-7ad759a72a90 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 204 len: 0 microversion: 2.1 time: 0.574877 May 23 13:55:55.672944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 960/1836] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:55:55 2022] DELETE /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 13:55:55.678587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fefac236-f8b9-4ccd-b70a-384a00a7cfce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:55.679252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fefac236-f8b9-4ccd-b70a-384a00a7cfce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:55.685292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fefac236-f8b9-4ccd-b70a-384a00a7cfce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.685747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fefac236-f8b9-4ccd-b70a-384a00a7cfce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:55.686607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fefac236-f8b9-4ccd-b70a-384a00a7cfce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.687042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fefac236-f8b9-4ccd-b70a-384a00a7cfce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:55.724071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a577eda5-6742-4254-86ed-ffc8d4c47655 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 204 len: 0 microversion: 2.1 time: 0.529238 May 23 13:55:55.724706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 877/1837] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:55:55 2022] DELETE /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 13:55:55.730828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:55.731623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:55.737927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.738560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:55.739367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.739991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:55.952244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:55.967046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:55.968705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:55.970990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d1eba7fb-4804-4bb5-9f71-82495c73bb10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.244804 May 23 13:55:55.971800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 878/1838] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:55:55 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:55:55.986686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba37f99d-bf09-4486-a8ce-1d951f0e7d1b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:55.990979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba37f99d-bf09-4486-a8ce-1d951f0e7d1b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:55.993779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fefac236-f8b9-4ccd-b70a-384a00a7cfce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:55.998066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba37f99d-bf09-4486-a8ce-1d951f0e7d1b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.998513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba37f99d-bf09-4486-a8ce-1d951f0e7d1b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:55.999474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba37f99d-bf09-4486-a8ce-1d951f0e7d1b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:55.999906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba37f99d-bf09-4486-a8ce-1d951f0e7d1b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:56.006596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fefac236-f8b9-4ccd-b70a-384a00a7cfce tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.332406 May 23 13:55:56.007181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 961/1839] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:55 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:56.015747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d5b039cd-7b38-4e9c-8e8d-6187a48e9728 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:56.020953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d5b039cd-7b38-4e9c-8e8d-6187a48e9728 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:56.033032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5b039cd-7b38-4e9c-8e8d-6187a48e9728 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:56.042631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5b039cd-7b38-4e9c-8e8d-6187a48e9728 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:56.042631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5b039cd-7b38-4e9c-8e8d-6187a48e9728 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:56.042631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5b039cd-7b38-4e9c-8e8d-6187a48e9728 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:56.158207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba37f99d-bf09-4486-a8ce-1d951f0e7d1b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:56.171912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba37f99d-bf09-4486-a8ce-1d951f0e7d1b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.198763 May 23 13:55:56.173038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 879/1840] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:55 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:56.298892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d5b039cd-7b38-4e9c-8e8d-6187a48e9728 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:56.309584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d5b039cd-7b38-4e9c-8e8d-6187a48e9728 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.301175 May 23 13:55:56.310691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 962/1841] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:56 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:56.992127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:56.992732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:56.999513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:56.999991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:57.000792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:57.001229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:57.028863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f25e0322-c269-40fe-9e8a-7cd106e817ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:57.029593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f25e0322-c269-40fe-9e8a-7cd106e817ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:57.036099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f25e0322-c269-40fe-9e8a-7cd106e817ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:57.036599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f25e0322-c269-40fe-9e8a-7cd106e817ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:57.037388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f25e0322-c269-40fe-9e8a-7cd106e817ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:57.037831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f25e0322-c269-40fe-9e8a-7cd106e817ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:57.180753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f25e0322-c269-40fe-9e8a-7cd106e817ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:57.190935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f25e0322-c269-40fe-9e8a-7cd106e817ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.167320 May 23 13:55:57.191653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 963/1842] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:57 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:57.198320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65696842-bc06-4737-9dad-8cecb0a421b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:57.198777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-65696842-bc06-4737-9dad-8cecb0a421b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:57.204902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65696842-bc06-4737-9dad-8cecb0a421b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:57.205482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65696842-bc06-4737-9dad-8cecb0a421b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:57.206275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65696842-bc06-4737-9dad-8cecb0a421b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:57.206714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65696842-bc06-4737-9dad-8cecb0a421b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:57.293839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:57.303252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:57.305347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:57.306755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75995b24-8082-49e0-94e9-1d3de42de894 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.318599 May 23 13:55:57.307414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 880/1843] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:55:56 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:55:57.328980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd737f8f-8c41-4622-85b6-03aec2a1c4d9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:57.329883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd737f8f-8c41-4622-85b6-03aec2a1c4d9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:57.336213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd737f8f-8c41-4622-85b6-03aec2a1c4d9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:57.336687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd737f8f-8c41-4622-85b6-03aec2a1c4d9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:57.338368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd737f8f-8c41-4622-85b6-03aec2a1c4d9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:57.339002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd737f8f-8c41-4622-85b6-03aec2a1c4d9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:57.349170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-65696842-bc06-4737-9dad-8cecb0a421b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:57.358029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65696842-bc06-4737-9dad-8cecb0a421b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164393 May 23 13:55:57.358916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 964/1844] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:57 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:57.617855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd737f8f-8c41-4622-85b6-03aec2a1c4d9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:57.626866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd737f8f-8c41-4622-85b6-03aec2a1c4d9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.302370 May 23 13:55:57.627445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 881/1845] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:57 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:55:58.214165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65a5cfe2-96a4-43b2-93d0-9a5ef0194aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:58.215309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-65a5cfe2-96a4-43b2-93d0-9a5ef0194aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:58.233012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65a5cfe2-96a4-43b2-93d0-9a5ef0194aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:58.233817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65a5cfe2-96a4-43b2-93d0-9a5ef0194aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:58.235171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65a5cfe2-96a4-43b2-93d0-9a5ef0194aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:58.235941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-65a5cfe2-96a4-43b2-93d0-9a5ef0194aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:58.326956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:58.327567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:58.334589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:58.335033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:58.335793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:58.336393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:58.378896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-65a5cfe2-96a4-43b2-93d0-9a5ef0194aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:58.387521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65a5cfe2-96a4-43b2-93d0-9a5ef0194aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.181064 May 23 13:55:58.388103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 965/1846] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:58 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:58.392879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f0c129e-ed3c-4aa3-8386-5915e808bcb1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:58.393489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f0c129e-ed3c-4aa3-8386-5915e808bcb1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:58.400359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f0c129e-ed3c-4aa3-8386-5915e808bcb1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:58.400940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f0c129e-ed3c-4aa3-8386-5915e808bcb1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:58.401784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f0c129e-ed3c-4aa3-8386-5915e808bcb1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:58.402434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f0c129e-ed3c-4aa3-8386-5915e808bcb1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:58.538907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f0c129e-ed3c-4aa3-8386-5915e808bcb1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:58.547747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f0c129e-ed3c-4aa3-8386-5915e808bcb1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158638 May 23 13:55:58.548323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 966/1847] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:58 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:58.562921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:58.571997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:58.573825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:58.575011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cac509b1-a3f1-4da8-8cc8-9a76d0b85114 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.252505 May 23 13:55:58.575566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 882/1848] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:55:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:55:58.646435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6289f610-1563-4d47-b48a-76869e2bff5f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:58.647060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6289f610-1563-4d47-b48a-76869e2bff5f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:58.655000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6289f610-1563-4d47-b48a-76869e2bff5f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:58.655548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6289f610-1563-4d47-b48a-76869e2bff5f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:58.656496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6289f610-1563-4d47-b48a-76869e2bff5f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:58.657089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6289f610-1563-4d47-b48a-76869e2bff5f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:58.908446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6289f610-1563-4d47-b48a-76869e2bff5f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:58.919580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6289f610-1563-4d47-b48a-76869e2bff5f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.278105 May 23 13:55:58.920271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 967/1849] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:58 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:59.405717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bd84742f-cc3b-473d-8d30-83b34b77e106 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:59.406358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd84742f-cc3b-473d-8d30-83b34b77e106 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:59.412924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd84742f-cc3b-473d-8d30-83b34b77e106 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:59.413377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd84742f-cc3b-473d-8d30-83b34b77e106 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:59.414134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd84742f-cc3b-473d-8d30-83b34b77e106 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:59.414567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd84742f-cc3b-473d-8d30-83b34b77e106 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:59.564991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bd84742f-cc3b-473d-8d30-83b34b77e106 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:59.567107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15f34915-e655-4729-93ca-1a788812f117 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:59.568300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15f34915-e655-4729-93ca-1a788812f117 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:59.569070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:55:59.576360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bd84742f-cc3b-473d-8d30-83b34b77e106 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.174279 May 23 13:55:59.576622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15f34915-e655-4729-93ca-1a788812f117 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:59.576903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15f34915-e655-4729-93ca-1a788812f117 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:59.577644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 883/1850] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:59 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:55:59.584784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15f34915-e655-4729-93ca-1a788812f117 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:59.584784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15f34915-e655-4729-93ca-1a788812f117 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:59.596833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:59.597675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:59.604646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:59.605305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:59.606540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:59.607138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:59.762635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:59.774165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:59.776437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:59.778127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9c8a37aa-058c-44b0-843d-f1ac30eb92c8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.186867 May 23 13:55:59.778799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 884/1851] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:55:59 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:55:59.859289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15f34915-e655-4729-93ca-1a788812f117 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:55:59.867607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15f34915-e655-4729-93ca-1a788812f117 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.304852 May 23 13:55:59.868747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 968/1852] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:59 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:55:59.937881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-de2a475d-8d96-4b42-aa5c-3cd13877b8a9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:55:59.938586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-de2a475d-8d96-4b42-aa5c-3cd13877b8a9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:55:59.946090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de2a475d-8d96-4b42-aa5c-3cd13877b8a9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:59.947104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de2a475d-8d96-4b42-aa5c-3cd13877b8a9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:55:59.947910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de2a475d-8d96-4b42-aa5c-3cd13877b8a9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:55:59.948594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de2a475d-8d96-4b42-aa5c-3cd13877b8a9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:00.098224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-de2a475d-8d96-4b42-aa5c-3cd13877b8a9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:00.107539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-de2a475d-8d96-4b42-aa5c-3cd13877b8a9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.173476 May 23 13:56:00.108123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 885/1853] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:55:59 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:00.595509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed49f733-5a9e-4507-8b0a-910432f5cb25 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:00.597428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed49f733-5a9e-4507-8b0a-910432f5cb25 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:00.607785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed49f733-5a9e-4507-8b0a-910432f5cb25 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:00.608525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed49f733-5a9e-4507-8b0a-910432f5cb25 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:00.609592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed49f733-5a9e-4507-8b0a-910432f5cb25 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:00.610191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed49f733-5a9e-4507-8b0a-910432f5cb25 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:00.776027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed49f733-5a9e-4507-8b0a-910432f5cb25 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:00.785567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed49f733-5a9e-4507-8b0a-910432f5cb25 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.194541 May 23 13:56:00.796732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 969/1854] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:00 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:00.799364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:00.800009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:00.807522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:00.807900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:00.808878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:00.809601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:00.886570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-88f15827-d6ad-453b-a4a9-e4156a72cf61 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:00.887258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-88f15827-d6ad-453b-a4a9-e4156a72cf61 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:00.901036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88f15827-d6ad-453b-a4a9-e4156a72cf61 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:00.901744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88f15827-d6ad-453b-a4a9-e4156a72cf61 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:00.902273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88f15827-d6ad-453b-a4a9-e4156a72cf61 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:00.902715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88f15827-d6ad-453b-a4a9-e4156a72cf61 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:00.959031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:00.971051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:00.972558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:00.973817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0f884b6-627a-4949-a5c5-ea7b8f1254aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.178812 May 23 13:56:00.974385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 886/1855] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:01.125736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d825a9ce-6ad0-48a1-8991-3a2ca7f20c86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:01.126691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d825a9ce-6ad0-48a1-8991-3a2ca7f20c86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:01.133370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d825a9ce-6ad0-48a1-8991-3a2ca7f20c86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:01.134106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d825a9ce-6ad0-48a1-8991-3a2ca7f20c86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:01.135332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d825a9ce-6ad0-48a1-8991-3a2ca7f20c86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:01.135767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d825a9ce-6ad0-48a1-8991-3a2ca7f20c86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:01.275641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d825a9ce-6ad0-48a1-8991-3a2ca7f20c86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:01.284365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d825a9ce-6ad0-48a1-8991-3a2ca7f20c86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.163004 May 23 13:56:01.285188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 887/1856] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:01 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:01.376005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-88f15827-d6ad-453b-a4a9-e4156a72cf61 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:01.386649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-88f15827-d6ad-453b-a4a9-e4156a72cf61 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.504798 May 23 13:56:01.392764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 970/1857] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:00 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:01.803389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c517d22-7e77-4b12-a878-6d8d1426edda tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:01.804647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7c517d22-7e77-4b12-a878-6d8d1426edda tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:01.812736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c517d22-7e77-4b12-a878-6d8d1426edda tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:01.813672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c517d22-7e77-4b12-a878-6d8d1426edda tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:01.814746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c517d22-7e77-4b12-a878-6d8d1426edda tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:01.815078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c517d22-7e77-4b12-a878-6d8d1426edda tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:01.993947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:01.994745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:02.001172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:02.001628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:02.002413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:02.002856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:02.038726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c517d22-7e77-4b12-a878-6d8d1426edda tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:02.045173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c517d22-7e77-4b12-a878-6d8d1426edda tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.245550 May 23 13:56:02.045753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 888/1858] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:01 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:02.136477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:02.147925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:02.150021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:02.151733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a059034-2de5-4bf2-9dda-38285170b3d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.162412 May 23 13:56:02.152521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 971/1859] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:01 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:02.303950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d349d17a-b7d7-4515-8c9d-9d1d7c49489b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:02.304598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d349d17a-b7d7-4515-8c9d-9d1d7c49489b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:02.311152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d349d17a-b7d7-4515-8c9d-9d1d7c49489b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:02.311605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d349d17a-b7d7-4515-8c9d-9d1d7c49489b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:02.312373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d349d17a-b7d7-4515-8c9d-9d1d7c49489b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:02.312848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d349d17a-b7d7-4515-8c9d-9d1d7c49489b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:02.409391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8026b4f1-8b49-4326-bc96-113ffc124d95 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:02.409935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8026b4f1-8b49-4326-bc96-113ffc124d95 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:02.417084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8026b4f1-8b49-4326-bc96-113ffc124d95 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:02.417483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8026b4f1-8b49-4326-bc96-113ffc124d95 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:02.418408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8026b4f1-8b49-4326-bc96-113ffc124d95 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:02.418854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8026b4f1-8b49-4326-bc96-113ffc124d95 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:02.447300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d349d17a-b7d7-4515-8c9d-9d1d7c49489b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:02.455655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d349d17a-b7d7-4515-8c9d-9d1d7c49489b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155605 May 23 13:56:02.456231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 889/1860] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:02 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:02.553552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8026b4f1-8b49-4326-bc96-113ffc124d95 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:02.563105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8026b4f1-8b49-4326-bc96-113ffc124d95 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.157587 May 23 13:56:02.563690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 972/1861] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:02 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:03.066310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04ad1ce6-e64f-4d03-b294-3e4a07e974ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:03.066967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04ad1ce6-e64f-4d03-b294-3e4a07e974ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:03.073633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04ad1ce6-e64f-4d03-b294-3e4a07e974ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:03.075501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04ad1ce6-e64f-4d03-b294-3e4a07e974ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:03.075501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04ad1ce6-e64f-4d03-b294-3e4a07e974ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:03.075501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04ad1ce6-e64f-4d03-b294-3e4a07e974ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:03.170917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:03.171538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:03.188637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:03.188637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:03.188637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:03.188637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:03.224659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04ad1ce6-e64f-4d03-b294-3e4a07e974ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:03.233110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04ad1ce6-e64f-4d03-b294-3e4a07e974ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.171076 May 23 13:56:03.233702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 890/1862] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:03 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:03.322407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:03.336046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:03.338274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:03.339468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-27c42c6f-d212-4cf4-880c-fc5ffcc6c5d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.172523 May 23 13:56:03.340035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 973/1863] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:03 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:03.472053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4a986a81-854f-463f-a120-b0a3bab7aa37 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:03.472700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4a986a81-854f-463f-a120-b0a3bab7aa37 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:03.479348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a986a81-854f-463f-a120-b0a3bab7aa37 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:03.480078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a986a81-854f-463f-a120-b0a3bab7aa37 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:03.481257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a986a81-854f-463f-a120-b0a3bab7aa37 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:03.481850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a986a81-854f-463f-a120-b0a3bab7aa37 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:03.580411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a0af2d2-7232-43ff-8f46-88ef29a696ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:03.581071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a0af2d2-7232-43ff-8f46-88ef29a696ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:03.600237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a0af2d2-7232-43ff-8f46-88ef29a696ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:03.600729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a0af2d2-7232-43ff-8f46-88ef29a696ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:03.601521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a0af2d2-7232-43ff-8f46-88ef29a696ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:03.601956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a0af2d2-7232-43ff-8f46-88ef29a696ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:03.627887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4a986a81-854f-463f-a120-b0a3bab7aa37 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:03.637396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4a986a81-854f-463f-a120-b0a3bab7aa37 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.169077 May 23 13:56:03.640627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 891/1864] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:03 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:03.773595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a0af2d2-7232-43ff-8f46-88ef29a696ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:03.783882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a0af2d2-7232-43ff-8f46-88ef29a696ef tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.207198 May 23 13:56:03.784482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 974/1865] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:03 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:04.250722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-048c528f-b781-425b-9087-b57defc22937 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:04.251333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-048c528f-b781-425b-9087-b57defc22937 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:04.257789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-048c528f-b781-425b-9087-b57defc22937 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:04.258234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-048c528f-b781-425b-9087-b57defc22937 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:04.259161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-048c528f-b781-425b-9087-b57defc22937 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:04.259607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-048c528f-b781-425b-9087-b57defc22937 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:04.358696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:04.359416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:04.366193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:04.366728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:04.367513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:04.368259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:04.395142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-048c528f-b781-425b-9087-b57defc22937 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:04.403999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-048c528f-b781-425b-9087-b57defc22937 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157124 May 23 13:56:04.404601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 892/1866] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:04 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:04.505933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:04.515332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:04.516959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:04.518125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-03fcb13f-ae4e-4de6-827b-460820b22102 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163458 May 23 13:56:04.518673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 975/1867] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:04 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:04.655358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e37d240d-9aa0-4445-9d1c-17a36584185c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:04.655975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e37d240d-9aa0-4445-9d1c-17a36584185c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:04.662279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e37d240d-9aa0-4445-9d1c-17a36584185c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:04.662815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e37d240d-9aa0-4445-9d1c-17a36584185c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:04.663620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e37d240d-9aa0-4445-9d1c-17a36584185c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:04.664219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e37d240d-9aa0-4445-9d1c-17a36584185c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:04.801502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e37d240d-9aa0-4445-9d1c-17a36584185c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:04.801926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9b8d729-aaef-49bd-aef9-106b413f0df3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:04.802551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9b8d729-aaef-49bd-aef9-106b413f0df3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:04.809696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9b8d729-aaef-49bd-aef9-106b413f0df3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:04.810169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9b8d729-aaef-49bd-aef9-106b413f0df3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:04.810409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e37d240d-9aa0-4445-9d1c-17a36584185c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159022 May 23 13:56:04.810927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9b8d729-aaef-49bd-aef9-106b413f0df3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:04.811074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 893/1868] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:04 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:04.811389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9b8d729-aaef-49bd-aef9-106b413f0df3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:04.815754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:04.948791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d9b8d729-aaef-49bd-aef9-106b413f0df3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:04.957063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9b8d729-aaef-49bd-aef9-106b413f0df3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158898 May 23 13:56:04.957637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 976/1869] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:04 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:05.422009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8937660-743b-4f8f-8be0-9a992fd2345b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:05.441742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8937660-743b-4f8f-8be0-9a992fd2345b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:05.441742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8937660-743b-4f8f-8be0-9a992fd2345b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:05.441742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8937660-743b-4f8f-8be0-9a992fd2345b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:05.441742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8937660-743b-4f8f-8be0-9a992fd2345b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:05.442167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8937660-743b-4f8f-8be0-9a992fd2345b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:05.538975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:05.539635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:05.547601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:05.548089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:05.548908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:05.549352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:05.573524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a8937660-743b-4f8f-8be0-9a992fd2345b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:05.573524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8937660-743b-4f8f-8be0-9a992fd2345b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.154555 May 23 13:56:05.581240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 894/1870] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:05 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:05.683880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:05.692397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:05.693945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:05.695110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d46e506b-9258-4233-8c3b-358c195ce65c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.160131 May 23 13:56:05.695688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 977/1871] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:05 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:05.827496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a461425b-e051-4cfa-b66f-d2c7da68b7c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:05.828113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a461425b-e051-4cfa-b66f-d2c7da68b7c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:05.834123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a461425b-e051-4cfa-b66f-d2c7da68b7c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:05.834573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a461425b-e051-4cfa-b66f-d2c7da68b7c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:05.835330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a461425b-e051-4cfa-b66f-d2c7da68b7c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:05.835764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a461425b-e051-4cfa-b66f-d2c7da68b7c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:05.971884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a461425b-e051-4cfa-b66f-d2c7da68b7c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:05.974976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b9a8f3b-81c0-41eb-ae59-b4d6ff281642 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:05.975605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b9a8f3b-81c0-41eb-ae59-b4d6ff281642 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:05.980624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a461425b-e051-4cfa-b66f-d2c7da68b7c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.157206 May 23 13:56:05.981416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 895/1872] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:05 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:05.981858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9a8f3b-81c0-41eb-ae59-b4d6ff281642 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:05.982620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9a8f3b-81c0-41eb-ae59-b4d6ff281642 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:05.989616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9a8f3b-81c0-41eb-ae59-b4d6ff281642 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:05.989616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9a8f3b-81c0-41eb-ae59-b4d6ff281642 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:06.119837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b9a8f3b-81c0-41eb-ae59-b4d6ff281642 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:06.127917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b9a8f3b-81c0-41eb-ae59-b4d6ff281642 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.157127 May 23 13:56:06.128479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 978/1873] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:05 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:06.591671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c1a29f86-0046-425e-a8f3-32adba25057f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:06.592320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c1a29f86-0046-425e-a8f3-32adba25057f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:06.598939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1a29f86-0046-425e-a8f3-32adba25057f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:06.599406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1a29f86-0046-425e-a8f3-32adba25057f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:06.600182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1a29f86-0046-425e-a8f3-32adba25057f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:06.600677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1a29f86-0046-425e-a8f3-32adba25057f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:06.727945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:06.728694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:06.735441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:06.735962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:06.736895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:06.737417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:06.737987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c1a29f86-0046-425e-a8f3-32adba25057f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:06.746978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c1a29f86-0046-425e-a8f3-32adba25057f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160307 May 23 13:56:06.747565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 896/1874] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:06 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:06.870664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:06.879180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:06.880723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:06.881889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-78654bb7-d4b1-4a34-a31e-63f863f130dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.158894 May 23 13:56:06.882441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 979/1875] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:06 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:06.998831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7bd9fe56-3000-41d1-9343-fecda631537a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:06.999467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7bd9fe56-3000-41d1-9343-fecda631537a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:07.005566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bd9fe56-3000-41d1-9343-fecda631537a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:07.006017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bd9fe56-3000-41d1-9343-fecda631537a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:07.006782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bd9fe56-3000-41d1-9343-fecda631537a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:07.007235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7bd9fe56-3000-41d1-9343-fecda631537a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:07.136711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7bd9fe56-3000-41d1-9343-fecda631537a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:07.145140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7bd9fe56-3000-41d1-9343-fecda631537a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.150098 May 23 13:56:07.145729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 897/1876] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:06 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:07.145999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ea326c1b-7cf3-4992-80b9-de0cd98cd6d7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:07.146621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ea326c1b-7cf3-4992-80b9-de0cd98cd6d7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:07.153445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea326c1b-7cf3-4992-80b9-de0cd98cd6d7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:07.154005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea326c1b-7cf3-4992-80b9-de0cd98cd6d7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:07.154856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea326c1b-7cf3-4992-80b9-de0cd98cd6d7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:07.155300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea326c1b-7cf3-4992-80b9-de0cd98cd6d7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:07.292411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ea326c1b-7cf3-4992-80b9-de0cd98cd6d7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:07.300483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ea326c1b-7cf3-4992-80b9-de0cd98cd6d7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158672 May 23 13:56:07.301079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 980/1877] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:07 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:07.764455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9ac6be3-d4ba-4abc-82fc-fdf48704b660 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:07.765097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9ac6be3-d4ba-4abc-82fc-fdf48704b660 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:07.771625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ac6be3-d4ba-4abc-82fc-fdf48704b660 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:07.772076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ac6be3-d4ba-4abc-82fc-fdf48704b660 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:07.772867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ac6be3-d4ba-4abc-82fc-fdf48704b660 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:07.773303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ac6be3-d4ba-4abc-82fc-fdf48704b660 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:07.900718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:07.901338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:07.908348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:07.908835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:07.909619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:07.910115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:07.925094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9ac6be3-d4ba-4abc-82fc-fdf48704b660 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:07.933677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9ac6be3-d4ba-4abc-82fc-fdf48704b660 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.173034 May 23 13:56:07.934352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 898/1878] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:07 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:08.044799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:08.053273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:08.054791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:08.056486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c021ed31-5515-44cd-8cbd-ac11e7941a5f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159796 May 23 13:56:08.057067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 981/1879] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:07 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:08.162362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95529515-9ea8-4334-8c5a-aa49301efe93 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:08.163015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95529515-9ea8-4334-8c5a-aa49301efe93 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:08.170100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95529515-9ea8-4334-8c5a-aa49301efe93 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:08.170557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95529515-9ea8-4334-8c5a-aa49301efe93 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:08.171335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95529515-9ea8-4334-8c5a-aa49301efe93 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:08.171780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95529515-9ea8-4334-8c5a-aa49301efe93 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:08.302462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95529515-9ea8-4334-8c5a-aa49301efe93 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:08.311477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95529515-9ea8-4334-8c5a-aa49301efe93 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.152999 May 23 13:56:08.312072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 899/1880] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:08 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:08.318630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-359f2aa6-228b-4431-97e5-dfeaf3266478 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:08.318630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-359f2aa6-228b-4431-97e5-dfeaf3266478 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:08.326432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-359f2aa6-228b-4431-97e5-dfeaf3266478 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:08.326883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-359f2aa6-228b-4431-97e5-dfeaf3266478 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:08.327664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-359f2aa6-228b-4431-97e5-dfeaf3266478 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:08.328100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-359f2aa6-228b-4431-97e5-dfeaf3266478 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:08.459840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-359f2aa6-228b-4431-97e5-dfeaf3266478 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:08.468267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-359f2aa6-228b-4431-97e5-dfeaf3266478 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154073 May 23 13:56:08.468905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 982/1881] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:08 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:08.951613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95629b84-2a48-4b7f-9717-1bbee24b39b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:08.952256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95629b84-2a48-4b7f-9717-1bbee24b39b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:08.958781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95629b84-2a48-4b7f-9717-1bbee24b39b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:08.959224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95629b84-2a48-4b7f-9717-1bbee24b39b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:08.959983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95629b84-2a48-4b7f-9717-1bbee24b39b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:08.960417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95629b84-2a48-4b7f-9717-1bbee24b39b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:08.980553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:09.075120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:09.076340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:09.082664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:09.083124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:09.085505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:09.085505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:09.242302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:09.252315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:09.253972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:09.255261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-652b080a-dba9-475b-bb27-c8e984784dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.184441 May 23 13:56:09.255841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 983/1882] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:09 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:09.334750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b8422ddd-3195-47db-b202-91f32dd7599a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:09.335382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b8422ddd-3195-47db-b202-91f32dd7599a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:09.343314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8422ddd-3195-47db-b202-91f32dd7599a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:09.343779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8422ddd-3195-47db-b202-91f32dd7599a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:09.344612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8422ddd-3195-47db-b202-91f32dd7599a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:09.345054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8422ddd-3195-47db-b202-91f32dd7599a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:09.356399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95629b84-2a48-4b7f-9717-1bbee24b39b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:09.364633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95629b84-2a48-4b7f-9717-1bbee24b39b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.417104 May 23 13:56:09.365258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 900/1883] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:08 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:09.486597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94dfdce8-367b-48be-acad-3969a374087c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:09.487376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94dfdce8-367b-48be-acad-3969a374087c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:09.487991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b8422ddd-3195-47db-b202-91f32dd7599a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:09.494499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94dfdce8-367b-48be-acad-3969a374087c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:09.494888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94dfdce8-367b-48be-acad-3969a374087c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:09.495656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94dfdce8-367b-48be-acad-3969a374087c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:09.496088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94dfdce8-367b-48be-acad-3969a374087c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:09.497366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b8422ddd-3195-47db-b202-91f32dd7599a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166492 May 23 13:56:09.498049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 984/1884] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:09 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:09.634652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94dfdce8-367b-48be-acad-3969a374087c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:09.642752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94dfdce8-367b-48be-acad-3969a374087c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160475 May 23 13:56:09.643328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 901/1885] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:09 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:10.275302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:10.275947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:10.282493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:10.282958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:10.283732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:10.284164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:10.386001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-43617395-caa7-46c9-8c94-70b897a733b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:10.386610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-43617395-caa7-46c9-8c94-70b897a733b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:10.394007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43617395-caa7-46c9-8c94-70b897a733b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:10.394459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43617395-caa7-46c9-8c94-70b897a733b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:10.395322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43617395-caa7-46c9-8c94-70b897a733b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:10.395761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43617395-caa7-46c9-8c94-70b897a733b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:10.421614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:10.430766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:10.432889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:10.434080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3737d0d6-dd1b-4c16-9673-2a5b06340376 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163188 May 23 13:56:10.434638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 985/1886] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:10 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:10.515487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c3d157d8-9aaa-4dec-8d37-f8d00e81fc77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:10.516113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c3d157d8-9aaa-4dec-8d37-f8d00e81fc77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:10.522315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3d157d8-9aaa-4dec-8d37-f8d00e81fc77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:10.522773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3d157d8-9aaa-4dec-8d37-f8d00e81fc77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:10.523559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3d157d8-9aaa-4dec-8d37-f8d00e81fc77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:10.524726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3d157d8-9aaa-4dec-8d37-f8d00e81fc77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:10.536390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43617395-caa7-46c9-8c94-70b897a733b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:10.544709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-43617395-caa7-46c9-8c94-70b897a733b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163229 May 23 13:56:10.545299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 902/1887] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:10 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:10.660871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ebbfeff6-bde9-4679-b613-1eeb2c0ab7ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:10.662213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ebbfeff6-bde9-4679-b613-1eeb2c0ab7ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:10.664160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c3d157d8-9aaa-4dec-8d37-f8d00e81fc77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:10.671163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebbfeff6-bde9-4679-b613-1eeb2c0ab7ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:10.671588 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebbfeff6-bde9-4679-b613-1eeb2c0ab7ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:10.672360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebbfeff6-bde9-4679-b613-1eeb2c0ab7ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:10.672830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebbfeff6-bde9-4679-b613-1eeb2c0ab7ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:10.673976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c3d157d8-9aaa-4dec-8d37-f8d00e81fc77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.162499 May 23 13:56:10.674562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 986/1888] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:10 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:10.812553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebbfeff6-bde9-4679-b613-1eeb2c0ab7ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:10.821806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ebbfeff6-bde9-4679-b613-1eeb2c0ab7ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164046 May 23 13:56:10.822409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 903/1889] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:10 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:11.452806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:11.453333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:11.459812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:11.460261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:11.461049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:11.461501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:11.563097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9255c644-9a0e-4a4b-9b53-327612bc89f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:11.563719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9255c644-9a0e-4a4b-9b53-327612bc89f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:11.570244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9255c644-9a0e-4a4b-9b53-327612bc89f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:11.571318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9255c644-9a0e-4a4b-9b53-327612bc89f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:11.572597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9255c644-9a0e-4a4b-9b53-327612bc89f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:11.573311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9255c644-9a0e-4a4b-9b53-327612bc89f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:11.593276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:11.602895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:11.604523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:11.605811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc18ae45-6bcf-4f63-8cc3-4150d129f548 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.157147 May 23 13:56:11.606465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 987/1890] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:11.691596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fa6fdc44-5e66-4d55-a0b4-cf76b719c46e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:11.692336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fa6fdc44-5e66-4d55-a0b4-cf76b719c46e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:11.700239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa6fdc44-5e66-4d55-a0b4-cf76b719c46e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:11.700709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa6fdc44-5e66-4d55-a0b4-cf76b719c46e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:11.701485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa6fdc44-5e66-4d55-a0b4-cf76b719c46e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:11.701918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa6fdc44-5e66-4d55-a0b4-cf76b719c46e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:11.720036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9255c644-9a0e-4a4b-9b53-327612bc89f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:11.728170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9255c644-9a0e-4a4b-9b53-327612bc89f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.169202 May 23 13:56:11.728774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 904/1891] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:11 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:11.839174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fa6fdc44-5e66-4d55-a0b4-cf76b719c46e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:11.841541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2240f829-525f-4976-8b02-c97300e8374a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:11.841541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2240f829-525f-4976-8b02-c97300e8374a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:11.846686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2240f829-525f-4976-8b02-c97300e8374a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:11.847139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2240f829-525f-4976-8b02-c97300e8374a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:11.847722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fa6fdc44-5e66-4d55-a0b4-cf76b719c46e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159915 May 23 13:56:11.847909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2240f829-525f-4976-8b02-c97300e8374a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:11.848304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 988/1892] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:11 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:11.848465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2240f829-525f-4976-8b02-c97300e8374a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:11.991774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2240f829-525f-4976-8b02-c97300e8374a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:12.000343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2240f829-525f-4976-8b02-c97300e8374a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164902 May 23 13:56:12.000986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 905/1893] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:11 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:12.624663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:12.625286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:12.631781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:12.632237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:12.633639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:12.634076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:12.746183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-10b30fda-363e-4bf4-8d3c-91eb8cf0683d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:12.746941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-10b30fda-363e-4bf4-8d3c-91eb8cf0683d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:12.753502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10b30fda-363e-4bf4-8d3c-91eb8cf0683d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:12.753949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10b30fda-363e-4bf4-8d3c-91eb8cf0683d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:12.754713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10b30fda-363e-4bf4-8d3c-91eb8cf0683d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:12.755177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10b30fda-363e-4bf4-8d3c-91eb8cf0683d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:12.765408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:12.774349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:12.776098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:12.777337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a29cf35a-e72d-46fe-8691-447db4993382 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.156727 May 23 13:56:12.778087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 989/1894] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:12.865149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0edb2d5b-f71b-4af6-ba49-4642db8410a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:12.865767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0edb2d5b-f71b-4af6-ba49-4642db8410a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:12.871765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edb2d5b-f71b-4af6-ba49-4642db8410a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:12.872212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edb2d5b-f71b-4af6-ba49-4642db8410a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:12.873007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edb2d5b-f71b-4af6-ba49-4642db8410a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:12.873442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edb2d5b-f71b-4af6-ba49-4642db8410a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:12.888545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-10b30fda-363e-4bf4-8d3c-91eb8cf0683d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:12.896853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-10b30fda-363e-4bf4-8d3c-91eb8cf0683d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.155026 May 23 13:56:12.897529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 906/1895] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:12 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:13.010737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0edb2d5b-f71b-4af6-ba49-4642db8410a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:13.017772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c5aa3cca-03a8-4197-b4ab-d59b5a7edd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:13.018383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5aa3cca-03a8-4197-b4ab-d59b5a7edd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:13.019322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0edb2d5b-f71b-4af6-ba49-4642db8410a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158099 May 23 13:56:13.020073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 990/1896] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:12 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:13.026034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5aa3cca-03a8-4197-b4ab-d59b5a7edd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:13.026584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5aa3cca-03a8-4197-b4ab-d59b5a7edd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:13.027443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5aa3cca-03a8-4197-b4ab-d59b5a7edd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:13.028021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5aa3cca-03a8-4197-b4ab-d59b5a7edd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:13.167477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5aa3cca-03a8-4197-b4ab-d59b5a7edd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:13.175604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c5aa3cca-03a8-4197-b4ab-d59b5a7edd21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161627 May 23 13:56:13.176217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 907/1897] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:13 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:13.796067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:13.796782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:13.810664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:13.810664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:13.810664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:13.810664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:13.916011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd5ce3c9-5b38-47c6-8e0d-38c5c4fd0ef8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:13.916551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd5ce3c9-5b38-47c6-8e0d-38c5c4fd0ef8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:13.923787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd5ce3c9-5b38-47c6-8e0d-38c5c4fd0ef8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:13.924427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd5ce3c9-5b38-47c6-8e0d-38c5c4fd0ef8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:13.925441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd5ce3c9-5b38-47c6-8e0d-38c5c4fd0ef8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:13.925875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd5ce3c9-5b38-47c6-8e0d-38c5c4fd0ef8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:13.939532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:13.948340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:13.949893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:13.951076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-14c4d760-141e-4211-a6e3-caffb0a3c319 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159122 May 23 13:56:13.951644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 991/1898] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:13 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:14.037805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-81ee6263-519c-4e33-85d7-ec58a8d0a010 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:14.038442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-81ee6263-519c-4e33-85d7-ec58a8d0a010 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:14.045870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81ee6263-519c-4e33-85d7-ec58a8d0a010 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:14.046329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81ee6263-519c-4e33-85d7-ec58a8d0a010 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:14.047121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81ee6263-519c-4e33-85d7-ec58a8d0a010 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:14.047567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81ee6263-519c-4e33-85d7-ec58a8d0a010 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:14.061888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd5ce3c9-5b38-47c6-8e0d-38c5c4fd0ef8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:14.071500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd5ce3c9-5b38-47c6-8e0d-38c5c4fd0ef8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160636 May 23 13:56:14.072080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 908/1899] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:13 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:14.193704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-81ee6263-519c-4e33-85d7-ec58a8d0a010 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:14.193970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-556586b5-8c27-455f-85ff-78aa7512a44c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:14.194664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-556586b5-8c27-455f-85ff-78aa7512a44c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:14.198137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:14.202278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-556586b5-8c27-455f-85ff-78aa7512a44c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:14.202730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-556586b5-8c27-455f-85ff-78aa7512a44c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:14.202931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-81ee6263-519c-4e33-85d7-ec58a8d0a010 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.169080 May 23 13:56:14.203500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-556586b5-8c27-455f-85ff-78aa7512a44c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:14.203633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 992/1900] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:14 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:14.203938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-556586b5-8c27-455f-85ff-78aa7512a44c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:14.338366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-556586b5-8c27-455f-85ff-78aa7512a44c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:14.346419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-556586b5-8c27-455f-85ff-78aa7512a44c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156572 May 23 13:56:14.346992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 909/1901] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:14 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:14.969973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:14.970599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:14.977405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:14.977893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:14.978630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:14.979070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:15.121488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34e6c942-cd67-44a3-88ea-b8fdf91c4341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:15.121488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-34e6c942-cd67-44a3-88ea-b8fdf91c4341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:15.121488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34e6c942-cd67-44a3-88ea-b8fdf91c4341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:15.121488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34e6c942-cd67-44a3-88ea-b8fdf91c4341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:15.122213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34e6c942-cd67-44a3-88ea-b8fdf91c4341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:15.122213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34e6c942-cd67-44a3-88ea-b8fdf91c4341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:15.122389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:15.123030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:15.124559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:15.125750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed48a599-94f2-4663-8402-0ee28a3e77e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.160136 May 23 13:56:15.126306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 993/1902] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:14 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:15.219684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-061780bf-2b1c-4c52-9453-5f3b5982a784 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:15.220300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-061780bf-2b1c-4c52-9453-5f3b5982a784 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:15.226527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-061780bf-2b1c-4c52-9453-5f3b5982a784 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:15.227604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-061780bf-2b1c-4c52-9453-5f3b5982a784 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:15.227896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-061780bf-2b1c-4c52-9453-5f3b5982a784 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:15.228331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-061780bf-2b1c-4c52-9453-5f3b5982a784 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:15.238253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34e6c942-cd67-44a3-88ea-b8fdf91c4341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:15.246801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34e6c942-cd67-44a3-88ea-b8fdf91c4341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161411 May 23 13:56:15.247391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 910/1903] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:15 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:15.364486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f6c535d-fd6e-4ba4-b8bc-ca3a8c91e92c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:15.365154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f6c535d-fd6e-4ba4-b8bc-ca3a8c91e92c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:15.371543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-061780bf-2b1c-4c52-9453-5f3b5982a784 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:15.372224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f6c535d-fd6e-4ba4-b8bc-ca3a8c91e92c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:15.372816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f6c535d-fd6e-4ba4-b8bc-ca3a8c91e92c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:15.373666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f6c535d-fd6e-4ba4-b8bc-ca3a8c91e92c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:15.374100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f6c535d-fd6e-4ba4-b8bc-ca3a8c91e92c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:15.380284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-061780bf-2b1c-4c52-9453-5f3b5982a784 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164893 May 23 13:56:15.381083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 994/1904] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:15 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:15.521675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f6c535d-fd6e-4ba4-b8bc-ca3a8c91e92c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:15.531165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f6c535d-fd6e-4ba4-b8bc-ca3a8c91e92c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.170631 May 23 13:56:15.531740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 911/1905] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:15 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:16.143763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:16.144368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:16.152128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:16.152606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:16.153386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:16.153827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:16.271059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e3537230-a273-4709-93ec-2ef7bc54b431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:16.271721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e3537230-a273-4709-93ec-2ef7bc54b431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:16.279319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3537230-a273-4709-93ec-2ef7bc54b431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:16.279854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3537230-a273-4709-93ec-2ef7bc54b431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:16.280655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3537230-a273-4709-93ec-2ef7bc54b431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:16.281091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3537230-a273-4709-93ec-2ef7bc54b431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:16.296349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:16.306895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:16.307433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:16.308666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0c0f5e07-7fd2-474a-878b-3662c05a809d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.168815 May 23 13:56:16.309239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 995/1906] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:16.398240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5dffef2b-06b8-49cc-866d-6c89c7fc1b0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:16.400035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5dffef2b-06b8-49cc-866d-6c89c7fc1b0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:16.406136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dffef2b-06b8-49cc-866d-6c89c7fc1b0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:16.406593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dffef2b-06b8-49cc-866d-6c89c7fc1b0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:16.407378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dffef2b-06b8-49cc-866d-6c89c7fc1b0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:16.407820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dffef2b-06b8-49cc-866d-6c89c7fc1b0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:16.426869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e3537230-a273-4709-93ec-2ef7bc54b431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:16.434944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e3537230-a273-4709-93ec-2ef7bc54b431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.167903 May 23 13:56:16.435685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 912/1907] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:16 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:16.541705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5dffef2b-06b8-49cc-866d-6c89c7fc1b0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:16.548350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-78a6cb7b-0dc3-4a09-8e9c-30ea275a12b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:16.548989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-78a6cb7b-0dc3-4a09-8e9c-30ea275a12b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:16.549929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5dffef2b-06b8-49cc-866d-6c89c7fc1b0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155778 May 23 13:56:16.550511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 996/1908] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:16 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:16.554996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78a6cb7b-0dc3-4a09-8e9c-30ea275a12b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:16.555452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78a6cb7b-0dc3-4a09-8e9c-30ea275a12b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:16.556225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78a6cb7b-0dc3-4a09-8e9c-30ea275a12b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:16.556679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78a6cb7b-0dc3-4a09-8e9c-30ea275a12b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:16.690955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78a6cb7b-0dc3-4a09-8e9c-30ea275a12b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:16.700530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-78a6cb7b-0dc3-4a09-8e9c-30ea275a12b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155905 May 23 13:56:16.701133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 913/1909] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:16 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:17.328547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:17.329196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:17.336501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:17.336942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:17.338237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:17.338363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:17.453168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-898720a6-10af-49e6-ad73-4426b93f1659 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:17.453729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-898720a6-10af-49e6-ad73-4426b93f1659 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:17.460179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-898720a6-10af-49e6-ad73-4426b93f1659 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:17.460666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-898720a6-10af-49e6-ad73-4426b93f1659 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:17.462434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-898720a6-10af-49e6-ad73-4426b93f1659 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:17.462887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-898720a6-10af-49e6-ad73-4426b93f1659 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:17.472552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:17.481713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:17.483246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:17.484439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-050af7d7-b907-44ac-9250-75d71db59b20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.160240 May 23 13:56:17.485038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 997/1910] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:17.567193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b0f1211-62d7-43a4-bd5c-088497bb5130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:17.567817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b0f1211-62d7-43a4-bd5c-088497bb5130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:17.575069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0f1211-62d7-43a4-bd5c-088497bb5130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:17.575502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0f1211-62d7-43a4-bd5c-088497bb5130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:17.576278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0f1211-62d7-43a4-bd5c-088497bb5130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:17.576771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0f1211-62d7-43a4-bd5c-088497bb5130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:17.599049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-898720a6-10af-49e6-ad73-4426b93f1659 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:17.608080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-898720a6-10af-49e6-ad73-4426b93f1659 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158860 May 23 13:56:17.608680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 914/1911] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:17 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:17.713349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b0f1211-62d7-43a4-bd5c-088497bb5130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:17.718018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-76aa965b-f297-4cd8-ab83-a3d40ecc5b30 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:17.718660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-76aa965b-f297-4cd8-ab83-a3d40ecc5b30 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:17.721570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b0f1211-62d7-43a4-bd5c-088497bb5130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158195 May 23 13:56:17.722153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 998/1912] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:17 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:17.724917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76aa965b-f297-4cd8-ab83-a3d40ecc5b30 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:17.725373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76aa965b-f297-4cd8-ab83-a3d40ecc5b30 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:17.726146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76aa965b-f297-4cd8-ab83-a3d40ecc5b30 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:17.727691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76aa965b-f297-4cd8-ab83-a3d40ecc5b30 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:17.857521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-76aa965b-f297-4cd8-ab83-a3d40ecc5b30 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:17.865481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-76aa965b-f297-4cd8-ab83-a3d40ecc5b30 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.151356 May 23 13:56:17.866048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 915/1913] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:17 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:18.502863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:18.503410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:18.510792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:18.511249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:18.512024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:18.512473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:18.626196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fcbdca44-8627-418e-b7b1-9e3ac22ddada tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:18.626816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fcbdca44-8627-418e-b7b1-9e3ac22ddada tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:18.634340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcbdca44-8627-418e-b7b1-9e3ac22ddada tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:18.634792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcbdca44-8627-418e-b7b1-9e3ac22ddada tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:18.635579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcbdca44-8627-418e-b7b1-9e3ac22ddada tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:18.636145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcbdca44-8627-418e-b7b1-9e3ac22ddada tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:18.645859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:18.658882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:18.660412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:18.661639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c54a9726-9dad-4bef-8cc6-2e835535c645 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.162835 May 23 13:56:18.662203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 999/1914] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:18 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:18.739498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a4dff557-e70d-472d-8606-f2b4d112ae5b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:18.740225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a4dff557-e70d-472d-8606-f2b4d112ae5b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:18.747547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4dff557-e70d-472d-8606-f2b4d112ae5b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:18.748008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4dff557-e70d-472d-8606-f2b4d112ae5b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:18.748822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4dff557-e70d-472d-8606-f2b4d112ae5b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:18.749272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4dff557-e70d-472d-8606-f2b4d112ae5b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:18.774361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fcbdca44-8627-418e-b7b1-9e3ac22ddada tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:18.782399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fcbdca44-8627-418e-b7b1-9e3ac22ddada tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160270 May 23 13:56:18.783169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 916/1915] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:18 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:18.882570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f068d5a2-08df-45b4-8bcc-a30495587194 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:18.883842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f068d5a2-08df-45b4-8bcc-a30495587194 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:18.885636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a4dff557-e70d-472d-8606-f2b4d112ae5b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:18.889907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f068d5a2-08df-45b4-8bcc-a30495587194 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:18.890357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f068d5a2-08df-45b4-8bcc-a30495587194 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:18.891119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f068d5a2-08df-45b4-8bcc-a30495587194 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:18.891714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f068d5a2-08df-45b4-8bcc-a30495587194 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:18.893904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a4dff557-e70d-472d-8606-f2b4d112ae5b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158299 May 23 13:56:18.894475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1000/1916] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:18 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:18.896291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:19.031741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f068d5a2-08df-45b4-8bcc-a30495587194 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:19.040025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f068d5a2-08df-45b4-8bcc-a30495587194 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161313 May 23 13:56:19.040612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 917/1917] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:18 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:19.680350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:19.681028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:19.687593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:19.688045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:19.688845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:19.689284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:19.799397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3873b93d-7340-4d35-ad6b-52ce11ca16be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:19.800029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3873b93d-7340-4d35-ad6b-52ce11ca16be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:19.807605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3873b93d-7340-4d35-ad6b-52ce11ca16be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:19.808057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3873b93d-7340-4d35-ad6b-52ce11ca16be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:19.808882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3873b93d-7340-4d35-ad6b-52ce11ca16be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:19.809326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3873b93d-7340-4d35-ad6b-52ce11ca16be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:19.823989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:19.832486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:19.834061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:19.835227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bcd9a40d-fb8d-4af8-91a1-be3adc40180d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159133 May 23 13:56:19.835982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1001/1918] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:19 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:19.911179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fa5ef57-b4b2-4f90-8b66-7dc6fe0d3e1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:19.911806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fa5ef57-b4b2-4f90-8b66-7dc6fe0d3e1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:19.919449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fa5ef57-b4b2-4f90-8b66-7dc6fe0d3e1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:19.919928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fa5ef57-b4b2-4f90-8b66-7dc6fe0d3e1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:19.920725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fa5ef57-b4b2-4f90-8b66-7dc6fe0d3e1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:19.921158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fa5ef57-b4b2-4f90-8b66-7dc6fe0d3e1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:19.942795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3873b93d-7340-4d35-ad6b-52ce11ca16be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:19.951733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3873b93d-7340-4d35-ad6b-52ce11ca16be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156221 May 23 13:56:19.952322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 918/1919] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:19 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:20.057754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7897e538-53a4-49f7-925f-12d7ea6295c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:20.058231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7897e538-53a4-49f7-925f-12d7ea6295c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:20.060228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fa5ef57-b4b2-4f90-8b66-7dc6fe0d3e1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:20.064416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7897e538-53a4-49f7-925f-12d7ea6295c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:20.064897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7897e538-53a4-49f7-925f-12d7ea6295c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:20.065662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7897e538-53a4-49f7-925f-12d7ea6295c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:20.066092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7897e538-53a4-49f7-925f-12d7ea6295c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:20.068337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fa5ef57-b4b2-4f90-8b66-7dc6fe0d3e1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160956 May 23 13:56:20.068954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1002/1920] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:19 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:20.203639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7897e538-53a4-49f7-925f-12d7ea6295c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:20.212820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7897e538-53a4-49f7-925f-12d7ea6295c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159105 May 23 13:56:20.213392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 919/1921] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:20 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:20.853719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:20.854988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:20.857405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:20.862257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:20.862715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:20.863502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:20.863947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:20.970517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2af8d05f-6e43-414c-959c-1b5f0f2c1b42 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:20.971132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2af8d05f-6e43-414c-959c-1b5f0f2c1b42 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:20.974108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:20.978906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2af8d05f-6e43-414c-959c-1b5f0f2c1b42 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:20.979363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2af8d05f-6e43-414c-959c-1b5f0f2c1b42 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:20.980139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2af8d05f-6e43-414c-959c-1b5f0f2c1b42 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:20.980594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2af8d05f-6e43-414c-959c-1b5f0f2c1b42 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:20.998243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:21.006665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:21.009053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:21.010226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fe7181d2-f375-4546-8d9f-4586ba53ec60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.160598 May 23 13:56:21.010787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1003/1922] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:21.086550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb349b7c-ae95-4bbb-a601-ec9d90a9e466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:21.087293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb349b7c-ae95-4bbb-a601-ec9d90a9e466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:21.093693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb349b7c-ae95-4bbb-a601-ec9d90a9e466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:21.094148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb349b7c-ae95-4bbb-a601-ec9d90a9e466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:21.094944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb349b7c-ae95-4bbb-a601-ec9d90a9e466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:21.095391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb349b7c-ae95-4bbb-a601-ec9d90a9e466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:21.119675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2af8d05f-6e43-414c-959c-1b5f0f2c1b42 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:21.127625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2af8d05f-6e43-414c-959c-1b5f0f2c1b42 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161719 May 23 13:56:21.128188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 920/1923] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:20 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:21.230151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb349b7c-ae95-4bbb-a601-ec9d90a9e466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:21.230836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3f50d71d-1e1e-4d57-9baa-841a8843a5e0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:21.231481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3f50d71d-1e1e-4d57-9baa-841a8843a5e0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:21.237755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f50d71d-1e1e-4d57-9baa-841a8843a5e0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:21.238207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f50d71d-1e1e-4d57-9baa-841a8843a5e0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:21.238338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb349b7c-ae95-4bbb-a601-ec9d90a9e466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156272 May 23 13:56:21.238842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1004/1924] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:21 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:21.239120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f50d71d-1e1e-4d57-9baa-841a8843a5e0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:21.239631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f50d71d-1e1e-4d57-9baa-841a8843a5e0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:21.373507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f50d71d-1e1e-4d57-9baa-841a8843a5e0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:21.382108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3f50d71d-1e1e-4d57-9baa-841a8843a5e0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155651 May 23 13:56:21.383691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 921/1925] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:21 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:22.028714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:22.029326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:22.035842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:22.036291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:22.037712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:22.037712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:22.146280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-007cb5c9-97a0-4400-a374-5ba566d64cd6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:22.147010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-007cb5c9-97a0-4400-a374-5ba566d64cd6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:22.153374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-007cb5c9-97a0-4400-a374-5ba566d64cd6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:22.153938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-007cb5c9-97a0-4400-a374-5ba566d64cd6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:22.154799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-007cb5c9-97a0-4400-a374-5ba566d64cd6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:22.155239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-007cb5c9-97a0-4400-a374-5ba566d64cd6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:22.177987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:22.188167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:22.189715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:22.191040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-294e66bc-cc33-4f90-83f7-a41f1c1c2117 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.166331 May 23 13:56:22.191796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1005/1926] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:22 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:22.265827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-94d9efca-1b77-41e9-a7e0-b59b9d8a5cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:22.266450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-94d9efca-1b77-41e9-a7e0-b59b9d8a5cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:22.272467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d9efca-1b77-41e9-a7e0-b59b9d8a5cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:22.272986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d9efca-1b77-41e9-a7e0-b59b9d8a5cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:22.274299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d9efca-1b77-41e9-a7e0-b59b9d8a5cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:22.274737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94d9efca-1b77-41e9-a7e0-b59b9d8a5cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:22.301165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-007cb5c9-97a0-4400-a374-5ba566d64cd6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:22.310461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-007cb5c9-97a0-4400-a374-5ba566d64cd6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.168066 May 23 13:56:22.311028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 922/1927] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:22 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:22.400397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d0ecc72-7c6a-4271-a56f-91fb474b7837 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:22.400957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d0ecc72-7c6a-4271-a56f-91fb474b7837 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:22.406980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0ecc72-7c6a-4271-a56f-91fb474b7837 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:22.407439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0ecc72-7c6a-4271-a56f-91fb474b7837 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:22.408249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0ecc72-7c6a-4271-a56f-91fb474b7837 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:22.408722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0ecc72-7c6a-4271-a56f-91fb474b7837 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:22.409965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94d9efca-1b77-41e9-a7e0-b59b9d8a5cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:22.418924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-94d9efca-1b77-41e9-a7e0-b59b9d8a5cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156882 May 23 13:56:22.419513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1006/1928] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:22 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:22.547279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d0ecc72-7c6a-4271-a56f-91fb474b7837 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:22.556327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d0ecc72-7c6a-4271-a56f-91fb474b7837 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160498 May 23 13:56:22.556935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 923/1929] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:22 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:23.211110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:23.211730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:23.218468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:23.218915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:23.219694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:23.220130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:23.328895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a01e0ca0-5aa7-4edc-83c4-524f747df2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:23.329634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a01e0ca0-5aa7-4edc-83c4-524f747df2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:23.337046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a01e0ca0-5aa7-4edc-83c4-524f747df2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:23.337507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a01e0ca0-5aa7-4edc-83c4-524f747df2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:23.338406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a01e0ca0-5aa7-4edc-83c4-524f747df2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:23.338727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a01e0ca0-5aa7-4edc-83c4-524f747df2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:23.358745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:23.368797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:23.371806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:23.373922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1b892fa4-ac96-49a2-91f1-461e3f27c22b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.167224 May 23 13:56:23.374559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1007/1930] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:23.435889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-399bc65b-4283-4444-848e-54470cbc3f8a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:23.436531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-399bc65b-4283-4444-848e-54470cbc3f8a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:23.442571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399bc65b-4283-4444-848e-54470cbc3f8a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:23.443015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399bc65b-4283-4444-848e-54470cbc3f8a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:23.443789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399bc65b-4283-4444-848e-54470cbc3f8a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:23.444220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399bc65b-4283-4444-848e-54470cbc3f8a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:23.483853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a01e0ca0-5aa7-4edc-83c4-524f747df2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:23.495170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a01e0ca0-5aa7-4edc-83c4-524f747df2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.169636 May 23 13:56:23.496101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 924/1931] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:23 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:23.574129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fc85e025-c734-44e5-84b8-1f7734bcd207 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:23.574737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fc85e025-c734-44e5-84b8-1f7734bcd207 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:23.580794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc85e025-c734-44e5-84b8-1f7734bcd207 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:23.581244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc85e025-c734-44e5-84b8-1f7734bcd207 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:23.582003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc85e025-c734-44e5-84b8-1f7734bcd207 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:23.582437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc85e025-c734-44e5-84b8-1f7734bcd207 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:23.588968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-399bc65b-4283-4444-848e-54470cbc3f8a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:23.597082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-399bc65b-4283-4444-848e-54470cbc3f8a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164845 May 23 13:56:23.598939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1008/1932] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:23 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:23.716382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc85e025-c734-44e5-84b8-1f7734bcd207 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:23.724512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fc85e025-c734-44e5-84b8-1f7734bcd207 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154765 May 23 13:56:23.725161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 925/1933] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:23 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:24.393326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:24.393939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:24.401002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:24.401459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:24.402221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:24.402658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:24.422569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:24.514071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6294d373-b2e0-4d9f-b701-e417338a992f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:24.514757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6294d373-b2e0-4d9f-b701-e417338a992f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:24.521389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6294d373-b2e0-4d9f-b701-e417338a992f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:24.521923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6294d373-b2e0-4d9f-b701-e417338a992f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:24.522672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6294d373-b2e0-4d9f-b701-e417338a992f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:24.523623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6294d373-b2e0-4d9f-b701-e417338a992f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:24.546225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:24.555822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:24.557382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:24.558562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-24e1e93e-278f-443a-8cc3-2b6dcf8fd27a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.169347 May 23 13:56:24.559149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1009/1934] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:24 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:24.617692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4ce1c223-c68f-4a71-a115-a795e85799df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:24.618400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4ce1c223-c68f-4a71-a115-a795e85799df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:24.624670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ce1c223-c68f-4a71-a115-a795e85799df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:24.625208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ce1c223-c68f-4a71-a115-a795e85799df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:24.626064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ce1c223-c68f-4a71-a115-a795e85799df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:24.626574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ce1c223-c68f-4a71-a115-a795e85799df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:24.670099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6294d373-b2e0-4d9f-b701-e417338a992f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:24.678391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6294d373-b2e0-4d9f-b701-e417338a992f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.168294 May 23 13:56:24.679192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 926/1935] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:24 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:24.743635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d99b2101-b6c3-4014-bd2d-9eb9eb69fe94 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:24.744157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d99b2101-b6c3-4014-bd2d-9eb9eb69fe94 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:24.750207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d99b2101-b6c3-4014-bd2d-9eb9eb69fe94 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:24.750668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d99b2101-b6c3-4014-bd2d-9eb9eb69fe94 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:24.751413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d99b2101-b6c3-4014-bd2d-9eb9eb69fe94 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:24.751845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d99b2101-b6c3-4014-bd2d-9eb9eb69fe94 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:24.768451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4ce1c223-c68f-4a71-a115-a795e85799df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:24.777841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4ce1c223-c68f-4a71-a115-a795e85799df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165501 May 23 13:56:24.778439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1010/1936] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:24 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:24.883924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d99b2101-b6c3-4014-bd2d-9eb9eb69fe94 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:24.892380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d99b2101-b6c3-4014-bd2d-9eb9eb69fe94 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153163 May 23 13:56:24.892978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 927/1937] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:24 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:25.577108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:25.577650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:25.584419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:25.584915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:25.585981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:25.586187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:25.695173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07586c34-611e-495c-bd8e-75a97748c5b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:25.696451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07586c34-611e-495c-bd8e-75a97748c5b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:25.703707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07586c34-611e-495c-bd8e-75a97748c5b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:25.704161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07586c34-611e-495c-bd8e-75a97748c5b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:25.704975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07586c34-611e-495c-bd8e-75a97748c5b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:25.705413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07586c34-611e-495c-bd8e-75a97748c5b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:25.723810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:25.733401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:25.734909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:25.736068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f5b457a9-b172-4fcb-a207-36f720500fdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163034 May 23 13:56:25.736643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1011/1938] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:25.795735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-527dcdd4-382a-43f0-bef3-de7f9c5a7413 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:25.796388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-527dcdd4-382a-43f0-bef3-de7f9c5a7413 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:25.802563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-527dcdd4-382a-43f0-bef3-de7f9c5a7413 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:25.802961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-527dcdd4-382a-43f0-bef3-de7f9c5a7413 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:25.803737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-527dcdd4-382a-43f0-bef3-de7f9c5a7413 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:25.805165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-527dcdd4-382a-43f0-bef3-de7f9c5a7413 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:25.842879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07586c34-611e-495c-bd8e-75a97748c5b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:25.851852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07586c34-611e-495c-bd8e-75a97748c5b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159780 May 23 13:56:25.852524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 928/1939] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:25 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:25.910202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-21ef6b37-3352-4b20-b929-f5563af170c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:25.910815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-21ef6b37-3352-4b20-b929-f5563af170c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:25.918088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21ef6b37-3352-4b20-b929-f5563af170c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:25.918537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21ef6b37-3352-4b20-b929-f5563af170c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:25.919306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21ef6b37-3352-4b20-b929-f5563af170c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:25.919736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21ef6b37-3352-4b20-b929-f5563af170c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:25.941351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-527dcdd4-382a-43f0-bef3-de7f9c5a7413 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:25.951969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-527dcdd4-382a-43f0-bef3-de7f9c5a7413 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160091 May 23 13:56:25.952619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1012/1940] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:25 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:26.055356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-21ef6b37-3352-4b20-b929-f5563af170c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:26.063422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-21ef6b37-3352-4b20-b929-f5563af170c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.157084 May 23 13:56:26.063992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 929/1941] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:25 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:26.755090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:26.755715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:26.763609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:26.764069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:26.764995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:26.765442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:26.870323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ec807784-deb0-4352-ba73-f5afaa0ca5f2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:26.870935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ec807784-deb0-4352-ba73-f5afaa0ca5f2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:26.877549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec807784-deb0-4352-ba73-f5afaa0ca5f2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:26.877990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec807784-deb0-4352-ba73-f5afaa0ca5f2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:26.878768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec807784-deb0-4352-ba73-f5afaa0ca5f2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:26.879251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec807784-deb0-4352-ba73-f5afaa0ca5f2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:26.908779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:26.918871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:26.920404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:26.921622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8ef80d2f-5a73-4d13-a0cf-58de3b0d4312 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.170818 May 23 13:56:26.922180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1013/1942] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:26.970107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-669622b8-ff98-4275-ba48-f22bd40d6a8b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:26.970751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-669622b8-ff98-4275-ba48-f22bd40d6a8b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:26.977941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-669622b8-ff98-4275-ba48-f22bd40d6a8b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:26.978374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-669622b8-ff98-4275-ba48-f22bd40d6a8b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:26.979207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-669622b8-ff98-4275-ba48-f22bd40d6a8b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:26.979651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-669622b8-ff98-4275-ba48-f22bd40d6a8b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:27.018665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ec807784-deb0-4352-ba73-f5afaa0ca5f2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:27.027648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ec807784-deb0-4352-ba73-f5afaa0ca5f2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161828 May 23 13:56:27.028275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 930/1943] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:26 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:27.082540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7fc1faa5-3f8e-4337-b572-9e0e5993915b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:27.083164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7fc1faa5-3f8e-4337-b572-9e0e5993915b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:27.091691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc1faa5-3f8e-4337-b572-9e0e5993915b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:27.092154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc1faa5-3f8e-4337-b572-9e0e5993915b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:27.093081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc1faa5-3f8e-4337-b572-9e0e5993915b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:27.093858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fc1faa5-3f8e-4337-b572-9e0e5993915b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:27.123536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-669622b8-ff98-4275-ba48-f22bd40d6a8b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:27.133089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-669622b8-ff98-4275-ba48-f22bd40d6a8b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166823 May 23 13:56:27.134070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1014/1944] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:26 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:27.247806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7fc1faa5-3f8e-4337-b572-9e0e5993915b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:27.255851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7fc1faa5-3f8e-4337-b572-9e0e5993915b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.177383 May 23 13:56:27.256493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 931/1945] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:27 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:27.940693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:27.941209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:27.949807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:27.950253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:27.951027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:27.951456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:28.045215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d297b6be-4081-4954-a2c1-910baeb89a24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:28.046009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d297b6be-4081-4954-a2c1-910baeb89a24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:28.052748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d297b6be-4081-4954-a2c1-910baeb89a24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:28.053195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d297b6be-4081-4954-a2c1-910baeb89a24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:28.054567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d297b6be-4081-4954-a2c1-910baeb89a24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:28.054966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d297b6be-4081-4954-a2c1-910baeb89a24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:28.084477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:28.093149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:28.094679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:28.095862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f143eb65-5be6-4148-8a09-5ea684836afc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159221 May 23 13:56:28.096423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1015/1946] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:28.149820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5dc6817e-e30f-44b5-a9c6-280ef1001313 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:28.150447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5dc6817e-e30f-44b5-a9c6-280ef1001313 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:28.156447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dc6817e-e30f-44b5-a9c6-280ef1001313 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:28.156937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dc6817e-e30f-44b5-a9c6-280ef1001313 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:28.157705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dc6817e-e30f-44b5-a9c6-280ef1001313 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:28.158150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dc6817e-e30f-44b5-a9c6-280ef1001313 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:28.191689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d297b6be-4081-4954-a2c1-910baeb89a24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:28.201455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d297b6be-4081-4954-a2c1-910baeb89a24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160045 May 23 13:56:28.202078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 932/1947] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:28 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:28.275015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-972c1ada-cf35-4794-95e1-e9558b030893 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:28.275821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-972c1ada-cf35-4794-95e1-e9558b030893 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:28.281876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-972c1ada-cf35-4794-95e1-e9558b030893 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:28.282333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-972c1ada-cf35-4794-95e1-e9558b030893 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:28.283109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-972c1ada-cf35-4794-95e1-e9558b030893 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:28.283544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-972c1ada-cf35-4794-95e1-e9558b030893 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:28.290005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5dc6817e-e30f-44b5-a9c6-280ef1001313 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:28.298583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5dc6817e-e30f-44b5-a9c6-280ef1001313 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.152084 May 23 13:56:28.298788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1016/1948] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:28 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:28.419021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-972c1ada-cf35-4794-95e1-e9558b030893 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:28.422388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:28.427088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-972c1ada-cf35-4794-95e1-e9558b030893 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156730 May 23 13:56:28.427702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 933/1949] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:28 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:29.114343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:29.117942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:29.122302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:29.122768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:29.123514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:29.123946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:29.219154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fa8e99e1-61d8-44c9-93d0-94170947d768 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:29.219771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fa8e99e1-61d8-44c9-93d0-94170947d768 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:29.227875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa8e99e1-61d8-44c9-93d0-94170947d768 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:29.228335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa8e99e1-61d8-44c9-93d0-94170947d768 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:29.229136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa8e99e1-61d8-44c9-93d0-94170947d768 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:29.229604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa8e99e1-61d8-44c9-93d0-94170947d768 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:29.260596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:29.269348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:29.270871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:29.272069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc987301-0239-4085-b1e3-991117c03b86 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.161738 May 23 13:56:29.273200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1017/1950] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:29 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:29.316426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab163f6a-af62-4bc8-a836-409c4ba5df08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:29.317083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab163f6a-af62-4bc8-a836-409c4ba5df08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:29.324365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab163f6a-af62-4bc8-a836-409c4ba5df08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:29.324851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab163f6a-af62-4bc8-a836-409c4ba5df08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:29.325636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab163f6a-af62-4bc8-a836-409c4ba5df08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:29.326082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab163f6a-af62-4bc8-a836-409c4ba5df08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:29.365983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fa8e99e1-61d8-44c9-93d0-94170947d768 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:29.374641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fa8e99e1-61d8-44c9-93d0-94170947d768 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159248 May 23 13:56:29.375222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 934/1951] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:29 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:29.446551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d70b298-4724-44be-a2e0-8535c46d66bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:29.447445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d70b298-4724-44be-a2e0-8535c46d66bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:29.454259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d70b298-4724-44be-a2e0-8535c46d66bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:29.454708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d70b298-4724-44be-a2e0-8535c46d66bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:29.455524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d70b298-4724-44be-a2e0-8535c46d66bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:29.455958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d70b298-4724-44be-a2e0-8535c46d66bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:29.461289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab163f6a-af62-4bc8-a836-409c4ba5df08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:29.469493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab163f6a-af62-4bc8-a836-409c4ba5df08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156847 May 23 13:56:29.470076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1018/1952] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:29 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:29.593160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d70b298-4724-44be-a2e0-8535c46d66bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:29.602385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d70b298-4724-44be-a2e0-8535c46d66bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160474 May 23 13:56:29.602965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 935/1953] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:29 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:30.290691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:30.291298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:30.297795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:30.298241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:30.299002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:30.299429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:30.393296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bbcacc51-04a9-4a14-9755-96463f66843f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:30.394059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bbcacc51-04a9-4a14-9755-96463f66843f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:30.400772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbcacc51-04a9-4a14-9755-96463f66843f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:30.401218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbcacc51-04a9-4a14-9755-96463f66843f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:30.401979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbcacc51-04a9-4a14-9755-96463f66843f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:30.402408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbcacc51-04a9-4a14-9755-96463f66843f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:30.435972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:30.445121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:30.447121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:30.448299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-728b41a6-d7ba-40c0-99ed-e7e996ec87cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.161549 May 23 13:56:30.448895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1019/1954] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:30.486697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b7bfef46-839d-470a-8668-bb7789f55533 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:30.487322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b7bfef46-839d-470a-8668-bb7789f55533 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:30.493610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7bfef46-839d-470a-8668-bb7789f55533 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:30.494063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7bfef46-839d-470a-8668-bb7789f55533 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:30.494839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7bfef46-839d-470a-8668-bb7789f55533 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:30.495284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7bfef46-839d-470a-8668-bb7789f55533 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:30.537062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbcacc51-04a9-4a14-9755-96463f66843f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:30.547251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bbcacc51-04a9-4a14-9755-96463f66843f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157779 May 23 13:56:30.547861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 936/1955] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:30 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:30.619387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8336cbb-8579-439e-804e-d8e236b03c93 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:30.620005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8336cbb-8579-439e-804e-d8e236b03c93 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:30.626421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b7bfef46-839d-470a-8668-bb7789f55533 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:30.626650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8336cbb-8579-439e-804e-d8e236b03c93 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:30.627127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8336cbb-8579-439e-804e-d8e236b03c93 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:30.627903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8336cbb-8579-439e-804e-d8e236b03c93 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:30.628604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8336cbb-8579-439e-804e-d8e236b03c93 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:30.635148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b7bfef46-839d-470a-8668-bb7789f55533 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.152277 May 23 13:56:30.635721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1020/1956] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:30 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:30.769508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b8336cbb-8579-439e-804e-d8e236b03c93 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:30.777976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8336cbb-8579-439e-804e-d8e236b03c93 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162608 May 23 13:56:30.778550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 937/1957] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:30 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:31.467404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:31.467958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:31.474448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:31.474898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:31.475662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:31.476098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:31.564713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e727ee5d-6861-4586-bd57-7ebac428ba4c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:31.565322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e727ee5d-6861-4586-bd57-7ebac428ba4c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:31.572880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e727ee5d-6861-4586-bd57-7ebac428ba4c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:31.573320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e727ee5d-6861-4586-bd57-7ebac428ba4c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:31.574082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e727ee5d-6861-4586-bd57-7ebac428ba4c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:31.574509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e727ee5d-6861-4586-bd57-7ebac428ba4c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:31.615362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:31.624806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:31.626312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:31.627506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf7f3cd1-71fd-4e69-970c-d513431b4e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.164215 May 23 13:56:31.628064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1021/1958] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:31 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:31.653710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6ceadbf-a734-4628-9260-9203f3814bd8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:31.654513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6ceadbf-a734-4628-9260-9203f3814bd8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:31.660753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6ceadbf-a734-4628-9260-9203f3814bd8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:31.661208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6ceadbf-a734-4628-9260-9203f3814bd8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:31.662158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6ceadbf-a734-4628-9260-9203f3814bd8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:31.662608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6ceadbf-a734-4628-9260-9203f3814bd8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:31.710578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e727ee5d-6861-4586-bd57-7ebac428ba4c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:31.720561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e727ee5d-6861-4586-bd57-7ebac428ba4c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159675 May 23 13:56:31.721110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 938/1959] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:31 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:31.796038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c5d0921c-d9d2-4248-be5c-b708d5c12fe0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:31.796672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5d0921c-d9d2-4248-be5c-b708d5c12fe0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:31.803171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5d0921c-d9d2-4248-be5c-b708d5c12fe0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:31.803665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5d0921c-d9d2-4248-be5c-b708d5c12fe0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:31.804416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5d0921c-d9d2-4248-be5c-b708d5c12fe0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:31.804977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5d0921c-d9d2-4248-be5c-b708d5c12fe0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:31.809013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6ceadbf-a734-4628-9260-9203f3814bd8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:31.817296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6ceadbf-a734-4628-9260-9203f3814bd8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.168744 May 23 13:56:31.818114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1022/1960] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:31 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:31.936758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5d0921c-d9d2-4248-be5c-b708d5c12fe0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:31.944766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c5d0921c-d9d2-4248-be5c-b708d5c12fe0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152955 May 23 13:56:31.945416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 939/1961] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:31 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:32.646765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:32.647414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:32.654582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:32.655034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:32.655815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:32.656241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:32.738888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9feaf3ae-6c38-4dd0-9319-498709e4f3a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:32.739504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9feaf3ae-6c38-4dd0-9319-498709e4f3a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:32.746361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9feaf3ae-6c38-4dd0-9319-498709e4f3a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:32.746808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9feaf3ae-6c38-4dd0-9319-498709e4f3a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:32.747573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9feaf3ae-6c38-4dd0-9319-498709e4f3a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:32.748013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9feaf3ae-6c38-4dd0-9319-498709e4f3a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:32.788320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:32.797603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:32.799123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:32.800309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b4c7227c-5f76-472f-b099-44d9343280ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.157567 May 23 13:56:32.800898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1023/1962] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:32 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:32.837407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a418d60d-e701-4f52-b426-79e7f3bcd63f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:32.838115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a418d60d-e701-4f52-b426-79e7f3bcd63f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:32.844273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a418d60d-e701-4f52-b426-79e7f3bcd63f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:32.844966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a418d60d-e701-4f52-b426-79e7f3bcd63f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:32.845663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a418d60d-e701-4f52-b426-79e7f3bcd63f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:32.846104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a418d60d-e701-4f52-b426-79e7f3bcd63f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:32.884008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9feaf3ae-6c38-4dd0-9319-498709e4f3a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:32.892529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9feaf3ae-6c38-4dd0-9319-498709e4f3a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157591 May 23 13:56:32.893132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 940/1963] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:32 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:32.962136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-20361966-7793-4c55-8f67-051e18783131 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:32.962746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-20361966-7793-4c55-8f67-051e18783131 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:32.968837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20361966-7793-4c55-8f67-051e18783131 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:32.969291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20361966-7793-4c55-8f67-051e18783131 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:32.970074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20361966-7793-4c55-8f67-051e18783131 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:32.970507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20361966-7793-4c55-8f67-051e18783131 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:32.982759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a418d60d-e701-4f52-b426-79e7f3bcd63f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:32.991308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a418d60d-e701-4f52-b426-79e7f3bcd63f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158421 May 23 13:56:32.991893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1024/1964] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:32 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:33.104441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-20361966-7793-4c55-8f67-051e18783131 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:33.112499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-20361966-7793-4c55-8f67-051e18783131 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154250 May 23 13:56:33.113094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 941/1965] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:32 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:33.819431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:33.820117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:33.827223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:33.827675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:33.828453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:33.834634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:33.912087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-62b402fb-969d-41aa-8d6f-f5570cff8eaf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:33.913472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-62b402fb-969d-41aa-8d6f-f5570cff8eaf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:33.921325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62b402fb-969d-41aa-8d6f-f5570cff8eaf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:33.921778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62b402fb-969d-41aa-8d6f-f5570cff8eaf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:33.922580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62b402fb-969d-41aa-8d6f-f5570cff8eaf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:33.923026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62b402fb-969d-41aa-8d6f-f5570cff8eaf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:33.975945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:33.990880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:33.993436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:33.994799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-03ecaaae-b4b6-402a-bac7-6acb61ddd11f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.179235 May 23 13:56:33.995252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1025/1966] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:34.009182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-885f7187-6f1b-4474-9ac3-6decbbb2f9ec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:34.009932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-885f7187-6f1b-4474-9ac3-6decbbb2f9ec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:34.016265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-885f7187-6f1b-4474-9ac3-6decbbb2f9ec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:34.016804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-885f7187-6f1b-4474-9ac3-6decbbb2f9ec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:34.017612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-885f7187-6f1b-4474-9ac3-6decbbb2f9ec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:34.018156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-885f7187-6f1b-4474-9ac3-6decbbb2f9ec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:34.024205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:34.068095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-62b402fb-969d-41aa-8d6f-f5570cff8eaf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:34.077221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-62b402fb-969d-41aa-8d6f-f5570cff8eaf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.170243 May 23 13:56:34.077808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 942/1967] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:33 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:34.130151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45bda1b3-6012-40ad-af19-ab3565cd3770 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:34.130764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45bda1b3-6012-40ad-af19-ab3565cd3770 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:34.137089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45bda1b3-6012-40ad-af19-ab3565cd3770 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:34.137541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45bda1b3-6012-40ad-af19-ab3565cd3770 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:34.138318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45bda1b3-6012-40ad-af19-ab3565cd3770 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:34.138758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45bda1b3-6012-40ad-af19-ab3565cd3770 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:34.154461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-885f7187-6f1b-4474-9ac3-6decbbb2f9ec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:34.165491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-885f7187-6f1b-4474-9ac3-6decbbb2f9ec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159408 May 23 13:56:34.166214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1026/1968] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:34 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:34.275660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45bda1b3-6012-40ad-af19-ab3565cd3770 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:34.283893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45bda1b3-6012-40ad-af19-ab3565cd3770 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.157609 May 23 13:56:34.284507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 943/1969] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:34 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:35.013830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:35.014443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:35.020970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:35.021419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:35.022209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:35.022644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:35.095391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0f9d5633-345b-4d89-8e1c-d168e863d37a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:35.096030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0f9d5633-345b-4d89-8e1c-d168e863d37a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:35.103919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f9d5633-345b-4d89-8e1c-d168e863d37a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:35.104363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f9d5633-345b-4d89-8e1c-d168e863d37a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:35.105170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f9d5633-345b-4d89-8e1c-d168e863d37a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:35.105599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f9d5633-345b-4d89-8e1c-d168e863d37a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:35.157512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:35.167536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:35.169088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:35.170373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c4505a6-bd85-4f52-9434-76b0986cca14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.160444 May 23 13:56:35.170835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1027/1970] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:35 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:56:35.188390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-756be8cc-60df-419b-a265-df0f974d8837 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:35.189751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-756be8cc-60df-419b-a265-df0f974d8837 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:35.196225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-756be8cc-60df-419b-a265-df0f974d8837 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:35.200841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-756be8cc-60df-419b-a265-df0f974d8837 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:35.200841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-756be8cc-60df-419b-a265-df0f974d8837 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:35.200841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-756be8cc-60df-419b-a265-df0f974d8837 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:35.243835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0f9d5633-345b-4d89-8e1c-d168e863d37a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:35.252140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0f9d5633-345b-4d89-8e1c-d168e863d37a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160659 May 23 13:56:35.252943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 944/1971] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:35 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:35.301350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-70f4de26-bbdb-4523-aa85-a1df18d78d67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:35.302066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-70f4de26-bbdb-4523-aa85-a1df18d78d67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:35.308814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70f4de26-bbdb-4523-aa85-a1df18d78d67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:35.309350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70f4de26-bbdb-4523-aa85-a1df18d78d67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:35.310219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70f4de26-bbdb-4523-aa85-a1df18d78d67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:35.310719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70f4de26-bbdb-4523-aa85-a1df18d78d67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:35.337009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-756be8cc-60df-419b-a265-df0f974d8837 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:35.345127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-756be8cc-60df-419b-a265-df0f974d8837 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160828 May 23 13:56:35.345807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1028/1972] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:35 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:35.449226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-70f4de26-bbdb-4523-aa85-a1df18d78d67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:35.457265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-70f4de26-bbdb-4523-aa85-a1df18d78d67 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159808 May 23 13:56:35.457839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 945/1973] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:35 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:36.190156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:36.190772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:36.198069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:36.198527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:36.199295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:36.199737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:36.269798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fb9286e2-8af7-4f37-9574-74304b8dfd35 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:36.270400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fb9286e2-8af7-4f37-9574-74304b8dfd35 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:36.277550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb9286e2-8af7-4f37-9574-74304b8dfd35 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:36.277988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb9286e2-8af7-4f37-9574-74304b8dfd35 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:36.278750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb9286e2-8af7-4f37-9574-74304b8dfd35 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:36.279203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb9286e2-8af7-4f37-9574-74304b8dfd35 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:36.338777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:36.347430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:36.349013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:36.350196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0aeba325-a04f-4a6d-8185-ed9deb4a0386 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.164009 May 23 13:56:36.350761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1029/1974] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:36 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:36.363294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-829e9356-1b3f-4bd7-873c-2af5f8c83e3e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:36.363914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-829e9356-1b3f-4bd7-873c-2af5f8c83e3e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:36.370740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-829e9356-1b3f-4bd7-873c-2af5f8c83e3e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:36.371199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-829e9356-1b3f-4bd7-873c-2af5f8c83e3e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:36.371980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-829e9356-1b3f-4bd7-873c-2af5f8c83e3e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:36.372423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-829e9356-1b3f-4bd7-873c-2af5f8c83e3e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:36.417244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb9286e2-8af7-4f37-9574-74304b8dfd35 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:36.425262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fb9286e2-8af7-4f37-9574-74304b8dfd35 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159307 May 23 13:56:36.425831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 946/1975] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:36 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:36.476249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-998ab1d2-fbc8-4736-a09d-f3e6e2f8b917 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:36.477181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-998ab1d2-fbc8-4736-a09d-f3e6e2f8b917 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:36.485317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-998ab1d2-fbc8-4736-a09d-f3e6e2f8b917 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:36.485772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-998ab1d2-fbc8-4736-a09d-f3e6e2f8b917 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:36.486561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-998ab1d2-fbc8-4736-a09d-f3e6e2f8b917 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:36.487023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-998ab1d2-fbc8-4736-a09d-f3e6e2f8b917 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:36.514512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-829e9356-1b3f-4bd7-873c-2af5f8c83e3e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:36.522590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-829e9356-1b3f-4bd7-873c-2af5f8c83e3e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.163171 May 23 13:56:36.523170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1030/1976] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:36 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:36.624224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-998ab1d2-fbc8-4736-a09d-f3e6e2f8b917 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:36.633349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-998ab1d2-fbc8-4736-a09d-f3e6e2f8b917 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162183 May 23 13:56:36.633897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 947/1977] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:36 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:37.369451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:37.370068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:37.377062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:37.377505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:37.378272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:37.378705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:37.443591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ec0d130-a0af-4c33-a6ab-14d5f4d66cd5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:37.444198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ec0d130-a0af-4c33-a6ab-14d5f4d66cd5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:37.452049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ec0d130-a0af-4c33-a6ab-14d5f4d66cd5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:37.452499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ec0d130-a0af-4c33-a6ab-14d5f4d66cd5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:37.453309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ec0d130-a0af-4c33-a6ab-14d5f4d66cd5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:37.453737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ec0d130-a0af-4c33-a6ab-14d5f4d66cd5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:37.518987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:37.528159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:37.529697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:37.530877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e5f7afb-01a1-4f75-b1cb-cbf5daf9d11d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.166141 May 23 13:56:37.531434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1031/1978] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:37 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:37.543899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6b5fab6-6e09-41e0-bfbf-4fd5ad706f72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:37.544557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f6b5fab6-6e09-41e0-bfbf-4fd5ad706f72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:37.550972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6b5fab6-6e09-41e0-bfbf-4fd5ad706f72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:37.551418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6b5fab6-6e09-41e0-bfbf-4fd5ad706f72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:37.552181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6b5fab6-6e09-41e0-bfbf-4fd5ad706f72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:37.552638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6b5fab6-6e09-41e0-bfbf-4fd5ad706f72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:37.598057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ec0d130-a0af-4c33-a6ab-14d5f4d66cd5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:37.606491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ec0d130-a0af-4c33-a6ab-14d5f4d66cd5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.166950 May 23 13:56:37.607825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 948/1979] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:37 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:37.651091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-40324098-aed8-4d25-b178-7830d0b399c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:37.651792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-40324098-aed8-4d25-b178-7830d0b399c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:37.658035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40324098-aed8-4d25-b178-7830d0b399c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:37.658484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40324098-aed8-4d25-b178-7830d0b399c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:37.659298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40324098-aed8-4d25-b178-7830d0b399c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:37.659733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40324098-aed8-4d25-b178-7830d0b399c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:37.689574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6b5fab6-6e09-41e0-bfbf-4fd5ad706f72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:37.698765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f6b5fab6-6e09-41e0-bfbf-4fd5ad706f72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159493 May 23 13:56:37.699355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1032/1980] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:37 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:37.795513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40324098-aed8-4d25-b178-7830d0b399c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:37.803555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-40324098-aed8-4d25-b178-7830d0b399c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156872 May 23 13:56:37.804760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 949/1981] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:37 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:38.549647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:38.550185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:38.557851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:38.558296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:38.559066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:38.559524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:38.625892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-26c9b7ff-7079-4563-8159-021942841aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:38.627039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-26c9b7ff-7079-4563-8159-021942841aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:38.639172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26c9b7ff-7079-4563-8159-021942841aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:38.639750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26c9b7ff-7079-4563-8159-021942841aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:38.640676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26c9b7ff-7079-4563-8159-021942841aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:38.641272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26c9b7ff-7079-4563-8159-021942841aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:38.663260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:38.716459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:38.726954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:38.728476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:38.729747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39513f85-86ed-4270-a478-2772d025e57e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.184271 May 23 13:56:38.730313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1033/1982] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:38 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:38.734807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c9511f13-cc22-4596-bcda-2b4ecf46b542 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:38.735419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c9511f13-cc22-4596-bcda-2b4ecf46b542 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:38.742878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9511f13-cc22-4596-bcda-2b4ecf46b542 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:38.743335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9511f13-cc22-4596-bcda-2b4ecf46b542 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:38.744153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9511f13-cc22-4596-bcda-2b4ecf46b542 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:38.744621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9511f13-cc22-4596-bcda-2b4ecf46b542 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:38.798542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-26c9b7ff-7079-4563-8159-021942841aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:38.810700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-26c9b7ff-7079-4563-8159-021942841aca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.189938 May 23 13:56:38.811725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 950/1983] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:38 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:38.824242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a6790809-5dc6-4e62-bec8-0a46858f865b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:38.824888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a6790809-5dc6-4e62-bec8-0a46858f865b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:38.832303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6790809-5dc6-4e62-bec8-0a46858f865b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:38.832843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6790809-5dc6-4e62-bec8-0a46858f865b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:38.833789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6790809-5dc6-4e62-bec8-0a46858f865b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:38.834600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6790809-5dc6-4e62-bec8-0a46858f865b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:38.901645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c9511f13-cc22-4596-bcda-2b4ecf46b542 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:38.910597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c9511f13-cc22-4596-bcda-2b4ecf46b542 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.179229 May 23 13:56:38.911379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1034/1984] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:38 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:38.978457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a6790809-5dc6-4e62-bec8-0a46858f865b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:38.986888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a6790809-5dc6-4e62-bec8-0a46858f865b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.168124 May 23 13:56:38.987460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 951/1985] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:38 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:39.748796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:39.749410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:39.756083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:39.756583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:39.758363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:39.758823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:39.831281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-74d71737-9e4f-4b5c-8a81-5505308a9733 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:39.831889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-74d71737-9e4f-4b5c-8a81-5505308a9733 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:39.839527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74d71737-9e4f-4b5c-8a81-5505308a9733 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:39.840007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74d71737-9e4f-4b5c-8a81-5505308a9733 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:39.840833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74d71737-9e4f-4b5c-8a81-5505308a9733 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:39.841261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74d71737-9e4f-4b5c-8a81-5505308a9733 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:39.889768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:39.898195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:39.899720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:39.900922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3073e3b1-e2d1-494c-9095-59bbc5db5f23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.156028 May 23 13:56:39.901490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1035/1986] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:39 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:39.929940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5aeea6fa-27a7-4c99-a82a-31f4ada3e553 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:39.930565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5aeea6fa-27a7-4c99-a82a-31f4ada3e553 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:39.936719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5aeea6fa-27a7-4c99-a82a-31f4ada3e553 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:39.937189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5aeea6fa-27a7-4c99-a82a-31f4ada3e553 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:39.937930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5aeea6fa-27a7-4c99-a82a-31f4ada3e553 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:39.938386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5aeea6fa-27a7-4c99-a82a-31f4ada3e553 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:39.976554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-74d71737-9e4f-4b5c-8a81-5505308a9733 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:39.985035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-74d71737-9e4f-4b5c-8a81-5505308a9733 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157492 May 23 13:56:39.985871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 952/1987] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:39 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:40.005158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f1cbbd3b-16ca-4bbc-b8fa-2f5d44e7858d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:40.005685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f1cbbd3b-16ca-4bbc-b8fa-2f5d44e7858d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:40.011877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1cbbd3b-16ca-4bbc-b8fa-2f5d44e7858d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:40.012324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1cbbd3b-16ca-4bbc-b8fa-2f5d44e7858d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:40.013122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1cbbd3b-16ca-4bbc-b8fa-2f5d44e7858d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:40.013554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f1cbbd3b-16ca-4bbc-b8fa-2f5d44e7858d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:40.073641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5aeea6fa-27a7-4c99-a82a-31f4ada3e553 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:40.081910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5aeea6fa-27a7-4c99-a82a-31f4ada3e553 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156430 May 23 13:56:40.082486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1036/1988] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:39 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:40.149806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f1cbbd3b-16ca-4bbc-b8fa-2f5d44e7858d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:40.157855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f1cbbd3b-16ca-4bbc-b8fa-2f5d44e7858d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156667 May 23 13:56:40.158422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 953/1989] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:40 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:40.919263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:40.919862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:40.926366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:40.926815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:40.927579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:40.928016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:41.002853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f84dc76-100b-4c72-b287-09d341b1b8fa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:41.003472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f84dc76-100b-4c72-b287-09d341b1b8fa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:41.010829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f84dc76-100b-4c72-b287-09d341b1b8fa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:41.011278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f84dc76-100b-4c72-b287-09d341b1b8fa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:41.012049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f84dc76-100b-4c72-b287-09d341b1b8fa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:41.012485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f84dc76-100b-4c72-b287-09d341b1b8fa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:41.071562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:41.080116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:41.081666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:41.082835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-915b6613-f64a-4284-afdb-75211c29e17d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.167546 May 23 13:56:41.083389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1037/1990] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:41.099319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37aa36d2-828a-44c5-a2a6-2efc670d0650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:41.099941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37aa36d2-828a-44c5-a2a6-2efc670d0650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:41.106579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37aa36d2-828a-44c5-a2a6-2efc670d0650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:41.107031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37aa36d2-828a-44c5-a2a6-2efc670d0650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:41.107806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37aa36d2-828a-44c5-a2a6-2efc670d0650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:41.108249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37aa36d2-828a-44c5-a2a6-2efc670d0650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:41.148595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f84dc76-100b-4c72-b287-09d341b1b8fa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:41.157124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f84dc76-100b-4c72-b287-09d341b1b8fa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158150 May 23 13:56:41.157739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 954/1991] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:40 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:41.177309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-afd22f5f-0069-4db7-a7f7-e0c943959219 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:41.178173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-afd22f5f-0069-4db7-a7f7-e0c943959219 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:41.185108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afd22f5f-0069-4db7-a7f7-e0c943959219 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:41.185624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afd22f5f-0069-4db7-a7f7-e0c943959219 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:41.186479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afd22f5f-0069-4db7-a7f7-e0c943959219 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:41.186975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afd22f5f-0069-4db7-a7f7-e0c943959219 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:41.246024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37aa36d2-828a-44c5-a2a6-2efc670d0650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:41.258309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37aa36d2-828a-44c5-a2a6-2efc670d0650 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.162589 May 23 13:56:41.259127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1038/1992] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:41 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:41.329591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-afd22f5f-0069-4db7-a7f7-e0c943959219 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:41.338623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-afd22f5f-0069-4db7-a7f7-e0c943959219 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.165198 May 23 13:56:41.339270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 955/1993] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:41 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:42.103790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:42.104412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:42.111088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:42.111545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:42.112311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:42.112772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:42.175474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d793365a-455c-4f1b-a194-eb326b84dd10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:42.182152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d793365a-455c-4f1b-a194-eb326b84dd10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:42.198252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d793365a-455c-4f1b-a194-eb326b84dd10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:42.198714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d793365a-455c-4f1b-a194-eb326b84dd10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:42.199601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d793365a-455c-4f1b-a194-eb326b84dd10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:42.199967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d793365a-455c-4f1b-a194-eb326b84dd10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:42.264543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:42.273918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:42.275803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:42.277101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68dcc0d0-4e47-4453-b10c-e1278653ee0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.177927 May 23 13:56:42.277664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1039/1994] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:42 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:42.282307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-57ebeb66-b03a-4491-9dac-004ebb7f4c4c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:42.282925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-57ebeb66-b03a-4491-9dac-004ebb7f4c4c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:42.289617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57ebeb66-b03a-4491-9dac-004ebb7f4c4c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:42.290064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57ebeb66-b03a-4491-9dac-004ebb7f4c4c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:42.290844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57ebeb66-b03a-4491-9dac-004ebb7f4c4c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:42.291288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57ebeb66-b03a-4491-9dac-004ebb7f4c4c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:42.350232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d793365a-455c-4f1b-a194-eb326b84dd10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:42.359407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d793365a-455c-4f1b-a194-eb326b84dd10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.187782 May 23 13:56:42.359921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 956/1995] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:42 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:42.364645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-08809df1-5a32-46ec-aae7-286f13b98bd8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:42.365051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-08809df1-5a32-46ec-aae7-286f13b98bd8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:42.371240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08809df1-5a32-46ec-aae7-286f13b98bd8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:42.371794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08809df1-5a32-46ec-aae7-286f13b98bd8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:42.372487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08809df1-5a32-46ec-aae7-286f13b98bd8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:42.372932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08809df1-5a32-46ec-aae7-286f13b98bd8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:42.425605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-57ebeb66-b03a-4491-9dac-004ebb7f4c4c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:42.434441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-57ebeb66-b03a-4491-9dac-004ebb7f4c4c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155764 May 23 13:56:42.435013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1040/1996] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:42 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:42.505133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08809df1-5a32-46ec-aae7-286f13b98bd8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:42.513901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-08809df1-5a32-46ec-aae7-286f13b98bd8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153023 May 23 13:56:42.514466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 957/1997] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:42 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:43.296264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:43.296870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:43.306583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:43.307028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:43.307800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:43.308235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:43.376920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4efa3f41-d0e0-4740-afbf-700d81777420 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:43.377535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4efa3f41-d0e0-4740-afbf-700d81777420 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:43.384750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4efa3f41-d0e0-4740-afbf-700d81777420 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:43.385200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4efa3f41-d0e0-4740-afbf-700d81777420 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:43.385968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4efa3f41-d0e0-4740-afbf-700d81777420 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:43.386407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4efa3f41-d0e0-4740-afbf-700d81777420 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:43.443209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:43.454376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:43.455861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:43.457076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52633332-120f-41f3-b1f4-0958068421fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.165150 May 23 13:56:43.458768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1041/1998] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:43 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:43.463953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20c9709c-a469-49f7-8008-b3320bf996d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:43.464623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-20c9709c-a469-49f7-8008-b3320bf996d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:43.471458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20c9709c-a469-49f7-8008-b3320bf996d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:43.471458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20c9709c-a469-49f7-8008-b3320bf996d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:43.472209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20c9709c-a469-49f7-8008-b3320bf996d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:43.472680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20c9709c-a469-49f7-8008-b3320bf996d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:43.524419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4efa3f41-d0e0-4740-afbf-700d81777420 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:43.532672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4efa3f41-d0e0-4740-afbf-700d81777420 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159640 May 23 13:56:43.533246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 958/1999] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:43 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:43.537703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b88c3155-24c7-4cb4-9ba6-426f8441bb6c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:43.538330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b88c3155-24c7-4cb4-9ba6-426f8441bb6c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:43.544274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b88c3155-24c7-4cb4-9ba6-426f8441bb6c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:43.544751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b88c3155-24c7-4cb4-9ba6-426f8441bb6c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:43.545506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b88c3155-24c7-4cb4-9ba6-426f8441bb6c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:43.545935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b88c3155-24c7-4cb4-9ba6-426f8441bb6c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:43.615191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-20c9709c-a469-49f7-8008-b3320bf996d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:43.620329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:43.626434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-20c9709c-a469-49f7-8008-b3320bf996d4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166565 May 23 13:56:43.632709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1042/2000] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:43 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:43.689614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b88c3155-24c7-4cb4-9ba6-426f8441bb6c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:43.698571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b88c3155-24c7-4cb4-9ba6-426f8441bb6c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164301 May 23 13:56:43.699065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 959/2001] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:43 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:44.477112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:44.477726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:44.484412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:44.484891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:44.485660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:44.486101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:44.551532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8cba3efe-cfae-420d-b45f-5aa078965ca5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:44.552146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8cba3efe-cfae-420d-b45f-5aa078965ca5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:44.558691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cba3efe-cfae-420d-b45f-5aa078965ca5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:44.559140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cba3efe-cfae-420d-b45f-5aa078965ca5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:44.559898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cba3efe-cfae-420d-b45f-5aa078965ca5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:44.560326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cba3efe-cfae-420d-b45f-5aa078965ca5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:44.625247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:44.643148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:44.645456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:44.646843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d5a936db-1b0f-41c2-af78-30a581af238b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.174751 May 23 13:56:44.647392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1043/2002] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:44 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:44.652617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-490bd9e0-3795-40db-afd7-dde43e8de7aa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:44.653228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-490bd9e0-3795-40db-afd7-dde43e8de7aa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:44.659228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-490bd9e0-3795-40db-afd7-dde43e8de7aa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:44.659672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-490bd9e0-3795-40db-afd7-dde43e8de7aa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:44.660500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-490bd9e0-3795-40db-afd7-dde43e8de7aa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:44.660956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-490bd9e0-3795-40db-afd7-dde43e8de7aa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:44.698026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8cba3efe-cfae-420d-b45f-5aa078965ca5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:44.706541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8cba3efe-cfae-420d-b45f-5aa078965ca5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158836 May 23 13:56:44.707338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 960/2003] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:44 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:44.715348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-947f0bcb-e99e-4d49-b110-98edd4dcf9e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:44.715954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-947f0bcb-e99e-4d49-b110-98edd4dcf9e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:44.722003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-947f0bcb-e99e-4d49-b110-98edd4dcf9e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:44.722454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-947f0bcb-e99e-4d49-b110-98edd4dcf9e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:44.723229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-947f0bcb-e99e-4d49-b110-98edd4dcf9e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:44.723666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-947f0bcb-e99e-4d49-b110-98edd4dcf9e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:44.793355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-490bd9e0-3795-40db-afd7-dde43e8de7aa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:44.801381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-490bd9e0-3795-40db-afd7-dde43e8de7aa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.152504 May 23 13:56:44.802146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1044/2004] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:44 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:44.856618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-947f0bcb-e99e-4d49-b110-98edd4dcf9e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:44.867776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-947f0bcb-e99e-4d49-b110-98edd4dcf9e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155984 May 23 13:56:44.868416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 961/2005] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:44 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:45.666260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:45.666874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:45.673164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:45.673620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:45.674380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:45.674819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:45.724199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6029cb7f-e32c-4cc5-9a64-d5438d1f2a6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:45.724890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6029cb7f-e32c-4cc5-9a64-d5438d1f2a6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:45.731838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6029cb7f-e32c-4cc5-9a64-d5438d1f2a6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:45.732281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6029cb7f-e32c-4cc5-9a64-d5438d1f2a6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:45.733069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6029cb7f-e32c-4cc5-9a64-d5438d1f2a6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:45.733505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6029cb7f-e32c-4cc5-9a64-d5438d1f2a6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:45.803092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:45.812319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:45.813947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:45.815274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aaf7e83d-587b-41ba-bbae-934328b27670 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.153510 May 23 13:56:45.819572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1045/2006] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:45.820984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0326087b-8de6-4bc3-834c-dd3b021df06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:45.821869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0326087b-8de6-4bc3-834c-dd3b021df06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:45.828051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0326087b-8de6-4bc3-834c-dd3b021df06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:45.828515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0326087b-8de6-4bc3-834c-dd3b021df06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:45.829331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0326087b-8de6-4bc3-834c-dd3b021df06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:45.829775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0326087b-8de6-4bc3-834c-dd3b021df06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:45.869644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6029cb7f-e32c-4cc5-9a64-d5438d1f2a6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:45.877995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6029cb7f-e32c-4cc5-9a64-d5438d1f2a6e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157592 May 23 13:56:45.878578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 962/2007] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:45 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:45.891571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97204570-bb1c-41f7-8ee9-0b225799690f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:45.892183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97204570-bb1c-41f7-8ee9-0b225799690f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:45.898477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97204570-bb1c-41f7-8ee9-0b225799690f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:45.898928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97204570-bb1c-41f7-8ee9-0b225799690f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:45.899691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97204570-bb1c-41f7-8ee9-0b225799690f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:45.900125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97204570-bb1c-41f7-8ee9-0b225799690f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:45.968008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0326087b-8de6-4bc3-834c-dd3b021df06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:45.976361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0326087b-8de6-4bc3-834c-dd3b021df06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159608 May 23 13:56:45.976955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1046/2008] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:45 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:46.032618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97204570-bb1c-41f7-8ee9-0b225799690f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:46.042296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97204570-bb1c-41f7-8ee9-0b225799690f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154556 May 23 13:56:46.042867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 963/2009] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:45 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:46.833690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:46.834312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:46.841756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:46.842213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:46.842988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:46.843430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:46.895448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cba7d4fa-115f-4068-91c7-07f92648a61a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:46.896060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cba7d4fa-115f-4068-91c7-07f92648a61a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:46.903127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba7d4fa-115f-4068-91c7-07f92648a61a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:46.903581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba7d4fa-115f-4068-91c7-07f92648a61a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:46.904346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba7d4fa-115f-4068-91c7-07f92648a61a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:46.904807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba7d4fa-115f-4068-91c7-07f92648a61a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:46.978457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:46.987371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:46.988956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:46.990151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e419643-e6cd-4b6b-8f72-5c8d159432ca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.160429 May 23 13:56:46.990933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1047/2010] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:47.001436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-874b2276-9cda-4c43-875d-3109407c5317 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:47.002060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-874b2276-9cda-4c43-875d-3109407c5317 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:47.009344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-874b2276-9cda-4c43-875d-3109407c5317 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:47.009741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-874b2276-9cda-4c43-875d-3109407c5317 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:47.010499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-874b2276-9cda-4c43-875d-3109407c5317 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:47.010940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-874b2276-9cda-4c43-875d-3109407c5317 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:47.039530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cba7d4fa-115f-4068-91c7-07f92648a61a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:47.047802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cba7d4fa-115f-4068-91c7-07f92648a61a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156234 May 23 13:56:47.049135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 964/2011] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:46 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:47.059613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9d46285d-211a-4f7d-b5fe-3a0855f1f892 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:47.062556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9d46285d-211a-4f7d-b5fe-3a0855f1f892 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:47.066269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d46285d-211a-4f7d-b5fe-3a0855f1f892 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:47.066724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d46285d-211a-4f7d-b5fe-3a0855f1f892 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:47.067493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d46285d-211a-4f7d-b5fe-3a0855f1f892 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:47.067934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d46285d-211a-4f7d-b5fe-3a0855f1f892 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:47.145205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-874b2276-9cda-4c43-875d-3109407c5317 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:47.153401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-874b2276-9cda-4c43-875d-3109407c5317 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155708 May 23 13:56:47.153981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1048/2012] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:46 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:47.207273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d46285d-211a-4f7d-b5fe-3a0855f1f892 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:47.215257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9d46285d-211a-4f7d-b5fe-3a0855f1f892 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159796 May 23 13:56:47.215863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 965/2013] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:47 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:48.010681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:48.011461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:48.018077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:48.018531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:48.019303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:48.019743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:48.066513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8851a2c6-ed20-438a-b4a3-68bf7c67bd95 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:48.067131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8851a2c6-ed20-438a-b4a3-68bf7c67bd95 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:48.075023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8851a2c6-ed20-438a-b4a3-68bf7c67bd95 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:48.075481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8851a2c6-ed20-438a-b4a3-68bf7c67bd95 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:48.076251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8851a2c6-ed20-438a-b4a3-68bf7c67bd95 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:48.076714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8851a2c6-ed20-438a-b4a3-68bf7c67bd95 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:48.155269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:48.166299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:48.171993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:48.171993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc137ef9-65e5-4f45-a38a-70dde2ae7309 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163473 May 23 13:56:48.171993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1049/2014] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:48.174941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed466603-b28b-4c2c-be8e-f42302df2910 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:48.175541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed466603-b28b-4c2c-be8e-f42302df2910 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:48.186244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed466603-b28b-4c2c-be8e-f42302df2910 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:48.187043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed466603-b28b-4c2c-be8e-f42302df2910 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:48.187833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed466603-b28b-4c2c-be8e-f42302df2910 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:48.188268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed466603-b28b-4c2c-be8e-f42302df2910 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:48.213607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8851a2c6-ed20-438a-b4a3-68bf7c67bd95 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:48.222568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8851a2c6-ed20-438a-b4a3-68bf7c67bd95 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160366 May 23 13:56:48.233614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 966/2015] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:48 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:48.236413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-286e5536-66a7-4391-ba83-4595bdfc4619 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:48.237013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-286e5536-66a7-4391-ba83-4595bdfc4619 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:48.243887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-286e5536-66a7-4391-ba83-4595bdfc4619 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:48.244293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-286e5536-66a7-4391-ba83-4595bdfc4619 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:48.245093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-286e5536-66a7-4391-ba83-4595bdfc4619 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:48.245526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-286e5536-66a7-4391-ba83-4595bdfc4619 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:48.249719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:48.328935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed466603-b28b-4c2c-be8e-f42302df2910 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:48.337710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed466603-b28b-4c2c-be8e-f42302df2910 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166807 May 23 13:56:48.338289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1050/2016] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:48 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:48.388872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-286e5536-66a7-4391-ba83-4595bdfc4619 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:48.396877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-286e5536-66a7-4391-ba83-4595bdfc4619 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164343 May 23 13:56:48.397990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 967/2017] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:48 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:49.189559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:49.190181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:49.197451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:49.197958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:49.198726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:49.199171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:49.240774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-690111f3-724e-42eb-9015-8d6f9c4692da tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:49.241425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-690111f3-724e-42eb-9015-8d6f9c4692da tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:49.248262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-690111f3-724e-42eb-9015-8d6f9c4692da tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:49.248749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-690111f3-724e-42eb-9015-8d6f9c4692da tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:49.249514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-690111f3-724e-42eb-9015-8d6f9c4692da tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:49.249972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-690111f3-724e-42eb-9015-8d6f9c4692da tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:49.330905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:49.340969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:49.342500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:49.343676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c81dbc1-eff3-4559-babb-adf56546e585 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.158062 May 23 13:56:49.344466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1051/2018] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:49 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:49.354729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5756d44c-bffd-446f-8035-f80183b5522f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:49.355344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5756d44c-bffd-446f-8035-f80183b5522f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:49.361494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5756d44c-bffd-446f-8035-f80183b5522f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:49.361947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5756d44c-bffd-446f-8035-f80183b5522f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:49.362769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5756d44c-bffd-446f-8035-f80183b5522f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:49.363212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5756d44c-bffd-446f-8035-f80183b5522f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:49.383529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-690111f3-724e-42eb-9015-8d6f9c4692da tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:49.391843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-690111f3-724e-42eb-9015-8d6f9c4692da tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.154875 May 23 13:56:49.392412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 968/2019] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:49 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:49.415062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dba4c7c7-dc64-4943-8c8c-4b382632f67b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:49.415665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dba4c7c7-dc64-4943-8c8c-4b382632f67b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:49.421968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dba4c7c7-dc64-4943-8c8c-4b382632f67b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:49.422423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dba4c7c7-dc64-4943-8c8c-4b382632f67b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:49.423203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dba4c7c7-dc64-4943-8c8c-4b382632f67b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:49.423641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dba4c7c7-dc64-4943-8c8c-4b382632f67b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:49.501200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5756d44c-bffd-446f-8035-f80183b5522f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:49.510046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5756d44c-bffd-446f-8035-f80183b5522f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159063 May 23 13:56:49.510628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1052/2020] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:49 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:49.562317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dba4c7c7-dc64-4943-8c8c-4b382632f67b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:49.571423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dba4c7c7-dc64-4943-8c8c-4b382632f67b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160020 May 23 13:56:49.571985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 969/2021] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:49 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:50.362822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:50.363463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:50.365984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:50.370703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:50.371160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:50.371948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:50.372377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:50.409799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-390ac931-65d4-4ef1-9245-eabcc0825c5f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:50.410527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-390ac931-65d4-4ef1-9245-eabcc0825c5f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:50.413867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:50.418907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-390ac931-65d4-4ef1-9245-eabcc0825c5f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:50.420494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-390ac931-65d4-4ef1-9245-eabcc0825c5f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:50.420494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-390ac931-65d4-4ef1-9245-eabcc0825c5f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:50.420740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-390ac931-65d4-4ef1-9245-eabcc0825c5f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:50.511334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:50.520393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:50.522187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:50.524088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aa39b4f6-9dc3-4ebf-9542-c3af11d2c431 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.165064 May 23 13:56:50.524676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1053/2022] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:50 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:50.529421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c69b05c8-de74-4202-b39a-f7fa1c858e4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:50.530045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c69b05c8-de74-4202-b39a-f7fa1c858e4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:50.536240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c69b05c8-de74-4202-b39a-f7fa1c858e4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:50.536925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c69b05c8-de74-4202-b39a-f7fa1c858e4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:50.537751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c69b05c8-de74-4202-b39a-f7fa1c858e4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:50.538420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c69b05c8-de74-4202-b39a-f7fa1c858e4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:50.564933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-390ac931-65d4-4ef1-9245-eabcc0825c5f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:50.574135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-390ac931-65d4-4ef1-9245-eabcc0825c5f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.168134 May 23 13:56:50.574902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 970/2023] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:50 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:50.588291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b3cc4052-4588-4f0d-9ab2-245019381106 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:50.589107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b3cc4052-4588-4f0d-9ab2-245019381106 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:50.595124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3cc4052-4588-4f0d-9ab2-245019381106 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:50.595573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3cc4052-4588-4f0d-9ab2-245019381106 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:50.596350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3cc4052-4588-4f0d-9ab2-245019381106 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:50.596806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3cc4052-4588-4f0d-9ab2-245019381106 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:50.674146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c69b05c8-de74-4202-b39a-f7fa1c858e4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:50.683338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c69b05c8-de74-4202-b39a-f7fa1c858e4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.157378 May 23 13:56:50.684425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1054/2024] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:50 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:50.736664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b3cc4052-4588-4f0d-9ab2-245019381106 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:50.746319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b3cc4052-4588-4f0d-9ab2-245019381106 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161886 May 23 13:56:50.746908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 971/2025] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:50 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:51.542990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:51.543634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:51.550182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:51.550631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:51.551385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:51.551818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:51.591986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-11181b78-5a1a-4359-8d61-efa2ab6f481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:51.592689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-11181b78-5a1a-4359-8d61-efa2ab6f481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:51.599319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11181b78-5a1a-4359-8d61-efa2ab6f481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:51.599762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11181b78-5a1a-4359-8d61-efa2ab6f481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:51.600561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11181b78-5a1a-4359-8d61-efa2ab6f481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:51.601088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11181b78-5a1a-4359-8d61-efa2ab6f481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:51.695286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:51.704541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:51.706082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:51.707245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee139bb1-4cae-4436-9597-1dd55f7678ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.168274 May 23 13:56:51.707803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1055/2026] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:51 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:51.712406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b476c671-4568-461c-b7ab-fb9d7266c142 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:51.713060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b476c671-4568-461c-b7ab-fb9d7266c142 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:51.718963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b476c671-4568-461c-b7ab-fb9d7266c142 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:51.719416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b476c671-4568-461c-b7ab-fb9d7266c142 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:51.720212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b476c671-4568-461c-b7ab-fb9d7266c142 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:51.720678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b476c671-4568-461c-b7ab-fb9d7266c142 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:51.741536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-11181b78-5a1a-4359-8d61-efa2ab6f481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:51.750064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-11181b78-5a1a-4359-8d61-efa2ab6f481b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161857 May 23 13:56:51.750643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 972/2027] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:51 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:51.763017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-398a1522-2020-4ea3-abd0-676e3187d51d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:51.763631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-398a1522-2020-4ea3-abd0-676e3187d51d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:51.769735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-398a1522-2020-4ea3-abd0-676e3187d51d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:51.770187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-398a1522-2020-4ea3-abd0-676e3187d51d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:51.770959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-398a1522-2020-4ea3-abd0-676e3187d51d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:51.771398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-398a1522-2020-4ea3-abd0-676e3187d51d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:51.853169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b476c671-4568-461c-b7ab-fb9d7266c142 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:51.861470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b476c671-4568-461c-b7ab-fb9d7266c142 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.152671 May 23 13:56:51.863156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1056/2028] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:51 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:51.902627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-398a1522-2020-4ea3-abd0-676e3187d51d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:51.910474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-398a1522-2020-4ea3-abd0-676e3187d51d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.151283 May 23 13:56:51.911030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 973/2029] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:51 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:52.725779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:52.726400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:52.733549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:52.734007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:52.734776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:52.735220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:52.865689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:52.874880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:52.876413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:52.877635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a0e2eb5a-c559-4c6e-9384-9c4b5b9a2ee5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.155781 May 23 13:56:52.878276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1057/2030] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:52 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:53.030629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c4fd7cf-46d8-41c1-b7e2-867e19c641db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:53.031456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c4fd7cf-46d8-41c1-b7e2-867e19c641db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:53.037688 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c4fd7cf-46d8-41c1-b7e2-867e19c641db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:53.038140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c4fd7cf-46d8-41c1-b7e2-867e19c641db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:53.039551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c4fd7cf-46d8-41c1-b7e2-867e19c641db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:53.040095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c4fd7cf-46d8-41c1-b7e2-867e19c641db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:53.104500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1af513b9-5950-43b4-9ebc-021a989b9e63 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:53.105158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1af513b9-5950-43b4-9ebc-021a989b9e63 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:53.111346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af513b9-5950-43b4-9ebc-021a989b9e63 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:53.111789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af513b9-5950-43b4-9ebc-021a989b9e63 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:53.112611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af513b9-5950-43b4-9ebc-021a989b9e63 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:53.113050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1af513b9-5950-43b4-9ebc-021a989b9e63 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:53.184786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c4fd7cf-46d8-41c1-b7e2-867e19c641db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:53.192825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c4fd7cf-46d8-41c1-b7e2-867e19c641db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.427481 May 23 13:56:53.193472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 974/2031] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:52 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:53.198663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2bdc5a35-c519-4a7a-8d78-77fa6ab26995 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:53.199276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2bdc5a35-c519-4a7a-8d78-77fa6ab26995 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:53.205535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bdc5a35-c519-4a7a-8d78-77fa6ab26995 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:53.205988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bdc5a35-c519-4a7a-8d78-77fa6ab26995 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:53.206759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bdc5a35-c519-4a7a-8d78-77fa6ab26995 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:53.207193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bdc5a35-c519-4a7a-8d78-77fa6ab26995 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:53.257223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1af513b9-5950-43b4-9ebc-021a989b9e63 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:53.266210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1af513b9-5950-43b4-9ebc-021a989b9e63 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.386993 May 23 13:56:53.266794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1058/2032] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:52 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:53.345719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2bdc5a35-c519-4a7a-8d78-77fa6ab26995 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:53.355439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2bdc5a35-c519-4a7a-8d78-77fa6ab26995 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160958 May 23 13:56:53.356007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 975/2033] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:53 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:53.898449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:53.899109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:53.908720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:53.909177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:53.909962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:53.910407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:53.933185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:54.048671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:54.057890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:54.067884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:54.067884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1807eff-2578-493e-a4fe-e4b8240a280e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.167694 May 23 13:56:54.067884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1059/2034] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:53 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:54.210718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b7e7a071-c099-49d9-b4f0-723568ba8dbf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:54.217485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b7e7a071-c099-49d9-b4f0-723568ba8dbf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:54.223197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7e7a071-c099-49d9-b4f0-723568ba8dbf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:54.225285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7e7a071-c099-49d9-b4f0-723568ba8dbf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:54.225285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7e7a071-c099-49d9-b4f0-723568ba8dbf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:54.225285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7e7a071-c099-49d9-b4f0-723568ba8dbf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:54.283482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d7be0df-5333-45aa-929a-8b5673128527 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:54.284129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d7be0df-5333-45aa-929a-8b5673128527 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:54.291170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d7be0df-5333-45aa-929a-8b5673128527 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:54.291699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d7be0df-5333-45aa-929a-8b5673128527 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:54.292510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d7be0df-5333-45aa-929a-8b5673128527 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:54.292974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d7be0df-5333-45aa-929a-8b5673128527 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:54.366493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7e7a071-c099-49d9-b4f0-723568ba8dbf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:54.371888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b7e7a071-c099-49d9-b4f0-723568ba8dbf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165286 May 23 13:56:54.372263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 976/2035] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:54 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:54.377773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba72f751-a8f9-4b95-bc10-55b851e5105d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:54.378445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba72f751-a8f9-4b95-bc10-55b851e5105d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:54.386389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba72f751-a8f9-4b95-bc10-55b851e5105d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:54.386930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba72f751-a8f9-4b95-bc10-55b851e5105d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:54.387776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba72f751-a8f9-4b95-bc10-55b851e5105d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:54.388283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba72f751-a8f9-4b95-bc10-55b851e5105d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:54.432476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d7be0df-5333-45aa-929a-8b5673128527 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:54.440718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d7be0df-5333-45aa-929a-8b5673128527 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161134 May 23 13:56:54.441296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1060/2036] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:54 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:54.526830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba72f751-a8f9-4b95-bc10-55b851e5105d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:54.534896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba72f751-a8f9-4b95-bc10-55b851e5105d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161643 May 23 13:56:54.535466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 977/2037] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:54 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:55.079472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:55.080045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:55.086807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:55.087259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:55.088023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:55.088494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:55.221250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:55.230933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:55.232452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:55.233813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8f5b20e7-fe27-4f58-8b5b-6cb9e3e80701 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.158264 May 23 13:56:55.234259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1061/2038] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:55 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:55.389469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f9d3c291-f5cd-4d58-8922-b21010af7f40 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:55.390093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f9d3c291-f5cd-4d58-8922-b21010af7f40 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:55.396811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9d3c291-f5cd-4d58-8922-b21010af7f40 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:55.397289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9d3c291-f5cd-4d58-8922-b21010af7f40 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:55.398052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9d3c291-f5cd-4d58-8922-b21010af7f40 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:55.399111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9d3c291-f5cd-4d58-8922-b21010af7f40 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:55.459273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7219df0e-f428-4bd8-9244-4770db59f733 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:55.459935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7219df0e-f428-4bd8-9244-4770db59f733 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:55.466776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7219df0e-f428-4bd8-9244-4770db59f733 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:55.467229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7219df0e-f428-4bd8-9244-4770db59f733 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:55.468009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7219df0e-f428-4bd8-9244-4770db59f733 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:55.468463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7219df0e-f428-4bd8-9244-4770db59f733 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:55.534835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f9d3c291-f5cd-4d58-8922-b21010af7f40 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:55.544360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f9d3c291-f5cd-4d58-8922-b21010af7f40 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158721 May 23 13:56:55.545005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 978/2039] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:55 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:55.553168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f785dda-21b1-428f-9354-1606efa49b3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:55.553960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f785dda-21b1-428f-9354-1606efa49b3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:55.561844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f785dda-21b1-428f-9354-1606efa49b3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:55.562296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f785dda-21b1-428f-9354-1606efa49b3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:55.563103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f785dda-21b1-428f-9354-1606efa49b3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:55.563633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f785dda-21b1-428f-9354-1606efa49b3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:55.608945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7219df0e-f428-4bd8-9244-4770db59f733 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:55.617892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7219df0e-f428-4bd8-9244-4770db59f733 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161876 May 23 13:56:55.618515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1062/2040] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:55 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:55.708199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f785dda-21b1-428f-9354-1606efa49b3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:55.716483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f785dda-21b1-428f-9354-1606efa49b3b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.167636 May 23 13:56:55.717081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 979/2041] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:55 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:56.252607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:56.262410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:56.262410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:56.262410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:56.262410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:56.262783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:56.392909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:56.402279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:56.403773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:56.404948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a20c0717-4f7d-48b2-81db-c9110de9fd08 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.156297 May 23 13:56:56.405497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1063/2042] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:56 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:56.562327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cf60793c-731f-456c-89c6-7887a8162333 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:56.562858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cf60793c-731f-456c-89c6-7887a8162333 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:56.569375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf60793c-731f-456c-89c6-7887a8162333 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:56.569826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf60793c-731f-456c-89c6-7887a8162333 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:56.571074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf60793c-731f-456c-89c6-7887a8162333 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:56.571509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf60793c-731f-456c-89c6-7887a8162333 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:56.635476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0bb1cc4f-621f-4037-a254-c6bf96db6d12 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:56.636103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0bb1cc4f-621f-4037-a254-c6bf96db6d12 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:56.642200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb1cc4f-621f-4037-a254-c6bf96db6d12 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:56.642654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb1cc4f-621f-4037-a254-c6bf96db6d12 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:56.645705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb1cc4f-621f-4037-a254-c6bf96db6d12 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:56.645705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bb1cc4f-621f-4037-a254-c6bf96db6d12 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:56.706811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf60793c-731f-456c-89c6-7887a8162333 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:56.715606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cf60793c-731f-456c-89c6-7887a8162333 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157540 May 23 13:56:56.720443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 980/2043] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:56 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:56.733361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d8024d8d-d1ca-4fba-8ece-f803506c06ae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:56.733981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d8024d8d-d1ca-4fba-8ece-f803506c06ae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:56.740213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8024d8d-d1ca-4fba-8ece-f803506c06ae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:56.740787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8024d8d-d1ca-4fba-8ece-f803506c06ae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:56.741672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8024d8d-d1ca-4fba-8ece-f803506c06ae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:56.743612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8024d8d-d1ca-4fba-8ece-f803506c06ae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:56.779214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0bb1cc4f-621f-4037-a254-c6bf96db6d12 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:56.787690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0bb1cc4f-621f-4037-a254-c6bf96db6d12 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156153 May 23 13:56:56.788276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1064/2044] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:56 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:56.875572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d8024d8d-d1ca-4fba-8ece-f803506c06ae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:56.883660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d8024d8d-d1ca-4fba-8ece-f803506c06ae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154038 May 23 13:56:56.884228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 981/2045] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:56 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:57.423911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:57.424529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:57.431659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:57.432165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:57.432910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:57.433351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:57.565201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:57.574253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:57.575762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:57.576952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-20e2cd19-0a9a-4ff7-b27a-cbb67af420d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.157129 May 23 13:56:57.577511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1065/2046] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:57 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:57.733237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7b809a94-7a48-4535-ace6-942a4f71c23c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:57.733796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7b809a94-7a48-4535-ace6-942a4f71c23c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:57.740246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b809a94-7a48-4535-ace6-942a4f71c23c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:57.740724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b809a94-7a48-4535-ace6-942a4f71c23c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:57.741468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b809a94-7a48-4535-ace6-942a4f71c23c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:57.741927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b809a94-7a48-4535-ace6-942a4f71c23c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:57.805809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0243a77-3094-4acd-a12d-210f3058abe1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:57.806375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e0243a77-3094-4acd-a12d-210f3058abe1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:57.812910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0243a77-3094-4acd-a12d-210f3058abe1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:57.814026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0243a77-3094-4acd-a12d-210f3058abe1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:57.814352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0243a77-3094-4acd-a12d-210f3058abe1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:57.814828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0243a77-3094-4acd-a12d-210f3058abe1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:57.878082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7b809a94-7a48-4535-ace6-942a4f71c23c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:57.886883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7b809a94-7a48-4535-ace6-942a4f71c23c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157678 May 23 13:56:57.887452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 982/2047] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:57 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:57.900915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46a29218-f08f-4a24-ad9e-6d7e12c44ed2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:57.901538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46a29218-f08f-4a24-ad9e-6d7e12c44ed2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:57.907716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46a29218-f08f-4a24-ad9e-6d7e12c44ed2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:57.908162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46a29218-f08f-4a24-ad9e-6d7e12c44ed2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:57.908961 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46a29218-f08f-4a24-ad9e-6d7e12c44ed2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:57.909452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46a29218-f08f-4a24-ad9e-6d7e12c44ed2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:57.949733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0243a77-3094-4acd-a12d-210f3058abe1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:57.957849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e0243a77-3094-4acd-a12d-210f3058abe1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155984 May 23 13:56:57.958428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1066/2048] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:57 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:58.040815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46a29218-f08f-4a24-ad9e-6d7e12c44ed2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:58.044239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:56:58.049071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46a29218-f08f-4a24-ad9e-6d7e12c44ed2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.151964 May 23 13:56:58.049636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 983/2049] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:57 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:56:58.595473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:58.596129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:58.604024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:58.604484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:58.605308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:58.605755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:58.751876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:58.760305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:58.761846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:58.763016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c8bb1bc0-6495-4cad-add8-f17a8c6b3d99 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.171526 May 23 13:56:58.763564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1067/2050] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:56:58.904124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-faafd0ac-5775-48bf-9950-24c90ebab30f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:58.904771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-faafd0ac-5775-48bf-9950-24c90ebab30f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:58.911584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-faafd0ac-5775-48bf-9950-24c90ebab30f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:58.912029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-faafd0ac-5775-48bf-9950-24c90ebab30f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:58.912847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-faafd0ac-5775-48bf-9950-24c90ebab30f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:58.913284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-faafd0ac-5775-48bf-9950-24c90ebab30f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:58.975553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-80b8a2da-54fe-4833-af51-d2da12234ec8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:58.976176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-80b8a2da-54fe-4833-af51-d2da12234ec8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:58.990571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80b8a2da-54fe-4833-af51-d2da12234ec8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:58.991056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80b8a2da-54fe-4833-af51-d2da12234ec8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:58.991880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80b8a2da-54fe-4833-af51-d2da12234ec8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:58.992332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80b8a2da-54fe-4833-af51-d2da12234ec8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:59.053508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-faafd0ac-5775-48bf-9950-24c90ebab30f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:59.060674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-faafd0ac-5775-48bf-9950-24c90ebab30f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160677 May 23 13:56:59.061255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 984/2051] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:58 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:59.067246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1bcf31df-e66a-4384-9210-53fdf7af524b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:59.067858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1bcf31df-e66a-4384-9210-53fdf7af524b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:59.074444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bcf31df-e66a-4384-9210-53fdf7af524b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:59.074894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bcf31df-e66a-4384-9210-53fdf7af524b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:59.075655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bcf31df-e66a-4384-9210-53fdf7af524b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:59.076090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bcf31df-e66a-4384-9210-53fdf7af524b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:59.125901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-80b8a2da-54fe-4833-af51-d2da12234ec8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:59.134535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-80b8a2da-54fe-4833-af51-d2da12234ec8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.163279 May 23 13:56:59.140744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1068/2052] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:58 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:59.215480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1bcf31df-e66a-4384-9210-53fdf7af524b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:59.224238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1bcf31df-e66a-4384-9210-53fdf7af524b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160792 May 23 13:56:59.224873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 985/2053] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:56:59 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:56:59.781897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:56:59.782514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:56:59.789859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:59.790313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:59.791081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:56:59.791519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:56:59.920144 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:59.929092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:59.931289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:56:59.932504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7323d718-66d2-4143-843e-ef2f025098fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.154587 May 23 13:56:59.933105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1069/2054] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:56:59 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:00.078776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e0fbb99d-653d-4abc-ab39-49d2a34149dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:00.079296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e0fbb99d-653d-4abc-ab39-49d2a34149dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:00.085373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0fbb99d-653d-4abc-ab39-49d2a34149dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:00.085885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0fbb99d-653d-4abc-ab39-49d2a34149dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:00.086640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0fbb99d-653d-4abc-ab39-49d2a34149dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:00.087071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0fbb99d-653d-4abc-ab39-49d2a34149dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:00.152497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d58b6a63-b0e8-419e-b8cb-722296c33402 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:00.153161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d58b6a63-b0e8-419e-b8cb-722296c33402 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:00.159133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d58b6a63-b0e8-419e-b8cb-722296c33402 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:00.159586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d58b6a63-b0e8-419e-b8cb-722296c33402 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:00.160387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d58b6a63-b0e8-419e-b8cb-722296c33402 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:00.160837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d58b6a63-b0e8-419e-b8cb-722296c33402 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:00.221743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e0fbb99d-653d-4abc-ab39-49d2a34149dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:00.231143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e0fbb99d-653d-4abc-ab39-49d2a34149dd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156505 May 23 13:57:00.233670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 986/2055] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:00 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:00.245348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-653dc4f0-2b08-44ef-8006-490463770234 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:00.245988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-653dc4f0-2b08-44ef-8006-490463770234 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:00.252129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653dc4f0-2b08-44ef-8006-490463770234 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:00.252719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653dc4f0-2b08-44ef-8006-490463770234 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:00.253379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653dc4f0-2b08-44ef-8006-490463770234 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:00.253816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-653dc4f0-2b08-44ef-8006-490463770234 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:00.309880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d58b6a63-b0e8-419e-b8cb-722296c33402 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:00.318331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d58b6a63-b0e8-419e-b8cb-722296c33402 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.170428 May 23 13:57:00.318907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1070/2056] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:00 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:00.387254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-653dc4f0-2b08-44ef-8006-490463770234 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:00.395207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-653dc4f0-2b08-44ef-8006-490463770234 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156234 May 23 13:57:00.395780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 987/2057] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:00 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:00.951332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:00.952396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:00.959864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:00.960526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:00.961534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:00.961973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:01.091002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:01.099786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:01.101640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:01.102769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7c2cc92b-7fab-4536-9a65-d6f1885f55ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.155452 May 23 13:57:01.103325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1071/2058] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:01.253587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45dd262c-c9d7-4f72-92e4-cee134719b06 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:01.254126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45dd262c-c9d7-4f72-92e4-cee134719b06 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:01.261364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45dd262c-c9d7-4f72-92e4-cee134719b06 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:01.261808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45dd262c-c9d7-4f72-92e4-cee134719b06 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:01.262558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45dd262c-c9d7-4f72-92e4-cee134719b06 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:01.262993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45dd262c-c9d7-4f72-92e4-cee134719b06 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:01.335225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e6887fbc-351b-415d-84a6-30799dbbfd48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:01.335902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e6887fbc-351b-415d-84a6-30799dbbfd48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:01.341998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6887fbc-351b-415d-84a6-30799dbbfd48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:01.342356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6887fbc-351b-415d-84a6-30799dbbfd48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:01.343124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6887fbc-351b-415d-84a6-30799dbbfd48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:01.343556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6887fbc-351b-415d-84a6-30799dbbfd48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:01.394510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45dd262c-c9d7-4f72-92e4-cee134719b06 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:01.403284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45dd262c-c9d7-4f72-92e4-cee134719b06 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.153615 May 23 13:57:01.404052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 988/2059] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:01 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:01.412640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8d0f107-2f56-439c-b64a-4bc642a6f981 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:01.423830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8d0f107-2f56-439c-b64a-4bc642a6f981 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:01.423830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8d0f107-2f56-439c-b64a-4bc642a6f981 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:01.423830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8d0f107-2f56-439c-b64a-4bc642a6f981 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:01.423830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8d0f107-2f56-439c-b64a-4bc642a6f981 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:01.424247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8d0f107-2f56-439c-b64a-4bc642a6f981 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:01.487027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6887fbc-351b-415d-84a6-30799dbbfd48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:01.496073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e6887fbc-351b-415d-84a6-30799dbbfd48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164639 May 23 13:57:01.496687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1072/2060] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:01 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:01.559305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8d0f107-2f56-439c-b64a-4bc642a6f981 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:01.567594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8d0f107-2f56-439c-b64a-4bc642a6f981 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158763 May 23 13:57:01.568162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 989/2061] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:01 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:02.122176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:02.122792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:02.129546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:02.130003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:02.130807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:02.131252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:02.261353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:02.269702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:02.271199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:02.272388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d7ee8354-37bc-49f1-b200-f53d4a97556a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.154335 May 23 13:57:02.273011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1073/2062] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:02 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:02.421329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3e6df267-ec63-431a-a480-fc626b247cc3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:02.421875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3e6df267-ec63-431a-a480-fc626b247cc3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:02.428479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e6df267-ec63-431a-a480-fc626b247cc3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:02.428958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e6df267-ec63-431a-a480-fc626b247cc3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:02.429743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e6df267-ec63-431a-a480-fc626b247cc3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:02.430165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e6df267-ec63-431a-a480-fc626b247cc3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:02.513603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-35b7ce49-98b5-4c74-9347-9c4d2ce4fefa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:02.514219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-35b7ce49-98b5-4c74-9347-9c4d2ce4fefa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:02.520298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35b7ce49-98b5-4c74-9347-9c4d2ce4fefa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:02.520780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35b7ce49-98b5-4c74-9347-9c4d2ce4fefa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:02.521546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35b7ce49-98b5-4c74-9347-9c4d2ce4fefa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:02.521983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35b7ce49-98b5-4c74-9347-9c4d2ce4fefa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:02.563467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e6df267-ec63-431a-a480-fc626b247cc3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:02.572866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3e6df267-ec63-431a-a480-fc626b247cc3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.155363 May 23 13:57:02.573449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 990/2063] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:02 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:02.587584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13f716b4-f813-4a65-a5ba-b715a85e360c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:02.588208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-13f716b4-f813-4a65-a5ba-b715a85e360c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:02.594340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13f716b4-f813-4a65-a5ba-b715a85e360c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:02.594793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13f716b4-f813-4a65-a5ba-b715a85e360c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:02.595561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13f716b4-f813-4a65-a5ba-b715a85e360c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:02.595997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13f716b4-f813-4a65-a5ba-b715a85e360c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:02.656895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-35b7ce49-98b5-4c74-9347-9c4d2ce4fefa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:02.665738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-35b7ce49-98b5-4c74-9347-9c4d2ce4fefa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155999 May 23 13:57:02.666413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1074/2064] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:02 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:02.734548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-13f716b4-f813-4a65-a5ba-b715a85e360c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:02.742666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-13f716b4-f813-4a65-a5ba-b715a85e360c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160351 May 23 13:57:02.743227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 991/2065] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:02 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:03.292403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:03.292953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:03.299425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:03.299878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:03.300668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:03.301117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:03.433736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:03.442086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:03.443669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:03.444896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0721af11-af63-49fc-ae7c-890b27347097 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.157207 May 23 13:57:03.446293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1075/2066] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:03 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:03.591174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b460dd78-0223-48de-a289-4c8dce207927 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:03.591744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b460dd78-0223-48de-a289-4c8dce207927 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:03.598357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b460dd78-0223-48de-a289-4c8dce207927 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:03.600395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b460dd78-0223-48de-a289-4c8dce207927 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:03.600395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b460dd78-0223-48de-a289-4c8dce207927 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:03.600395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b460dd78-0223-48de-a289-4c8dce207927 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:03.683420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a9279af-8440-4ec0-9d42-fe4826a93a82 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:03.684039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a9279af-8440-4ec0-9d42-fe4826a93a82 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:03.690562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a9279af-8440-4ec0-9d42-fe4826a93a82 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:03.691012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a9279af-8440-4ec0-9d42-fe4826a93a82 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:03.691853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a9279af-8440-4ec0-9d42-fe4826a93a82 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:03.692299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a9279af-8440-4ec0-9d42-fe4826a93a82 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:03.697465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:03.732709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b460dd78-0223-48de-a289-4c8dce207927 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:03.741476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b460dd78-0223-48de-a289-4c8dce207927 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.154379 May 23 13:57:03.742115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 992/2067] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:03 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:03.760007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bbe87d04-33d5-45e5-9987-405bc2161fda tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:03.760640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bbe87d04-33d5-45e5-9987-405bc2161fda tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:03.766906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbe87d04-33d5-45e5-9987-405bc2161fda tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:03.767355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbe87d04-33d5-45e5-9987-405bc2161fda tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:03.768143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbe87d04-33d5-45e5-9987-405bc2161fda tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:03.768685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbe87d04-33d5-45e5-9987-405bc2161fda tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:03.841527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a9279af-8440-4ec0-9d42-fe4826a93a82 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:03.849605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a9279af-8440-4ec0-9d42-fe4826a93a82 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.170120 May 23 13:57:03.850189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1076/2068] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:03 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:03.901327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbe87d04-33d5-45e5-9987-405bc2161fda tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:03.909330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bbe87d04-33d5-45e5-9987-405bc2161fda tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154044 May 23 13:57:03.909898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 993/2069] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:03 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:04.463845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:04.464368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:04.471041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:04.471488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:04.472252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:04.472715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:04.758828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-43a2e3a9-30dd-4f71-8a43-9dd1519947e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:04.759391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-43a2e3a9-30dd-4f71-8a43-9dd1519947e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:04.766123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43a2e3a9-30dd-4f71-8a43-9dd1519947e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:04.766564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43a2e3a9-30dd-4f71-8a43-9dd1519947e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:04.767324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43a2e3a9-30dd-4f71-8a43-9dd1519947e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:04.767751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43a2e3a9-30dd-4f71-8a43-9dd1519947e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:04.854961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:04.863684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:04.865268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:04.866444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aec63305-48e3-4887-8403-17e3b8cb99de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.406796 May 23 13:57:04.867075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1077/2070] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:04 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:04.871573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f84a768f-0e8e-4748-9e4c-754ffbb40bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:04.872199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f84a768f-0e8e-4748-9e4c-754ffbb40bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:04.878159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f84a768f-0e8e-4748-9e4c-754ffbb40bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:04.878618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f84a768f-0e8e-4748-9e4c-754ffbb40bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:04.879400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f84a768f-0e8e-4748-9e4c-754ffbb40bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:04.879870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f84a768f-0e8e-4748-9e4c-754ffbb40bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:04.908139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43a2e3a9-30dd-4f71-8a43-9dd1519947e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:04.917408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-43a2e3a9-30dd-4f71-8a43-9dd1519947e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162632 May 23 13:57:04.918200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 994/2071] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:04 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:04.927452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7b7d3ee-2c30-4e41-9627-b1d4edd31b99 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:04.928080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7b7d3ee-2c30-4e41-9627-b1d4edd31b99 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:04.935032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7b7d3ee-2c30-4e41-9627-b1d4edd31b99 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:04.935486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7b7d3ee-2c30-4e41-9627-b1d4edd31b99 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:04.936291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7b7d3ee-2c30-4e41-9627-b1d4edd31b99 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:04.936782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7b7d3ee-2c30-4e41-9627-b1d4edd31b99 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:05.015128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f84a768f-0e8e-4748-9e4c-754ffbb40bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:05.023796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f84a768f-0e8e-4748-9e4c-754ffbb40bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155715 May 23 13:57:05.024918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1078/2072] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:04 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:05.069672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7b7d3ee-2c30-4e41-9627-b1d4edd31b99 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:05.078020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7b7d3ee-2c30-4e41-9627-b1d4edd31b99 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154887 May 23 13:57:05.078584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 995/2073] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:04 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:05.885434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:05.886059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:05.892697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:05.893154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:05.893919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:05.894359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:05.939267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e6f92206-0388-475b-b414-891c2c8527b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:05.940212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e6f92206-0388-475b-b414-891c2c8527b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:05.947573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6f92206-0388-475b-b414-891c2c8527b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:05.948020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6f92206-0388-475b-b414-891c2c8527b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:05.948821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6f92206-0388-475b-b414-891c2c8527b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:05.949261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6f92206-0388-475b-b414-891c2c8527b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:06.032270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:06.042749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:06.044279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:06.045523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-70de66f1-9739-47e1-8ae8-949fc250b12e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.164703 May 23 13:57:06.046084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1079/2074] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:05 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:06.050691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-967b83bf-4bd4-46e2-95b6-e01f690a9137 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:06.051317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-967b83bf-4bd4-46e2-95b6-e01f690a9137 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:06.059460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967b83bf-4bd4-46e2-95b6-e01f690a9137 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:06.059924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967b83bf-4bd4-46e2-95b6-e01f690a9137 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:06.060734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967b83bf-4bd4-46e2-95b6-e01f690a9137 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:06.061180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967b83bf-4bd4-46e2-95b6-e01f690a9137 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:06.091446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6f92206-0388-475b-b414-891c2c8527b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:06.099768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e6f92206-0388-475b-b414-891c2c8527b0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.164385 May 23 13:57:06.100491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 996/2075] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:05 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:06.106011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c08e636-f922-4354-8eba-739a429ed7ed tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:06.106695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c08e636-f922-4354-8eba-739a429ed7ed tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:06.112829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c08e636-f922-4354-8eba-739a429ed7ed tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:06.113380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c08e636-f922-4354-8eba-739a429ed7ed tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:06.114208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c08e636-f922-4354-8eba-739a429ed7ed tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:06.114643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c08e636-f922-4354-8eba-739a429ed7ed tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:06.197565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-967b83bf-4bd4-46e2-95b6-e01f690a9137 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:06.205720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-967b83bf-4bd4-46e2-95b6-e01f690a9137 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158652 May 23 13:57:06.206296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1080/2076] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:06 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:06.253290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c08e636-f922-4354-8eba-739a429ed7ed tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:06.261965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c08e636-f922-4354-8eba-739a429ed7ed tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159882 May 23 13:57:06.262543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 997/2077] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:06 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:07.064649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:07.065273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:07.072782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:07.073246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:07.074025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:07.074469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:07.121089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fddae9c9-8997-46d8-a5b6-ff4dce0279e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:07.121089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fddae9c9-8997-46d8-a5b6-ff4dce0279e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:07.127074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fddae9c9-8997-46d8-a5b6-ff4dce0279e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:07.127670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fddae9c9-8997-46d8-a5b6-ff4dce0279e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:07.128550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fddae9c9-8997-46d8-a5b6-ff4dce0279e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:07.129010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fddae9c9-8997-46d8-a5b6-ff4dce0279e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:07.221212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:07.230957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:07.232721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:07.234051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bfada965-74e9-417d-95ad-3735d9921b3b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.173482 May 23 13:57:07.234853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1081/2078] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:07 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:07.239339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77fa1ef4-41be-4f31-bf38-997c40e8c934 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:07.239952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-77fa1ef4-41be-4f31-bf38-997c40e8c934 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:07.246680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77fa1ef4-41be-4f31-bf38-997c40e8c934 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:07.247135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77fa1ef4-41be-4f31-bf38-997c40e8c934 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:07.247902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77fa1ef4-41be-4f31-bf38-997c40e8c934 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:07.248385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77fa1ef4-41be-4f31-bf38-997c40e8c934 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:07.277316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fddae9c9-8997-46d8-a5b6-ff4dce0279e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:07.285677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fddae9c9-8997-46d8-a5b6-ff4dce0279e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.171041 May 23 13:57:07.286266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 998/2079] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:07 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:07.291437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7724a03-23f0-462a-a965-a484f6c1239e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:07.292129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7724a03-23f0-462a-a965-a484f6c1239e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:07.298648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7724a03-23f0-462a-a965-a484f6c1239e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:07.299102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7724a03-23f0-462a-a965-a484f6c1239e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:07.299918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7724a03-23f0-462a-a965-a484f6c1239e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:07.300323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7724a03-23f0-462a-a965-a484f6c1239e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:07.390267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77fa1ef4-41be-4f31-bf38-997c40e8c934 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:07.399232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77fa1ef4-41be-4f31-bf38-997c40e8c934 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.163418 May 23 13:57:07.400047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1082/2080] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:07 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:07.433125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7724a03-23f0-462a-a965-a484f6c1239e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:07.441128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7724a03-23f0-462a-a965-a484f6c1239e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153615 May 23 13:57:07.441701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 999/2081] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:07 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:08.252422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:08.253080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:08.260267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:08.260758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:08.261534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:08.261984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:08.305156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1996e608-7e16-4d19-bab9-d6459e643d82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:08.305784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1996e608-7e16-4d19-bab9-d6459e643d82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:08.311967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1996e608-7e16-4d19-bab9-d6459e643d82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:08.312417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1996e608-7e16-4d19-bab9-d6459e643d82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:08.313223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1996e608-7e16-4d19-bab9-d6459e643d82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:08.313660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1996e608-7e16-4d19-bab9-d6459e643d82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:08.338562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:08.400677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:08.409054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:08.410686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:08.411878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b0b54d5-473a-4243-b79a-066ab7c5145d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163461 May 23 13:57:08.412435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1083/2082] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:08 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:08.417863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7a054392-6b38-45df-ade3-430ed5b46921 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:08.418486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7a054392-6b38-45df-ade3-430ed5b46921 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:08.425006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a054392-6b38-45df-ade3-430ed5b46921 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:08.425500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a054392-6b38-45df-ade3-430ed5b46921 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:08.426279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a054392-6b38-45df-ade3-430ed5b46921 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:08.426760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a054392-6b38-45df-ade3-430ed5b46921 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:08.452937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1996e608-7e16-4d19-bab9-d6459e643d82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:08.462401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1996e608-7e16-4d19-bab9-d6459e643d82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162311 May 23 13:57:08.462986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1000/2083] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:08 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:08.467627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5664b7d-be6d-4597-8483-559276692433 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:08.468181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5664b7d-be6d-4597-8483-559276692433 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:08.474399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5664b7d-be6d-4597-8483-559276692433 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:08.474844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5664b7d-be6d-4597-8483-559276692433 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:08.475604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5664b7d-be6d-4597-8483-559276692433 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:08.476688 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5664b7d-be6d-4597-8483-559276692433 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:08.563951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7a054392-6b38-45df-ade3-430ed5b46921 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:08.573355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7a054392-6b38-45df-ade3-430ed5b46921 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159838 May 23 13:57:08.574046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1084/2084] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:08 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:08.616143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5664b7d-be6d-4597-8483-559276692433 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:08.624711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5664b7d-be6d-4597-8483-559276692433 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160739 May 23 13:57:08.625288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1001/2085] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:08 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:09.430597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:09.431219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:09.438339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:09.438745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:09.439511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:09.439954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:09.482509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-54f2115c-2823-4835-8905-0f7691c28db2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:09.483350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-54f2115c-2823-4835-8905-0f7691c28db2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:09.491089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54f2115c-2823-4835-8905-0f7691c28db2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:09.492071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54f2115c-2823-4835-8905-0f7691c28db2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:09.492957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54f2115c-2823-4835-8905-0f7691c28db2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:09.493391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54f2115c-2823-4835-8905-0f7691c28db2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:09.576211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:09.585411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:09.587974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:09.589223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2e3b5302-95d0-4bb3-b25e-12606064bc65 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163249 May 23 13:57:09.590281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1085/2086] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:09 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:09.594491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-79521753-b988-4311-af14-97c22e7de70b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:09.595102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-79521753-b988-4311-af14-97c22e7de70b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:09.603098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79521753-b988-4311-af14-97c22e7de70b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:09.603693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79521753-b988-4311-af14-97c22e7de70b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:09.604555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79521753-b988-4311-af14-97c22e7de70b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:09.605164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79521753-b988-4311-af14-97c22e7de70b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:09.653852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-54f2115c-2823-4835-8905-0f7691c28db2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:09.662183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-54f2115c-2823-4835-8905-0f7691c28db2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.186261 May 23 13:57:09.662964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1002/2087] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:09 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:09.667893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6550a1a2-860f-4243-a495-edfbe15b2367 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:09.668499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6550a1a2-860f-4243-a495-edfbe15b2367 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:09.674612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6550a1a2-860f-4243-a495-edfbe15b2367 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:09.675066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6550a1a2-860f-4243-a495-edfbe15b2367 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:09.676038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6550a1a2-860f-4243-a495-edfbe15b2367 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:09.676475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6550a1a2-860f-4243-a495-edfbe15b2367 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:09.763663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-79521753-b988-4311-af14-97c22e7de70b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:09.771900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-79521753-b988-4311-af14-97c22e7de70b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.180871 May 23 13:57:09.772481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1086/2088] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:09 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:09.815489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6550a1a2-860f-4243-a495-edfbe15b2367 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:09.823860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6550a1a2-860f-4243-a495-edfbe15b2367 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159594 May 23 13:57:09.824431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1003/2089] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:09 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:10.614496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:10.615122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:10.622475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:10.622927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:10.623702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:10.624188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:10.685978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-69903127-5e8b-40c9-9354-d6b977461319 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:10.686616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-69903127-5e8b-40c9-9354-d6b977461319 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:10.693371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69903127-5e8b-40c9-9354-d6b977461319 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:10.693824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69903127-5e8b-40c9-9354-d6b977461319 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:10.695191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69903127-5e8b-40c9-9354-d6b977461319 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:10.695632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69903127-5e8b-40c9-9354-d6b977461319 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:10.761739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:10.771144 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:10.772583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:10.773883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8bc70cab-bbd2-46ed-b876-85c6a58d68e7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163403 May 23 13:57:10.774451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1087/2090] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:10 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:10.791275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-60e995a6-35b9-4d65-92b3-369980bb8710 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:10.791898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-60e995a6-35b9-4d65-92b3-369980bb8710 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:10.798028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60e995a6-35b9-4d65-92b3-369980bb8710 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:10.799103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60e995a6-35b9-4d65-92b3-369980bb8710 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:10.799716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60e995a6-35b9-4d65-92b3-369980bb8710 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:10.800156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60e995a6-35b9-4d65-92b3-369980bb8710 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:10.830779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-69903127-5e8b-40c9-9354-d6b977461319 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:10.839758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-69903127-5e8b-40c9-9354-d6b977461319 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157312 May 23 13:57:10.840263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1004/2091] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:10 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:10.845228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f9d5a275-812f-4645-a426-de9371c8abfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:10.845844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f9d5a275-812f-4645-a426-de9371c8abfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:10.852051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9d5a275-812f-4645-a426-de9371c8abfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:10.852496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9d5a275-812f-4645-a426-de9371c8abfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:10.853326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9d5a275-812f-4645-a426-de9371c8abfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:10.853910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9d5a275-812f-4645-a426-de9371c8abfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:10.934455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-60e995a6-35b9-4d65-92b3-369980bb8710 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:10.943050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-60e995a6-35b9-4d65-92b3-369980bb8710 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155694 May 23 13:57:10.943636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1088/2092] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:10 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:10.988838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f9d5a275-812f-4645-a426-de9371c8abfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:10.998050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f9d5a275-812f-4645-a426-de9371c8abfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156722 May 23 13:57:10.998670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1005/2093] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:10 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:11.795239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:11.795891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:11.802976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:11.803430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:11.804245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:11.804711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:11.857348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ef0c559-d922-4de1-9c75-a96f125c55db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:11.858056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ef0c559-d922-4de1-9c75-a96f125c55db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:11.864738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ef0c559-d922-4de1-9c75-a96f125c55db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:11.865265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ef0c559-d922-4de1-9c75-a96f125c55db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:11.866099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ef0c559-d922-4de1-9c75-a96f125c55db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:11.867149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ef0c559-d922-4de1-9c75-a96f125c55db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:11.942536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:11.952135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:11.953701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:11.954871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0edc7d24-ff66-465e-bfde-9006d0f8206c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.167174 May 23 13:57:11.957068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1089/2094] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:11.962595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-00dfbc75-da00-4d53-b536-f647883fcd28 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:11.963222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-00dfbc75-da00-4d53-b536-f647883fcd28 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:11.969793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00dfbc75-da00-4d53-b536-f647883fcd28 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:11.969984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00dfbc75-da00-4d53-b536-f647883fcd28 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:11.970663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00dfbc75-da00-4d53-b536-f647883fcd28 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:11.971104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00dfbc75-da00-4d53-b536-f647883fcd28 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:12.009614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ef0c559-d922-4de1-9c75-a96f125c55db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:12.018865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ef0c559-d922-4de1-9c75-a96f125c55db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165323 May 23 13:57:12.020093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1006/2095] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:11 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:12.024203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d4c5850-7850-4ce3-a3e1-b2467606a8ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:12.024849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d4c5850-7850-4ce3-a3e1-b2467606a8ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:12.032478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d4c5850-7850-4ce3-a3e1-b2467606a8ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:12.032957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d4c5850-7850-4ce3-a3e1-b2467606a8ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:12.033757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d4c5850-7850-4ce3-a3e1-b2467606a8ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:12.034281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d4c5850-7850-4ce3-a3e1-b2467606a8ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:12.109150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-00dfbc75-da00-4d53-b536-f647883fcd28 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:12.117999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-00dfbc75-da00-4d53-b536-f647883fcd28 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159712 May 23 13:57:12.118589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1090/2096] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:11 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:12.166196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d4c5850-7850-4ce3-a3e1-b2467606a8ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:12.174200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d4c5850-7850-4ce3-a3e1-b2467606a8ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153781 May 23 13:57:12.174774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1007/2097] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:12 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:12.973537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:12.974139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:12.981527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:12.981979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:12.982751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:12.983196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:13.040209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aab533c4-a14e-48cf-9d88-b1084942755a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:13.040873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aab533c4-a14e-48cf-9d88-b1084942755a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:13.047911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aab533c4-a14e-48cf-9d88-b1084942755a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:13.048402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aab533c4-a14e-48cf-9d88-b1084942755a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:13.049196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aab533c4-a14e-48cf-9d88-b1084942755a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:13.049622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aab533c4-a14e-48cf-9d88-b1084942755a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:13.121138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:13.129647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:13.131585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:13.132933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97cfb4d5-ee89-47dc-b540-1c591d353657 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163286 May 23 13:57:13.133530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1091/2098] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:13.138633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f0c5f9e-f61a-4bea-a480-50ce63784bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:13.139239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f0c5f9e-f61a-4bea-a480-50ce63784bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:13.149622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f0c5f9e-f61a-4bea-a480-50ce63784bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:13.150061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f0c5f9e-f61a-4bea-a480-50ce63784bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:13.150827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f0c5f9e-f61a-4bea-a480-50ce63784bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:13.151260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f0c5f9e-f61a-4bea-a480-50ce63784bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:13.191557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aab533c4-a14e-48cf-9d88-b1084942755a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:13.200201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aab533c4-a14e-48cf-9d88-b1084942755a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.166131 May 23 13:57:13.200807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1008/2099] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:13 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:13.205330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ee19874a-da44-4951-9cde-02dc3eac5ed8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:13.206088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ee19874a-da44-4951-9cde-02dc3eac5ed8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:13.212892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee19874a-da44-4951-9cde-02dc3eac5ed8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:13.213341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee19874a-da44-4951-9cde-02dc3eac5ed8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:13.214108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee19874a-da44-4951-9cde-02dc3eac5ed8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:13.214558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ee19874a-da44-4951-9cde-02dc3eac5ed8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:13.283928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f0c5f9e-f61a-4bea-a480-50ce63784bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:13.287411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:13.294051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f0c5f9e-f61a-4bea-a480-50ce63784bcf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159416 May 23 13:57:13.294525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1092/2100] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:13 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:13.346461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ee19874a-da44-4951-9cde-02dc3eac5ed8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:13.355007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ee19874a-da44-4951-9cde-02dc3eac5ed8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153231 May 23 13:57:13.355566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1009/2101] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:13 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:14.151905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:14.152550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:14.159421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:14.159873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:14.160672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:14.161114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:14.217678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-11d83b68-e218-432f-88c5-19b17b2172cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:14.218375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-11d83b68-e218-432f-88c5-19b17b2172cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:14.224879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11d83b68-e218-432f-88c5-19b17b2172cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:14.225356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11d83b68-e218-432f-88c5-19b17b2172cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:14.226349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11d83b68-e218-432f-88c5-19b17b2172cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:14.226776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11d83b68-e218-432f-88c5-19b17b2172cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:14.295354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:14.303866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:14.305596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:14.306766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-179e6c75-36b9-48ef-9f9d-2c5c79687160 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159512 May 23 13:57:14.307325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1093/2102] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:14 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:14.327321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10fcede9-5e56-4c2b-8549-a29c54ed0241 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:14.327948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10fcede9-5e56-4c2b-8549-a29c54ed0241 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:14.334208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10fcede9-5e56-4c2b-8549-a29c54ed0241 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:14.334657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10fcede9-5e56-4c2b-8549-a29c54ed0241 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:14.335999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10fcede9-5e56-4c2b-8549-a29c54ed0241 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:14.336431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10fcede9-5e56-4c2b-8549-a29c54ed0241 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:14.369304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-11d83b68-e218-432f-88c5-19b17b2172cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:14.377651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-11d83b68-e218-432f-88c5-19b17b2172cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163818 May 23 13:57:14.378330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1010/2103] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:14 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:14.383612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c46ceeb-64a2-4b2d-bdc7-816dadb5b288 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:14.384288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c46ceeb-64a2-4b2d-bdc7-816dadb5b288 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:14.390951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c46ceeb-64a2-4b2d-bdc7-816dadb5b288 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:14.391511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c46ceeb-64a2-4b2d-bdc7-816dadb5b288 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:14.392233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c46ceeb-64a2-4b2d-bdc7-816dadb5b288 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:14.392707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c46ceeb-64a2-4b2d-bdc7-816dadb5b288 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:14.478913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10fcede9-5e56-4c2b-8549-a29c54ed0241 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:14.488382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10fcede9-5e56-4c2b-8549-a29c54ed0241 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.169484 May 23 13:57:14.489005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1094/2104] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:14 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:14.528426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3c46ceeb-64a2-4b2d-bdc7-816dadb5b288 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:14.536684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3c46ceeb-64a2-4b2d-bdc7-816dadb5b288 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.157322 May 23 13:57:14.537249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1011/2105] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:14 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:15.325646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:15.326267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:15.332502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:15.332993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:15.333796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:15.334243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:15.398157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-919fec50-d27a-4ff1-8896-b7e94382830e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:15.398768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-919fec50-d27a-4ff1-8896-b7e94382830e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:15.405565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-919fec50-d27a-4ff1-8896-b7e94382830e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:15.408749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-919fec50-d27a-4ff1-8896-b7e94382830e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:15.408749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-919fec50-d27a-4ff1-8896-b7e94382830e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:15.408749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-919fec50-d27a-4ff1-8896-b7e94382830e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:15.471724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:15.481091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:15.482631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:15.483819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e31406c-d2b2-4042-92f0-86bcc9382d2a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.162161 May 23 13:57:15.484390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1095/2106] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:15 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:15.506482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02c4149a-ac42-42b0-8f53-f939de3cb71a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:15.507766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02c4149a-ac42-42b0-8f53-f939de3cb71a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:15.513863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02c4149a-ac42-42b0-8f53-f939de3cb71a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:15.514340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02c4149a-ac42-42b0-8f53-f939de3cb71a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:15.515103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02c4149a-ac42-42b0-8f53-f939de3cb71a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:15.515612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02c4149a-ac42-42b0-8f53-f939de3cb71a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:15.548449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-919fec50-d27a-4ff1-8896-b7e94382830e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:15.558587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-919fec50-d27a-4ff1-8896-b7e94382830e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165129 May 23 13:57:15.559506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1012/2107] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:15 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:15.564962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d1f9109-5a12-4778-bbb9-d36cb7d396a0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:15.565722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d1f9109-5a12-4778-bbb9-d36cb7d396a0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:15.574712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d1f9109-5a12-4778-bbb9-d36cb7d396a0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:15.575302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d1f9109-5a12-4778-bbb9-d36cb7d396a0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:15.576124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d1f9109-5a12-4778-bbb9-d36cb7d396a0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:15.576594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d1f9109-5a12-4778-bbb9-d36cb7d396a0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:15.666022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02c4149a-ac42-42b0-8f53-f939de3cb71a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:15.674603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02c4149a-ac42-42b0-8f53-f939de3cb71a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.172241 May 23 13:57:15.675287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1096/2108] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:15 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:15.718705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d1f9109-5a12-4778-bbb9-d36cb7d396a0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:15.726957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d1f9109-5a12-4778-bbb9-d36cb7d396a0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.166429 May 23 13:57:15.727533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1013/2109] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:15 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:16.502634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:16.503193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:16.509627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:16.510076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:16.510828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:16.511260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:16.576642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b6feb466-d40f-4460-8446-f922abb1f560 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:16.577343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b6feb466-d40f-4460-8446-f922abb1f560 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:16.583964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6feb466-d40f-4460-8446-f922abb1f560 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:16.584410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6feb466-d40f-4460-8446-f922abb1f560 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:16.585893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6feb466-d40f-4460-8446-f922abb1f560 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:16.586327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6feb466-d40f-4460-8446-f922abb1f560 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:16.647562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:16.656639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:16.658146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:16.659339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0377c50f-ec34-4dc6-8ee5-ffa79314911e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.160731 May 23 13:57:16.660620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1097/2110] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:16.693533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c28154a-a9d3-4cab-8f52-0764fde58e1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:16.694194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c28154a-a9d3-4cab-8f52-0764fde58e1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:16.701368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c28154a-a9d3-4cab-8f52-0764fde58e1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:16.701825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c28154a-a9d3-4cab-8f52-0764fde58e1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:16.702638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c28154a-a9d3-4cab-8f52-0764fde58e1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:16.703082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c28154a-a9d3-4cab-8f52-0764fde58e1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:16.728057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6feb466-d40f-4460-8446-f922abb1f560 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:16.738274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b6feb466-d40f-4460-8446-f922abb1f560 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165339 May 23 13:57:16.738865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1014/2111] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:16 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:16.743997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1921d4a7-6fd6-4de3-b880-a7650321797a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:16.744727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1921d4a7-6fd6-4de3-b880-a7650321797a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:16.751465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1921d4a7-6fd6-4de3-b880-a7650321797a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:16.752055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1921d4a7-6fd6-4de3-b880-a7650321797a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:16.752917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1921d4a7-6fd6-4de3-b880-a7650321797a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:16.753309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1921d4a7-6fd6-4de3-b880-a7650321797a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:16.842090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c28154a-a9d3-4cab-8f52-0764fde58e1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:16.851292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c28154a-a9d3-4cab-8f52-0764fde58e1b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161256 May 23 13:57:16.851897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1098/2112] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:16 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:16.889956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1921d4a7-6fd6-4de3-b880-a7650321797a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:16.898193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1921d4a7-6fd6-4de3-b880-a7650321797a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158351 May 23 13:57:16.901841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1015/2113] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:16 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:17.679475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:17.680247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:17.686927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:17.687383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:17.688196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:17.688671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:17.755800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5e815ea5-ce17-4a3c-8f03-a17cc55d9916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:17.757090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5e815ea5-ce17-4a3c-8f03-a17cc55d9916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:17.763691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e815ea5-ce17-4a3c-8f03-a17cc55d9916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:17.764135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e815ea5-ce17-4a3c-8f03-a17cc55d9916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:17.764926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e815ea5-ce17-4a3c-8f03-a17cc55d9916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:17.765363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e815ea5-ce17-4a3c-8f03-a17cc55d9916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:17.826903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:17.841375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:17.842910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:17.844105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c1d59db6-3090-44b3-878d-f251e65ffa85 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.168985 May 23 13:57:17.844681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1099/2114] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:17.869075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6b3c57cb-1658-4db3-bb55-da111aa11bf8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:17.869783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6b3c57cb-1658-4db3-bb55-da111aa11bf8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:17.875907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b3c57cb-1658-4db3-bb55-da111aa11bf8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:17.876430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b3c57cb-1658-4db3-bb55-da111aa11bf8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:17.877222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b3c57cb-1658-4db3-bb55-da111aa11bf8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:17.877661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b3c57cb-1658-4db3-bb55-da111aa11bf8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:17.904739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e815ea5-ce17-4a3c-8f03-a17cc55d9916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:17.914507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5e815ea5-ce17-4a3c-8f03-a17cc55d9916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162579 May 23 13:57:17.915081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1016/2115] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:17 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:17.919998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e16d2648-623b-4af3-a97a-4ec3911ca29d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:17.920793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e16d2648-623b-4af3-a97a-4ec3911ca29d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:17.926850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e16d2648-623b-4af3-a97a-4ec3911ca29d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:17.927298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e16d2648-623b-4af3-a97a-4ec3911ca29d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:17.928129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e16d2648-623b-4af3-a97a-4ec3911ca29d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:17.929319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e16d2648-623b-4af3-a97a-4ec3911ca29d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:17.933790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:18.018386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6b3c57cb-1658-4db3-bb55-da111aa11bf8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:18.026850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6b3c57cb-1658-4db3-bb55-da111aa11bf8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.162393 May 23 13:57:18.027435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1100/2116] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:17 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:18.060176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e16d2648-623b-4af3-a97a-4ec3911ca29d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:18.068260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e16d2648-623b-4af3-a97a-4ec3911ca29d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152237 May 23 13:57:18.068876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1017/2117] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:17 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:18.862246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:18.862848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:18.870467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:18.870912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:18.871672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:18.872104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:18.931980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-42360b51-1f85-49da-8079-2e4ac61f424c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:18.932620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-42360b51-1f85-49da-8079-2e4ac61f424c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:18.939176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42360b51-1f85-49da-8079-2e4ac61f424c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:18.939630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42360b51-1f85-49da-8079-2e4ac61f424c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:18.940407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42360b51-1f85-49da-8079-2e4ac61f424c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:18.940868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42360b51-1f85-49da-8079-2e4ac61f424c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:19.010835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:19.019549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:19.021087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:19.022344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1d0fc81b-713f-4781-88b7-567b84a37f55 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.164078 May 23 13:57:19.022918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1101/2118] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:18 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:19.043261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-83e37c98-5fd3-4d4c-9a1b-c902e6a5e88b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:19.043883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-83e37c98-5fd3-4d4c-9a1b-c902e6a5e88b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:19.049974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e37c98-5fd3-4d4c-9a1b-c902e6a5e88b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:19.050441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e37c98-5fd3-4d4c-9a1b-c902e6a5e88b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:19.051231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e37c98-5fd3-4d4c-9a1b-c902e6a5e88b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:19.051675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-83e37c98-5fd3-4d4c-9a1b-c902e6a5e88b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:19.079925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-42360b51-1f85-49da-8079-2e4ac61f424c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:19.088417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-42360b51-1f85-49da-8079-2e4ac61f424c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160935 May 23 13:57:19.089041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1018/2119] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:18 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:19.093643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef912a89-54b2-4b89-8098-314d2d68fc44 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:19.094173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ef912a89-54b2-4b89-8098-314d2d68fc44 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:19.100268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef912a89-54b2-4b89-8098-314d2d68fc44 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:19.107938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef912a89-54b2-4b89-8098-314d2d68fc44 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:19.107938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef912a89-54b2-4b89-8098-314d2d68fc44 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:19.107938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef912a89-54b2-4b89-8098-314d2d68fc44 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:19.188355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-83e37c98-5fd3-4d4c-9a1b-c902e6a5e88b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:19.197353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-83e37c98-5fd3-4d4c-9a1b-c902e6a5e88b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.157976 May 23 13:57:19.197941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1102/2120] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:19 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:19.234565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ef912a89-54b2-4b89-8098-314d2d68fc44 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:19.243385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef912a89-54b2-4b89-8098-314d2d68fc44 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153365 May 23 13:57:19.243960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1019/2121] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:19 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:20.041009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:20.041677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:20.043936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:20.048658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:20.049112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:20.049867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:20.050301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:20.106578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06a186b0-b5ba-4e03-941d-6038bf26fc3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:20.107223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06a186b0-b5ba-4e03-941d-6038bf26fc3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:20.110681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:20.114150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06a186b0-b5ba-4e03-941d-6038bf26fc3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:20.114593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06a186b0-b5ba-4e03-941d-6038bf26fc3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:20.115347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06a186b0-b5ba-4e03-941d-6038bf26fc3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:20.115858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06a186b0-b5ba-4e03-941d-6038bf26fc3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:20.187696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:20.197752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:20.199520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:20.200734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-82f5b004-5abb-4861-b06b-b5fc84029921 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163663 May 23 13:57:20.201290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1103/2122] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:20.215589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01799f47-3e58-4f3f-bc7f-723d9790745e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:20.216213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-01799f47-3e58-4f3f-bc7f-723d9790745e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:20.222226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01799f47-3e58-4f3f-bc7f-723d9790745e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:20.222678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01799f47-3e58-4f3f-bc7f-723d9790745e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:20.223450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01799f47-3e58-4f3f-bc7f-723d9790745e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:20.223890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01799f47-3e58-4f3f-bc7f-723d9790745e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:20.258100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06a186b0-b5ba-4e03-941d-6038bf26fc3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:20.266591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06a186b0-b5ba-4e03-941d-6038bf26fc3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163829 May 23 13:57:20.267353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1020/2123] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:20 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:20.271939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d2f7d994-141b-4d95-8fa2-ef1e8da0efbb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:20.273373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d2f7d994-141b-4d95-8fa2-ef1e8da0efbb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:20.279775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2f7d994-141b-4d95-8fa2-ef1e8da0efbb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:20.280224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2f7d994-141b-4d95-8fa2-ef1e8da0efbb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:20.281018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2f7d994-141b-4d95-8fa2-ef1e8da0efbb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:20.281461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2f7d994-141b-4d95-8fa2-ef1e8da0efbb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:20.362846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-01799f47-3e58-4f3f-bc7f-723d9790745e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:20.370977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01799f47-3e58-4f3f-bc7f-723d9790745e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159126 May 23 13:57:20.371562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1104/2124] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:20 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:20.413402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d2f7d994-141b-4d95-8fa2-ef1e8da0efbb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:20.421553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d2f7d994-141b-4d95-8fa2-ef1e8da0efbb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153170 May 23 13:57:20.422121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1021/2125] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:20 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:21.219935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:21.220546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:21.228201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:21.229817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:21.229817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:21.229817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:21.284117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a3cb3f24-01a8-47d0-87c0-d04f39239e09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:21.284780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a3cb3f24-01a8-47d0-87c0-d04f39239e09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:21.293057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3cb3f24-01a8-47d0-87c0-d04f39239e09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:21.293514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3cb3f24-01a8-47d0-87c0-d04f39239e09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:21.294288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3cb3f24-01a8-47d0-87c0-d04f39239e09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:21.294736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3cb3f24-01a8-47d0-87c0-d04f39239e09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:21.365953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:21.374944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:21.376439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:21.377663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15e293a1-b71b-4903-9eb4-d93a5f68b661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.161738 May 23 13:57:21.378401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1105/2126] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:21 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:21.393038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5c8f2f8a-7650-40fb-b59e-8744994bd06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:21.393664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5c8f2f8a-7650-40fb-b59e-8744994bd06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:21.400477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c8f2f8a-7650-40fb-b59e-8744994bd06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:21.400970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c8f2f8a-7650-40fb-b59e-8744994bd06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:21.401760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c8f2f8a-7650-40fb-b59e-8744994bd06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:21.402261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c8f2f8a-7650-40fb-b59e-8744994bd06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:21.440494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a3cb3f24-01a8-47d0-87c0-d04f39239e09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:21.449637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a3cb3f24-01a8-47d0-87c0-d04f39239e09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.169413 May 23 13:57:21.450224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1022/2127] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:21 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:21.455065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db3403d9-8205-46bd-a16a-a2f4634fdf3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:21.455666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db3403d9-8205-46bd-a16a-a2f4634fdf3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:21.463187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db3403d9-8205-46bd-a16a-a2f4634fdf3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:21.463634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db3403d9-8205-46bd-a16a-a2f4634fdf3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:21.464412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db3403d9-8205-46bd-a16a-a2f4634fdf3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:21.464893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db3403d9-8205-46bd-a16a-a2f4634fdf3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:21.545210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5c8f2f8a-7650-40fb-b59e-8744994bd06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:21.554160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5c8f2f8a-7650-40fb-b59e-8744994bd06d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165707 May 23 13:57:21.554742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1106/2128] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:21 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:21.603741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db3403d9-8205-46bd-a16a-a2f4634fdf3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:21.612366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db3403d9-8205-46bd-a16a-a2f4634fdf3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161110 May 23 13:57:21.612973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1023/2129] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:21 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:22.396297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:22.397771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:22.404960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:22.405332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:22.406103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:22.406534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:22.467543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae6d7adf-c0a9-4b7e-8441-efa08418cda0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:22.468269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae6d7adf-c0a9-4b7e-8441-efa08418cda0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:22.475259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae6d7adf-c0a9-4b7e-8441-efa08418cda0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:22.475707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae6d7adf-c0a9-4b7e-8441-efa08418cda0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:22.476485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae6d7adf-c0a9-4b7e-8441-efa08418cda0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:22.477049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae6d7adf-c0a9-4b7e-8441-efa08418cda0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:22.547137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:22.557181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:22.558867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:22.560166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-69f85b4f-1d67-4ba7-9377-fc7c5abca4d7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.167904 May 23 13:57:22.560761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1107/2130] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:22 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:22.574870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8bc3a858-a0b6-49a3-8d54-bfe0f25531b4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:22.575498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8bc3a858-a0b6-49a3-8d54-bfe0f25531b4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:22.581778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bc3a858-a0b6-49a3-8d54-bfe0f25531b4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:22.582233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bc3a858-a0b6-49a3-8d54-bfe0f25531b4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:22.583015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bc3a858-a0b6-49a3-8d54-bfe0f25531b4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:22.583454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bc3a858-a0b6-49a3-8d54-bfe0f25531b4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:22.625771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae6d7adf-c0a9-4b7e-8441-efa08418cda0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:22.636210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae6d7adf-c0a9-4b7e-8441-efa08418cda0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.172644 May 23 13:57:22.636830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1024/2131] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:22 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:22.641558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7cd8051e-80a0-491a-b0da-9f1ba4be4e17 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:22.642168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7cd8051e-80a0-491a-b0da-9f1ba4be4e17 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:22.649198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cd8051e-80a0-491a-b0da-9f1ba4be4e17 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:22.649741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cd8051e-80a0-491a-b0da-9f1ba4be4e17 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:22.650431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cd8051e-80a0-491a-b0da-9f1ba4be4e17 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:22.650868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cd8051e-80a0-491a-b0da-9f1ba4be4e17 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:22.739954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8bc3a858-a0b6-49a3-8d54-bfe0f25531b4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:22.749696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8bc3a858-a0b6-49a3-8d54-bfe0f25531b4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.178977 May 23 13:57:22.750296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1108/2132] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:22 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:23.069171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7cd8051e-80a0-491a-b0da-9f1ba4be4e17 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:23.079731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7cd8051e-80a0-491a-b0da-9f1ba4be4e17 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.439944 May 23 13:57:23.079731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1025/2133] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:22 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:23.578556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:23.579415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:23.586770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:23.587221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:23.587986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:23.588422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:23.609670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:23.654130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eeaba138-b4bb-4713-b3f7-b06fa6964d66 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:23.654769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eeaba138-b4bb-4713-b3f7-b06fa6964d66 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:23.661912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeaba138-b4bb-4713-b3f7-b06fa6964d66 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:23.662387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeaba138-b4bb-4713-b3f7-b06fa6964d66 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:23.663715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeaba138-b4bb-4713-b3f7-b06fa6964d66 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:23.664154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eeaba138-b4bb-4713-b3f7-b06fa6964d66 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:23.734379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:23.744209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:23.745769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:23.746964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9074fa92-6552-4a70-b19b-30a07220cefa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.172384 May 23 13:57:23.747705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1109/2134] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:23.767070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-24e4d2b8-6a10-4fd7-91b3-a9585ed2046c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:23.767733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-24e4d2b8-6a10-4fd7-91b3-a9585ed2046c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:23.774869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24e4d2b8-6a10-4fd7-91b3-a9585ed2046c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:23.775320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24e4d2b8-6a10-4fd7-91b3-a9585ed2046c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:23.776094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24e4d2b8-6a10-4fd7-91b3-a9585ed2046c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:23.776532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24e4d2b8-6a10-4fd7-91b3-a9585ed2046c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:23.811753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eeaba138-b4bb-4713-b3f7-b06fa6964d66 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:23.821945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eeaba138-b4bb-4713-b3f7-b06fa6964d66 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.171806 May 23 13:57:23.822722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1026/2135] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:23 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:23.926594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-24e4d2b8-6a10-4fd7-91b3-a9585ed2046c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:23.934763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-24e4d2b8-6a10-4fd7-91b3-a9585ed2046c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.171444 May 23 13:57:23.935342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1110/2136] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:23 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:24.095297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-152c656d-5d5f-4c7c-9193-1f92a50bbbd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:24.095827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-152c656d-5d5f-4c7c-9193-1f92a50bbbd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:24.101877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152c656d-5d5f-4c7c-9193-1f92a50bbbd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:24.102327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152c656d-5d5f-4c7c-9193-1f92a50bbbd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:24.103080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152c656d-5d5f-4c7c-9193-1f92a50bbbd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:24.103516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152c656d-5d5f-4c7c-9193-1f92a50bbbd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:24.241382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-152c656d-5d5f-4c7c-9193-1f92a50bbbd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:24.243987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-152c656d-5d5f-4c7c-9193-1f92a50bbbd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152688 May 23 13:57:24.244586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1027/2137] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:24 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:24.765336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:24.765956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:24.773366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:24.773822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:24.774594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:24.775035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:24.841699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34afbf4f-16fb-4c93-8209-59bdf08f3c9f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:24.842375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-34afbf4f-16fb-4c93-8209-59bdf08f3c9f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:24.848850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34afbf4f-16fb-4c93-8209-59bdf08f3c9f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:24.849299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34afbf4f-16fb-4c93-8209-59bdf08f3c9f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:24.851920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34afbf4f-16fb-4c93-8209-59bdf08f3c9f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:24.851920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34afbf4f-16fb-4c93-8209-59bdf08f3c9f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:24.908623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:24.918970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:24.920510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:24.921732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5b9835de-adb3-4732-89b7-bf46161a60dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.160354 May 23 13:57:24.924630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1111/2138] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:24 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:24.953542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e91bf394-fdcd-48df-8bfe-5c91b5a16f77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:24.954165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e91bf394-fdcd-48df-8bfe-5c91b5a16f77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:24.960411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e91bf394-fdcd-48df-8bfe-5c91b5a16f77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:24.963137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e91bf394-fdcd-48df-8bfe-5c91b5a16f77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:24.963137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e91bf394-fdcd-48df-8bfe-5c91b5a16f77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:24.963137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e91bf394-fdcd-48df-8bfe-5c91b5a16f77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:25.001382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34afbf4f-16fb-4c93-8209-59bdf08f3c9f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:25.006180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34afbf4f-16fb-4c93-8209-59bdf08f3c9f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.168217 May 23 13:57:25.007753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1028/2139] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:24 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:25.127325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e91bf394-fdcd-48df-8bfe-5c91b5a16f77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:25.136779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e91bf394-fdcd-48df-8bfe-5c91b5a16f77 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.188145 May 23 13:57:25.137376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1112/2140] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:24 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:25.261700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-70ab34a2-7a0f-44ce-b0cd-3361120720e9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:25.262239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-70ab34a2-7a0f-44ce-b0cd-3361120720e9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:25.268406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70ab34a2-7a0f-44ce-b0cd-3361120720e9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:25.268892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70ab34a2-7a0f-44ce-b0cd-3361120720e9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:25.269661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70ab34a2-7a0f-44ce-b0cd-3361120720e9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:25.270159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70ab34a2-7a0f-44ce-b0cd-3361120720e9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:25.415888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-70ab34a2-7a0f-44ce-b0cd-3361120720e9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:25.424220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-70ab34a2-7a0f-44ce-b0cd-3361120720e9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.166466 May 23 13:57:25.424983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1029/2141] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:25 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:25.940922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:25.941583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:25.949207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:25.949657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:25.950433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:25.950881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:26.026291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9c229e2-fc1f-43f3-a5e3-ed1e511bea77 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:26.027437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9c229e2-fc1f-43f3-a5e3-ed1e511bea77 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:26.034753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9c229e2-fc1f-43f3-a5e3-ed1e511bea77 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:26.035203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9c229e2-fc1f-43f3-a5e3-ed1e511bea77 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:26.036059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9c229e2-fc1f-43f3-a5e3-ed1e511bea77 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:26.036500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9c229e2-fc1f-43f3-a5e3-ed1e511bea77 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:26.091101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:26.101968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:26.103545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:26.104812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77dd7f6d-0c06-44c2-9d62-6df04aca0d1f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.167839 May 23 13:57:26.105579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1113/2142] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:26.154166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-90853615-6852-4eed-9339-c94e7f500411 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:26.154793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-90853615-6852-4eed-9339-c94e7f500411 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:26.160949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90853615-6852-4eed-9339-c94e7f500411 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:26.161395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90853615-6852-4eed-9339-c94e7f500411 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:26.162719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90853615-6852-4eed-9339-c94e7f500411 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:26.163141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90853615-6852-4eed-9339-c94e7f500411 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:26.194372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9c229e2-fc1f-43f3-a5e3-ed1e511bea77 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:26.201160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9c229e2-fc1f-43f3-a5e3-ed1e511bea77 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.180264 May 23 13:57:26.205930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1030/2143] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:26 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:26.314336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-90853615-6852-4eed-9339-c94e7f500411 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:26.322713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-90853615-6852-4eed-9339-c94e7f500411 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.172502 May 23 13:57:26.323283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1114/2144] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:26 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:26.442672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8733b1ab-c3d0-4c79-b024-b812d4f15e7d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:26.443312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8733b1ab-c3d0-4c79-b024-b812d4f15e7d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:26.449620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8733b1ab-c3d0-4c79-b024-b812d4f15e7d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:26.450060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8733b1ab-c3d0-4c79-b024-b812d4f15e7d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:26.450953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8733b1ab-c3d0-4c79-b024-b812d4f15e7d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:26.451382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8733b1ab-c3d0-4c79-b024-b812d4f15e7d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:26.583365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8733b1ab-c3d0-4c79-b024-b812d4f15e7d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:26.592795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8733b1ab-c3d0-4c79-b024-b812d4f15e7d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153903 May 23 13:57:26.593776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1031/2145] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:26 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:27.124015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:27.124652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:27.131964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:27.132416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:27.133208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:27.133715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:27.222219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cdf720ed-b3c8-47db-8525-1a8e9e269cea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:27.222834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cdf720ed-b3c8-47db-8525-1a8e9e269cea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:27.229867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdf720ed-b3c8-47db-8525-1a8e9e269cea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:27.230323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdf720ed-b3c8-47db-8525-1a8e9e269cea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:27.231095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdf720ed-b3c8-47db-8525-1a8e9e269cea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:27.231525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdf720ed-b3c8-47db-8525-1a8e9e269cea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:27.270966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:27.280013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:27.281543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:27.282721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2afd649b-d541-4cb0-9967-7bd225555ca2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.162660 May 23 13:57:27.283485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1115/2146] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:27.339811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f9d9724-5255-4884-9d89-be02f5e2b80c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:27.340494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f9d9724-5255-4884-9d89-be02f5e2b80c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:27.346714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f9d9724-5255-4884-9d89-be02f5e2b80c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:27.347159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f9d9724-5255-4884-9d89-be02f5e2b80c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:27.347927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f9d9724-5255-4884-9d89-be02f5e2b80c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:27.348366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f9d9724-5255-4884-9d89-be02f5e2b80c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:27.371969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cdf720ed-b3c8-47db-8525-1a8e9e269cea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:27.380255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cdf720ed-b3c8-47db-8525-1a8e9e269cea tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161758 May 23 13:57:27.380761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1032/2147] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:27 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:27.504484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f9d9724-5255-4884-9d89-be02f5e2b80c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:27.513563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f9d9724-5255-4884-9d89-be02f5e2b80c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.177708 May 23 13:57:27.514135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1116/2148] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:27 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:27.611703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e4b8128-9786-4000-a9c0-c511d708a9e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:27.619871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1e4b8128-9786-4000-a9c0-c511d708a9e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:27.620354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e4b8128-9786-4000-a9c0-c511d708a9e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:27.620855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e4b8128-9786-4000-a9c0-c511d708a9e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:27.621653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e4b8128-9786-4000-a9c0-c511d708a9e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:27.622097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e4b8128-9786-4000-a9c0-c511d708a9e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:27.785700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1e4b8128-9786-4000-a9c0-c511d708a9e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:27.790121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:27.797411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1e4b8128-9786-4000-a9c0-c511d708a9e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.190041 May 23 13:57:27.799427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1033/2149] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:27 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:28.301908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:28.302557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:28.310608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:28.311058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:28.311877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:28.312313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:28.399040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-98a4c56d-a2c5-4ced-a783-cddbc3eb6668 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:28.399918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-98a4c56d-a2c5-4ced-a783-cddbc3eb6668 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:28.406690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98a4c56d-a2c5-4ced-a783-cddbc3eb6668 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:28.407140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98a4c56d-a2c5-4ced-a783-cddbc3eb6668 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:28.407920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98a4c56d-a2c5-4ced-a783-cddbc3eb6668 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:28.408351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-98a4c56d-a2c5-4ced-a783-cddbc3eb6668 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:28.459797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:28.469578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:28.471118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:28.472302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-399be92b-c0f5-410c-8664-96291050d582 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.174376 May 23 13:57:28.472891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1117/2150] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:28 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:28.531239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6581df26-bf98-41fe-9cc6-af74be988c9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:28.531872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6581df26-bf98-41fe-9cc6-af74be988c9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:28.539440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6581df26-bf98-41fe-9cc6-af74be988c9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:28.539894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6581df26-bf98-41fe-9cc6-af74be988c9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:28.540713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6581df26-bf98-41fe-9cc6-af74be988c9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:28.541166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6581df26-bf98-41fe-9cc6-af74be988c9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:28.550278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-98a4c56d-a2c5-4ced-a783-cddbc3eb6668 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:28.560000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-98a4c56d-a2c5-4ced-a783-cddbc3eb6668 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165585 May 23 13:57:28.560639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1034/2151] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:28 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:28.682840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6581df26-bf98-41fe-9cc6-af74be988c9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:28.690881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6581df26-bf98-41fe-9cc6-af74be988c9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.163566 May 23 13:57:28.691557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1118/2152] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:28 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:28.825510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5db2046b-beb8-49c8-bcff-1a2b3286d1ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:28.826023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5db2046b-beb8-49c8-bcff-1a2b3286d1ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:28.832416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5db2046b-beb8-49c8-bcff-1a2b3286d1ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:28.832898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5db2046b-beb8-49c8-bcff-1a2b3286d1ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:28.833657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5db2046b-beb8-49c8-bcff-1a2b3286d1ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:28.834808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5db2046b-beb8-49c8-bcff-1a2b3286d1ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:28.968801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5db2046b-beb8-49c8-bcff-1a2b3286d1ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:28.978173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5db2046b-beb8-49c8-bcff-1a2b3286d1ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156608 May 23 13:57:28.978969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1035/2153] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:28 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:29.493720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:29.494285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:29.501171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:29.501628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:29.502411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:29.502853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:29.578413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cdff0c94-a78c-455e-b1f3-aa427235e693 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:29.579150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cdff0c94-a78c-455e-b1f3-aa427235e693 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:29.587196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdff0c94-a78c-455e-b1f3-aa427235e693 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:29.587347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdff0c94-a78c-455e-b1f3-aa427235e693 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:29.588062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdff0c94-a78c-455e-b1f3-aa427235e693 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:29.588501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdff0c94-a78c-455e-b1f3-aa427235e693 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:29.645584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:29.655112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:29.656762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:29.660272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9649ab8f-c382-4edd-b5d6-4d507de70009 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.169621 May 23 13:57:29.660272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1119/2154] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:29 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:29.708614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0d56d803-5a4f-4357-912d-0f233fab5d84 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:29.709328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0d56d803-5a4f-4357-912d-0f233fab5d84 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:29.715659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d56d803-5a4f-4357-912d-0f233fab5d84 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:29.716099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d56d803-5a4f-4357-912d-0f233fab5d84 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:29.716952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d56d803-5a4f-4357-912d-0f233fab5d84 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:29.717430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d56d803-5a4f-4357-912d-0f233fab5d84 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:29.737605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cdff0c94-a78c-455e-b1f3-aa427235e693 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:29.747953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cdff0c94-a78c-455e-b1f3-aa427235e693 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.173265 May 23 13:57:29.748730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1036/2155] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:29 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:29.874400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0d56d803-5a4f-4357-912d-0f233fab5d84 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:29.876889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0d56d803-5a4f-4357-912d-0f233fab5d84 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.172167 May 23 13:57:29.877486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1120/2156] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:29 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:29.997052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99bdd1cb-c604-47aa-8231-572f3a2f00ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:29.997820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99bdd1cb-c604-47aa-8231-572f3a2f00ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:30.004636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99bdd1cb-c604-47aa-8231-572f3a2f00ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:30.005084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99bdd1cb-c604-47aa-8231-572f3a2f00ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:30.006437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99bdd1cb-c604-47aa-8231-572f3a2f00ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:30.007053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99bdd1cb-c604-47aa-8231-572f3a2f00ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:30.155582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99bdd1cb-c604-47aa-8231-572f3a2f00ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:30.165051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99bdd1cb-c604-47aa-8231-572f3a2f00ff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.172106 May 23 13:57:30.165649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1037/2157] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:29 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:30.681778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:30.682415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:30.688924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:30.689366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:30.690125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:30.690584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:30.767293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a55a73b-9f03-435c-81f5-011aa3bd70f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:30.767902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a55a73b-9f03-435c-81f5-011aa3bd70f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:30.775507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a55a73b-9f03-435c-81f5-011aa3bd70f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:30.775950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a55a73b-9f03-435c-81f5-011aa3bd70f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:30.776771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a55a73b-9f03-435c-81f5-011aa3bd70f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:30.777214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a55a73b-9f03-435c-81f5-011aa3bd70f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:30.845534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:30.858845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:30.860946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:30.862231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9b53aa6f-e297-403b-817c-29abb50fb6e5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.184754 May 23 13:57:30.862816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1121/2158] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:30.894811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c5e8673-0596-44ed-814b-c27b2cece95a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:30.895638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c5e8673-0596-44ed-814b-c27b2cece95a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:30.905485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c5e8673-0596-44ed-814b-c27b2cece95a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:30.908450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c5e8673-0596-44ed-814b-c27b2cece95a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:30.908450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c5e8673-0596-44ed-814b-c27b2cece95a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:30.908450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c5e8673-0596-44ed-814b-c27b2cece95a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:30.936407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a55a73b-9f03-435c-81f5-011aa3bd70f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:30.945216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a55a73b-9f03-435c-81f5-011aa3bd70f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.182240 May 23 13:57:30.945801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1038/2159] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:30 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:31.076898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c5e8673-0596-44ed-814b-c27b2cece95a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:31.086155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c5e8673-0596-44ed-814b-c27b2cece95a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.195287 May 23 13:57:31.086733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1122/2160] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:30 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:31.182932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92d60f41-ad33-47d8-a324-f86a6667954f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:31.183791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-92d60f41-ad33-47d8-a324-f86a6667954f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:31.190278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92d60f41-ad33-47d8-a324-f86a6667954f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:31.190739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92d60f41-ad33-47d8-a324-f86a6667954f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:31.191521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92d60f41-ad33-47d8-a324-f86a6667954f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:31.191972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92d60f41-ad33-47d8-a324-f86a6667954f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:31.343245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-92d60f41-ad33-47d8-a324-f86a6667954f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:31.352040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-92d60f41-ad33-47d8-a324-f86a6667954f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.173119 May 23 13:57:31.352681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1039/2161] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:31 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:31.881989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:31.883558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:31.891243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:31.892062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:31.893489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:31.894299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:31.964241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7144a73-e39a-431d-b67a-3dff0bfaaed8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:31.965153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7144a73-e39a-431d-b67a-3dff0bfaaed8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:31.972062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7144a73-e39a-431d-b67a-3dff0bfaaed8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:31.972518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7144a73-e39a-431d-b67a-3dff0bfaaed8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:31.973371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7144a73-e39a-431d-b67a-3dff0bfaaed8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:31.973813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7144a73-e39a-431d-b67a-3dff0bfaaed8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:32.042491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:32.051121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:32.053335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:32.054892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15786e37-2786-44e1-a412-912957bcb08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.176861 May 23 13:57:32.055350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1123/2162] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:31 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:32.104854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-218fa14b-6c6d-4340-8296-0ef766ae28ea tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:32.105506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-218fa14b-6c6d-4340-8296-0ef766ae28ea tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:32.112001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-218fa14b-6c6d-4340-8296-0ef766ae28ea tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:32.112458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-218fa14b-6c6d-4340-8296-0ef766ae28ea tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:32.113269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-218fa14b-6c6d-4340-8296-0ef766ae28ea tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:32.113768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-218fa14b-6c6d-4340-8296-0ef766ae28ea tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:32.114313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7144a73-e39a-431d-b67a-3dff0bfaaed8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:32.123959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7144a73-e39a-431d-b67a-3dff0bfaaed8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163794 May 23 13:57:32.124556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1040/2163] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:31 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:32.251018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-218fa14b-6c6d-4340-8296-0ef766ae28ea tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:32.260482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-218fa14b-6c6d-4340-8296-0ef766ae28ea tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159520 May 23 13:57:32.261096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1124/2164] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:32 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:32.370467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e777366-ab83-4ec1-b226-a79e7038f456 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:32.371001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e777366-ab83-4ec1-b226-a79e7038f456 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:32.377504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e777366-ab83-4ec1-b226-a79e7038f456 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:32.377938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e777366-ab83-4ec1-b226-a79e7038f456 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:32.378689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e777366-ab83-4ec1-b226-a79e7038f456 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:32.379123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e777366-ab83-4ec1-b226-a79e7038f456 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:32.516534 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0e777366-ab83-4ec1-b226-a79e7038f456 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:32.525450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e777366-ab83-4ec1-b226-a79e7038f456 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159560 May 23 13:57:32.526038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1041/2165] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:32 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:33.073966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:33.074572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:33.081270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:33.081716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:33.082491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:33.082924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:33.144843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fa91cb6a-0179-47f8-9f5f-2635b9b4bec9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:33.145602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fa91cb6a-0179-47f8-9f5f-2635b9b4bec9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:33.152681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa91cb6a-0179-47f8-9f5f-2635b9b4bec9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:33.153346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa91cb6a-0179-47f8-9f5f-2635b9b4bec9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:33.153912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa91cb6a-0179-47f8-9f5f-2635b9b4bec9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:33.154354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa91cb6a-0179-47f8-9f5f-2635b9b4bec9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:33.224492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:33.233663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:33.235168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:33.236357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0759e280-5a25-4fe2-aa58-82fa68807751 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.166379 May 23 13:57:33.243218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1125/2166] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:57:33.278061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c29525e-2c28-4cb9-958c-22915bd45370 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:33.278717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c29525e-2c28-4cb9-958c-22915bd45370 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:33.285222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c29525e-2c28-4cb9-958c-22915bd45370 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:33.285673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c29525e-2c28-4cb9-958c-22915bd45370 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:33.286643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c29525e-2c28-4cb9-958c-22915bd45370 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:33.287159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c29525e-2c28-4cb9-958c-22915bd45370 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:33.292164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:33.293022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fa91cb6a-0179-47f8-9f5f-2635b9b4bec9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:33.301279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fa91cb6a-0179-47f8-9f5f-2635b9b4bec9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160450 May 23 13:57:33.304371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1042/2167] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:33 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:33.423162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3c29525e-2c28-4cb9-958c-22915bd45370 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:33.431712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c29525e-2c28-4cb9-958c-22915bd45370 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.157639 May 23 13:57:33.432281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1126/2168] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:33 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:33.543035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6d8997d-e05d-4993-ba7e-697c3014c0f7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:33.543646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6d8997d-e05d-4993-ba7e-697c3014c0f7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:33.549743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6d8997d-e05d-4993-ba7e-697c3014c0f7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:33.550193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6d8997d-e05d-4993-ba7e-697c3014c0f7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:33.550969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6d8997d-e05d-4993-ba7e-697c3014c0f7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:33.551383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6d8997d-e05d-4993-ba7e-697c3014c0f7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:33.694179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6d8997d-e05d-4993-ba7e-697c3014c0f7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:33.697141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6d8997d-e05d-4993-ba7e-697c3014c0f7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.157775 May 23 13:57:33.697750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1043/2169] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:33 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:34.256832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:34.257865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:34.265172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:34.265625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:34.266398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:34.266844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:34.324202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9277cc70-7188-4c6c-b2b2-dc53cf472a93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:34.324960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9277cc70-7188-4c6c-b2b2-dc53cf472a93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:34.332031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9277cc70-7188-4c6c-b2b2-dc53cf472a93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:34.332485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9277cc70-7188-4c6c-b2b2-dc53cf472a93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:34.333328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9277cc70-7188-4c6c-b2b2-dc53cf472a93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:34.334338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9277cc70-7188-4c6c-b2b2-dc53cf472a93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:34.408931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:34.418678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:34.420200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:34.421420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eca7fa89-38fa-45ef-9575-3e10dd205204 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.169302 May 23 13:57:34.421987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1127/2170] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:34 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:34.450388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e14d106-8649-4f46-8a13-e239ca9f5b70 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:34.450968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e14d106-8649-4f46-8a13-e239ca9f5b70 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:34.457669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e14d106-8649-4f46-8a13-e239ca9f5b70 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:34.458120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e14d106-8649-4f46-8a13-e239ca9f5b70 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:34.459584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e14d106-8649-4f46-8a13-e239ca9f5b70 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:34.460344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e14d106-8649-4f46-8a13-e239ca9f5b70 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:34.483219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9277cc70-7188-4c6c-b2b2-dc53cf472a93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:34.490181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9277cc70-7188-4c6c-b2b2-dc53cf472a93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.169863 May 23 13:57:34.490754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1044/2171] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:34 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:34.596010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9e14d106-8649-4f46-8a13-e239ca9f5b70 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:34.604884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e14d106-8649-4f46-8a13-e239ca9f5b70 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158521 May 23 13:57:34.605472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1128/2172] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:34 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:34.714739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b72d0424-cd55-4728-bced-08bec6cb1b2b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:34.715259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b72d0424-cd55-4728-bced-08bec6cb1b2b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:34.724810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b72d0424-cd55-4728-bced-08bec6cb1b2b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:34.725269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b72d0424-cd55-4728-bced-08bec6cb1b2b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:34.726048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b72d0424-cd55-4728-bced-08bec6cb1b2b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:34.726486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b72d0424-cd55-4728-bced-08bec6cb1b2b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:34.868147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b72d0424-cd55-4728-bced-08bec6cb1b2b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:34.876403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b72d0424-cd55-4728-bced-08bec6cb1b2b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.165501 May 23 13:57:34.877046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1045/2173] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:34 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:35.440241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:35.440823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:35.448753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:35.449213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:35.449996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:35.450440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:35.508350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b44126e7-bc81-4c3f-addf-aac9155a0e29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:35.509340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b44126e7-bc81-4c3f-addf-aac9155a0e29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:35.516520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b44126e7-bc81-4c3f-addf-aac9155a0e29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:35.516994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b44126e7-bc81-4c3f-addf-aac9155a0e29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:35.517771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b44126e7-bc81-4c3f-addf-aac9155a0e29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:35.518203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b44126e7-bc81-4c3f-addf-aac9155a0e29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:35.595272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:35.604834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:35.606580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:35.607564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7b27e662-9bdc-4635-8d21-01ede5e5241d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.171394 May 23 13:57:35.608135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1129/2174] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:35 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:35.629368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4baae052-05a1-4049-b559-e4cc9c8d4da5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:35.630760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4baae052-05a1-4049-b559-e4cc9c8d4da5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:35.638854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4baae052-05a1-4049-b559-e4cc9c8d4da5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:35.639233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4baae052-05a1-4049-b559-e4cc9c8d4da5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:35.640013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4baae052-05a1-4049-b559-e4cc9c8d4da5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:35.640450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4baae052-05a1-4049-b559-e4cc9c8d4da5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:35.663867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b44126e7-bc81-4c3f-addf-aac9155a0e29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:35.673311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b44126e7-bc81-4c3f-addf-aac9155a0e29 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.168843 May 23 13:57:35.673903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1046/2175] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:35 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:35.786124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4baae052-05a1-4049-b559-e4cc9c8d4da5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:35.795148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4baae052-05a1-4049-b559-e4cc9c8d4da5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.173933 May 23 13:57:35.795752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1130/2176] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:35 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:35.894411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b28bf5cb-df84-43fa-95d9-86ce5b463764 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:35.895027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b28bf5cb-df84-43fa-95d9-86ce5b463764 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:35.902000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b28bf5cb-df84-43fa-95d9-86ce5b463764 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:35.902449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b28bf5cb-df84-43fa-95d9-86ce5b463764 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:35.903225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b28bf5cb-df84-43fa-95d9-86ce5b463764 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:35.903660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b28bf5cb-df84-43fa-95d9-86ce5b463764 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:36.056587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b28bf5cb-df84-43fa-95d9-86ce5b463764 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:36.065249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b28bf5cb-df84-43fa-95d9-86ce5b463764 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.174734 May 23 13:57:36.065831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1047/2177] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:35 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:36.626704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:36.629887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:36.634822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:36.635275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:36.636137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:36.636627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:36.692052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-54dc57ed-7a5e-4f9b-8174-b297e1f3b2db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:36.694211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-54dc57ed-7a5e-4f9b-8174-b297e1f3b2db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:36.701249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54dc57ed-7a5e-4f9b-8174-b297e1f3b2db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:36.704129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54dc57ed-7a5e-4f9b-8174-b297e1f3b2db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:36.704129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54dc57ed-7a5e-4f9b-8174-b297e1f3b2db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:36.704129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54dc57ed-7a5e-4f9b-8174-b297e1f3b2db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:36.808843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:36.818994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:36.820528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:36.821760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c7848f70-1c2b-48ee-9648-aa8c47f52a8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.199204 May 23 13:57:36.822331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1131/2178] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:36 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:36.827629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e781cbd5-6e41-4541-afe2-77d1a3590fec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:36.828252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e781cbd5-6e41-4541-afe2-77d1a3590fec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:36.835428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e781cbd5-6e41-4541-afe2-77d1a3590fec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:36.835904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e781cbd5-6e41-4541-afe2-77d1a3590fec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:36.836721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e781cbd5-6e41-4541-afe2-77d1a3590fec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:36.837161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e781cbd5-6e41-4541-afe2-77d1a3590fec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:36.863172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-54dc57ed-7a5e-4f9b-8174-b297e1f3b2db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:36.877658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-54dc57ed-7a5e-4f9b-8174-b297e1f3b2db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.185409 May 23 13:57:36.877658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1048/2179] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:36 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:36.992988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e781cbd5-6e41-4541-afe2-77d1a3590fec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:37.002100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e781cbd5-6e41-4541-afe2-77d1a3590fec tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.178400 May 23 13:57:37.002693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1132/2180] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:36 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:37.084086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95773ee5-6a42-44d5-8863-3cf9bc8c4789 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:37.084755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95773ee5-6a42-44d5-8863-3cf9bc8c4789 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:37.091529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95773ee5-6a42-44d5-8863-3cf9bc8c4789 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:37.092080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95773ee5-6a42-44d5-8863-3cf9bc8c4789 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:37.092968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95773ee5-6a42-44d5-8863-3cf9bc8c4789 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:37.093454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95773ee5-6a42-44d5-8863-3cf9bc8c4789 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:37.243309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95773ee5-6a42-44d5-8863-3cf9bc8c4789 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:37.251661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95773ee5-6a42-44d5-8863-3cf9bc8c4789 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.171510 May 23 13:57:37.252255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1049/2181] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:37 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:37.841603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:37.841974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:37.849718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:37.850182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:37.851059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:37.851498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:37.899431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9186e394-2637-4123-8bb9-5fc4e6e0b527 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:37.900632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9186e394-2637-4123-8bb9-5fc4e6e0b527 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:37.913000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9186e394-2637-4123-8bb9-5fc4e6e0b527 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:37.913805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9186e394-2637-4123-8bb9-5fc4e6e0b527 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:37.915222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9186e394-2637-4123-8bb9-5fc4e6e0b527 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:37.916000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9186e394-2637-4123-8bb9-5fc4e6e0b527 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:37.963427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:38.009216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:38.019900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:38.023421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:38.025824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87d11770-9374-41ed-915b-0ecd73e5a138 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.187756 May 23 13:57:38.026295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1133/2182] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:37 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:38.032218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61464416-4623-41f8-922b-fd33e5275cca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:38.032880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-61464416-4623-41f8-922b-fd33e5275cca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:38.043910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61464416-4623-41f8-922b-fd33e5275cca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:38.044768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61464416-4623-41f8-922b-fd33e5275cca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:38.046192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61464416-4623-41f8-922b-fd33e5275cca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:38.046703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61464416-4623-41f8-922b-fd33e5275cca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:38.129192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9186e394-2637-4123-8bb9-5fc4e6e0b527 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:38.143974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9186e394-2637-4123-8bb9-5fc4e6e0b527 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.252178 May 23 13:57:38.144831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1050/2183] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:37 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:38.235766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-61464416-4623-41f8-922b-fd33e5275cca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:38.245659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-61464416-4623-41f8-922b-fd33e5275cca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.218055 May 23 13:57:38.246257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1134/2184] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:38 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:38.272293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8b2ffeb3-7332-4ae1-b780-e4aed2d03a63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:38.272838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8b2ffeb3-7332-4ae1-b780-e4aed2d03a63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:38.279416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b2ffeb3-7332-4ae1-b780-e4aed2d03a63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:38.279864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b2ffeb3-7332-4ae1-b780-e4aed2d03a63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:38.280681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b2ffeb3-7332-4ae1-b780-e4aed2d03a63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:38.281118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b2ffeb3-7332-4ae1-b780-e4aed2d03a63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:38.443208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8b2ffeb3-7332-4ae1-b780-e4aed2d03a63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:38.453182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8b2ffeb3-7332-4ae1-b780-e4aed2d03a63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.185532 May 23 13:57:38.453834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1051/2185] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:38 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:39.054110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:39.054732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:39.062005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:39.062460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:39.063280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:39.063732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:39.170316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e1f4c730-6c28-4248-873a-38e6606416aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:39.171246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e1f4c730-6c28-4248-873a-38e6606416aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:39.183467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1f4c730-6c28-4248-873a-38e6606416aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:39.184659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1f4c730-6c28-4248-873a-38e6606416aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:39.188025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1f4c730-6c28-4248-873a-38e6606416aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:39.188229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1f4c730-6c28-4248-873a-38e6606416aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:39.219104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:39.229190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:39.230763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:39.231991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6998e9e0-00d7-480a-8206-b332a6824fc0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.182199 May 23 13:57:39.232590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1135/2186] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:39 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:39.263841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-092c54e0-04ac-4dc2-9b45-63a5fe1dc8fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:39.264629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-092c54e0-04ac-4dc2-9b45-63a5fe1dc8fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:39.271664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-092c54e0-04ac-4dc2-9b45-63a5fe1dc8fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:39.272184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-092c54e0-04ac-4dc2-9b45-63a5fe1dc8fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:39.273016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-092c54e0-04ac-4dc2-9b45-63a5fe1dc8fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:39.273460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-092c54e0-04ac-4dc2-9b45-63a5fe1dc8fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:39.383549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e1f4c730-6c28-4248-873a-38e6606416aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:39.392628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e1f4c730-6c28-4248-873a-38e6606416aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.229229 May 23 13:57:39.393238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1052/2187] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:39 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:39.447762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-092c54e0-04ac-4dc2-9b45-63a5fe1dc8fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:39.462100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-092c54e0-04ac-4dc2-9b45-63a5fe1dc8fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.201939 May 23 13:57:39.463171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1136/2188] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:39 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:39.472820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65e05a09-f90b-46bd-bc5b-986470a19774 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:39.473478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65e05a09-f90b-46bd-bc5b-986470a19774 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:39.481268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65e05a09-f90b-46bd-bc5b-986470a19774 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:39.481720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65e05a09-f90b-46bd-bc5b-986470a19774 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:39.482514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65e05a09-f90b-46bd-bc5b-986470a19774 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:39.482950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65e05a09-f90b-46bd-bc5b-986470a19774 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:39.680915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65e05a09-f90b-46bd-bc5b-986470a19774 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:39.690075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65e05a09-f90b-46bd-bc5b-986470a19774 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.221554 May 23 13:57:39.690680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1053/2189] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:39 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:40.252619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:40.253263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:40.261434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:40.261892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:40.262692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:40.263126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:40.419975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0c03b820-593e-41c4-bfe2-a11e6222cbd7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:40.420626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0c03b820-593e-41c4-bfe2-a11e6222cbd7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:40.427822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c03b820-593e-41c4-bfe2-a11e6222cbd7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:40.428277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c03b820-593e-41c4-bfe2-a11e6222cbd7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:40.429271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c03b820-593e-41c4-bfe2-a11e6222cbd7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:40.430390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c03b820-593e-41c4-bfe2-a11e6222cbd7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:40.438694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:40.450715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:40.452409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:40.453648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b202d9c-073f-42e4-8c14-f532ea5a2a9b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.205139 May 23 13:57:40.454225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1137/2190] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:40.488547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-62a11134-5660-480b-b024-b485739732e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:40.489287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-62a11134-5660-480b-b024-b485739732e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:40.498728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62a11134-5660-480b-b024-b485739732e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:40.499442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62a11134-5660-480b-b024-b485739732e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:40.500819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62a11134-5660-480b-b024-b485739732e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:40.501538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62a11134-5660-480b-b024-b485739732e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:40.613836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0c03b820-593e-41c4-bfe2-a11e6222cbd7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:40.625815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0c03b820-593e-41c4-bfe2-a11e6222cbd7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.207968 May 23 13:57:40.625815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1054/2191] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:40 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:40.681278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-62a11134-5660-480b-b024-b485739732e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:40.690548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-62a11134-5660-480b-b024-b485739732e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.205852 May 23 13:57:40.691029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1138/2192] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:40 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:40.709906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e35ea1d-7078-40bb-9b13-c4701e14ae77 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:40.709906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e35ea1d-7078-40bb-9b13-c4701e14ae77 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:40.716518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e35ea1d-7078-40bb-9b13-c4701e14ae77 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:40.716996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e35ea1d-7078-40bb-9b13-c4701e14ae77 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:40.717795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e35ea1d-7078-40bb-9b13-c4701e14ae77 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:40.718231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e35ea1d-7078-40bb-9b13-c4701e14ae77 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:40.860449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e35ea1d-7078-40bb-9b13-c4701e14ae77 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:40.868955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e35ea1d-7078-40bb-9b13-c4701e14ae77 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164130 May 23 13:57:40.869614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1055/2193] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:40 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:41.474377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:41.474925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:41.481870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:41.482328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:41.483113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:41.483554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:41.642027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:41.643002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-784f6f3d-d159-47c8-aff5-d8b13b4e917c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:41.643966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-784f6f3d-d159-47c8-aff5-d8b13b4e917c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:41.655034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-784f6f3d-d159-47c8-aff5-d8b13b4e917c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:41.655771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-784f6f3d-d159-47c8-aff5-d8b13b4e917c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:41.657086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-784f6f3d-d159-47c8-aff5-d8b13b4e917c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:41.657797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-784f6f3d-d159-47c8-aff5-d8b13b4e917c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:41.659254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:41.662808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:41.664961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9777fe2e-1c67-40ae-9a21-9aa8d76ba072 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.194808 May 23 13:57:41.666161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1139/2194] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:41 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:57:41.707679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12ec0adb-02bf-4f96-8588-df954d10b1ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:41.709044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12ec0adb-02bf-4f96-8588-df954d10b1ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:41.716487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12ec0adb-02bf-4f96-8588-df954d10b1ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:41.716971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12ec0adb-02bf-4f96-8588-df954d10b1ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:41.717789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12ec0adb-02bf-4f96-8588-df954d10b1ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:41.718228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12ec0adb-02bf-4f96-8588-df954d10b1ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:41.821704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-784f6f3d-d159-47c8-aff5-d8b13b4e917c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:41.830461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-784f6f3d-d159-47c8-aff5-d8b13b4e917c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.191803 May 23 13:57:41.831614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1056/2195] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:41 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:41.859674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12ec0adb-02bf-4f96-8588-df954d10b1ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:41.868241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12ec0adb-02bf-4f96-8588-df954d10b1ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164816 May 23 13:57:41.868838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1140/2196] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:41 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:41.886202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13e34141-7475-4e68-9670-568bfdbcc9b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:41.886810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-13e34141-7475-4e68-9670-568bfdbcc9b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:41.892866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13e34141-7475-4e68-9670-568bfdbcc9b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:41.893315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13e34141-7475-4e68-9670-568bfdbcc9b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:41.894110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13e34141-7475-4e68-9670-568bfdbcc9b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:41.894547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13e34141-7475-4e68-9670-568bfdbcc9b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:42.028962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-13e34141-7475-4e68-9670-568bfdbcc9b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:42.037324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-13e34141-7475-4e68-9670-568bfdbcc9b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154704 May 23 13:57:42.037897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1057/2197] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:41 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:42.694290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:42.695978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:42.703765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:42.704214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:42.705041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:42.705491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:42.850189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55160508-1145-4dd5-b363-435aa9310950 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:42.851175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55160508-1145-4dd5-b363-435aa9310950 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:42.866282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55160508-1145-4dd5-b363-435aa9310950 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:42.867076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55160508-1145-4dd5-b363-435aa9310950 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:42.871982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:42.872997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55160508-1145-4dd5-b363-435aa9310950 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:42.875739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55160508-1145-4dd5-b363-435aa9310950 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:42.883323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:42.885091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:42.886389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e13cc184-1f34-484f-b5d5-a4e339dfee02 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.197083 May 23 13:57:42.887281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1141/2198] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:42 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:42.902491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17d83e73-518e-4b9f-a049-fd314569eb40 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:42.903121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17d83e73-518e-4b9f-a049-fd314569eb40 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:42.909703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17d83e73-518e-4b9f-a049-fd314569eb40 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:42.910167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17d83e73-518e-4b9f-a049-fd314569eb40 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:42.910956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17d83e73-518e-4b9f-a049-fd314569eb40 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:42.912210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17d83e73-518e-4b9f-a049-fd314569eb40 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:43.037371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55160508-1145-4dd5-b363-435aa9310950 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:43.049778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55160508-1145-4dd5-b363-435aa9310950 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.203783 May 23 13:57:43.054441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1058/2199] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:42 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:43.060237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-35e9fcca-fa16-4764-835a-1ecd9cfaca8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:43.060903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-35e9fcca-fa16-4764-835a-1ecd9cfaca8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:43.068104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35e9fcca-fa16-4764-835a-1ecd9cfaca8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:43.069539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35e9fcca-fa16-4764-835a-1ecd9cfaca8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:43.070358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35e9fcca-fa16-4764-835a-1ecd9cfaca8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:43.070801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35e9fcca-fa16-4764-835a-1ecd9cfaca8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:43.099719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-17d83e73-518e-4b9f-a049-fd314569eb40 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:43.103679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:43.109020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17d83e73-518e-4b9f-a049-fd314569eb40 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.210802 May 23 13:57:43.109607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1142/2200] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:42 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:43.246061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-35e9fcca-fa16-4764-835a-1ecd9cfaca8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:43.257246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-35e9fcca-fa16-4764-835a-1ecd9cfaca8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.200586 May 23 13:57:43.257875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1059/2201] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:43 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:43.909397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:43.910014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:43.917799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:43.918257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:43.919040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:43.919478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:44.053250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:44.061599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:44.063124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:44.064320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92c83644-a828-46f3-8fb8-3112b3be2daf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159261 May 23 13:57:44.064911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1143/2202] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:43 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:44.067209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89e1f054-8a63-47df-a4f9-1a63e2d3b8ab tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:44.067855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-89e1f054-8a63-47df-a4f9-1a63e2d3b8ab tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:44.075645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89e1f054-8a63-47df-a4f9-1a63e2d3b8ab tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:44.076123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89e1f054-8a63-47df-a4f9-1a63e2d3b8ab tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:44.077026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89e1f054-8a63-47df-a4f9-1a63e2d3b8ab tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:44.077490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-89e1f054-8a63-47df-a4f9-1a63e2d3b8ab tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:44.136006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4ff1aa70-7e4b-43d1-a272-c6d983f9c109 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:44.136669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4ff1aa70-7e4b-43d1-a272-c6d983f9c109 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:44.143204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ff1aa70-7e4b-43d1-a272-c6d983f9c109 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:44.143659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ff1aa70-7e4b-43d1-a272-c6d983f9c109 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:44.144435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ff1aa70-7e4b-43d1-a272-c6d983f9c109 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:44.144900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ff1aa70-7e4b-43d1-a272-c6d983f9c109 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:44.219095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-89e1f054-8a63-47df-a4f9-1a63e2d3b8ab tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:44.228593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89e1f054-8a63-47df-a4f9-1a63e2d3b8ab tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165058 May 23 13:57:44.229202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1060/2203] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:44 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:44.279879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a85e8c93-38cd-4fc6-a72d-03202c4e6081 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:44.280487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a85e8c93-38cd-4fc6-a72d-03202c4e6081 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:44.284914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4ff1aa70-7e4b-43d1-a272-c6d983f9c109 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:44.287186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a85e8c93-38cd-4fc6-a72d-03202c4e6081 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:44.287624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a85e8c93-38cd-4fc6-a72d-03202c4e6081 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:44.288378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a85e8c93-38cd-4fc6-a72d-03202c4e6081 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:44.288825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a85e8c93-38cd-4fc6-a72d-03202c4e6081 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:44.293600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4ff1aa70-7e4b-43d1-a272-c6d983f9c109 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161526 May 23 13:57:44.294183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1144/2204] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:44 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:44.428498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a85e8c93-38cd-4fc6-a72d-03202c4e6081 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:44.436543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a85e8c93-38cd-4fc6-a72d-03202c4e6081 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160466 May 23 13:57:44.437123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1061/2205] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:44 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:45.087508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:45.088122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:45.094263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:45.094714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:45.095481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:45.095925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:45.228642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:45.237624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:45.239319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:45.240551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec641efb-c3b4-4b55-819c-860d37905920 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.157151 May 23 13:57:45.244670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1145/2206] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:45.251166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64a1746c-e899-4682-bc14-2fbc50ff6edb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:45.252121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64a1746c-e899-4682-bc14-2fbc50ff6edb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:45.259057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a1746c-e899-4682-bc14-2fbc50ff6edb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:45.259537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a1746c-e899-4682-bc14-2fbc50ff6edb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:45.263411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a1746c-e899-4682-bc14-2fbc50ff6edb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:45.263411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a1746c-e899-4682-bc14-2fbc50ff6edb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:45.311228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-663c36dd-38e7-4e25-9e9d-a9fe8e49a75c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:45.311844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-663c36dd-38e7-4e25-9e9d-a9fe8e49a75c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:45.318388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-663c36dd-38e7-4e25-9e9d-a9fe8e49a75c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:45.318845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-663c36dd-38e7-4e25-9e9d-a9fe8e49a75c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:45.319684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-663c36dd-38e7-4e25-9e9d-a9fe8e49a75c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:45.320148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-663c36dd-38e7-4e25-9e9d-a9fe8e49a75c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:45.397186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64a1746c-e899-4682-bc14-2fbc50ff6edb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:45.405537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64a1746c-e899-4682-bc14-2fbc50ff6edb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159336 May 23 13:57:45.406119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1062/2207] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:45 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:45.455025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1edbf0d4-a927-4bca-801c-4bba8b3768c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:45.455767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1edbf0d4-a927-4bca-801c-4bba8b3768c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:45.463980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1edbf0d4-a927-4bca-801c-4bba8b3768c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:45.464406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1edbf0d4-a927-4bca-801c-4bba8b3768c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:45.465206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1edbf0d4-a927-4bca-801c-4bba8b3768c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:45.465635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1edbf0d4-a927-4bca-801c-4bba8b3768c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:45.477454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-663c36dd-38e7-4e25-9e9d-a9fe8e49a75c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:45.488839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-663c36dd-38e7-4e25-9e9d-a9fe8e49a75c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.181166 May 23 13:57:45.491762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1146/2208] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:45 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:45.618048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1edbf0d4-a927-4bca-801c-4bba8b3768c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:45.626449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1edbf0d4-a927-4bca-801c-4bba8b3768c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.176094 May 23 13:57:45.627028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1063/2209] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:45 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:46.261935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:46.262899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:46.270012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:46.270673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:46.271452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:46.271917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:46.414244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:46.423601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:46.425145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:46.426333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0214e396-4c08-4816-94ab-9297cd903471 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.170782 May 23 13:57:46.427766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1147/2210] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:46.431552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-450a7a95-a729-48f0-90bb-c91587bb5808 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:46.432325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-450a7a95-a729-48f0-90bb-c91587bb5808 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:46.442258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-450a7a95-a729-48f0-90bb-c91587bb5808 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:46.442732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-450a7a95-a729-48f0-90bb-c91587bb5808 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:46.444160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-450a7a95-a729-48f0-90bb-c91587bb5808 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:46.444628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-450a7a95-a729-48f0-90bb-c91587bb5808 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:46.508029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a9e98de-a60c-47b5-a634-668887a0eb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:46.508679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a9e98de-a60c-47b5-a634-668887a0eb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:46.514914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a9e98de-a60c-47b5-a634-668887a0eb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:46.515363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a9e98de-a60c-47b5-a634-668887a0eb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:46.516129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a9e98de-a60c-47b5-a634-668887a0eb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:46.516556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a9e98de-a60c-47b5-a634-668887a0eb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:46.678466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a9e98de-a60c-47b5-a634-668887a0eb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:46.687185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a9e98de-a60c-47b5-a634-668887a0eb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.183542 May 23 13:57:46.687822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1148/2211] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:46 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:46.692929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b235bed3-46c0-4d27-8f2a-9a19d9ec12c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:46.693721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b235bed3-46c0-4d27-8f2a-9a19d9ec12c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:46.701373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b235bed3-46c0-4d27-8f2a-9a19d9ec12c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:46.706275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b235bed3-46c0-4d27-8f2a-9a19d9ec12c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:46.706275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b235bed3-46c0-4d27-8f2a-9a19d9ec12c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:46.706275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b235bed3-46c0-4d27-8f2a-9a19d9ec12c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:46.774615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-450a7a95-a729-48f0-90bb-c91587bb5808 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:46.784762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-450a7a95-a729-48f0-90bb-c91587bb5808 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.363702 May 23 13:57:46.785470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1064/2212] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:46 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:46.850596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b235bed3-46c0-4d27-8f2a-9a19d9ec12c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:46.859086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b235bed3-46c0-4d27-8f2a-9a19d9ec12c6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.170240 May 23 13:57:46.859659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1149/2213] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:46 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:47.447250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:47.447795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:47.454592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:47.455050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:47.455825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:47.456267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:47.601778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:47.614841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:47.617742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:47.619566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-502037ed-4b1c-41dd-a94c-27aedfbe6706 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.177207 May 23 13:57:47.620262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1065/2214] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:47 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:47.706036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1436762f-bc12-47c4-83fc-78ebba578e98 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:47.706802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1436762f-bc12-47c4-83fc-78ebba578e98 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:47.714477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1436762f-bc12-47c4-83fc-78ebba578e98 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:47.714935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1436762f-bc12-47c4-83fc-78ebba578e98 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:47.715726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1436762f-bc12-47c4-83fc-78ebba578e98 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:47.716169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1436762f-bc12-47c4-83fc-78ebba578e98 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:47.808319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fc5d4146-805e-439a-89e0-baa30d134800 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:47.808966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fc5d4146-805e-439a-89e0-baa30d134800 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:47.815644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc5d4146-805e-439a-89e0-baa30d134800 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:47.816099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc5d4146-805e-439a-89e0-baa30d134800 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:47.816898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc5d4146-805e-439a-89e0-baa30d134800 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:47.818295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc5d4146-805e-439a-89e0-baa30d134800 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:47.861680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1436762f-bc12-47c4-83fc-78ebba578e98 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:47.872018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1436762f-bc12-47c4-83fc-78ebba578e98 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.170262 May 23 13:57:47.872638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1150/2215] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:47 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:47.878521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10052e99-3f3d-4a7d-92cd-61cdd42a0e87 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:47.879160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10052e99-3f3d-4a7d-92cd-61cdd42a0e87 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:47.886203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10052e99-3f3d-4a7d-92cd-61cdd42a0e87 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:47.886653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10052e99-3f3d-4a7d-92cd-61cdd42a0e87 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:47.887429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10052e99-3f3d-4a7d-92cd-61cdd42a0e87 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:47.887868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10052e99-3f3d-4a7d-92cd-61cdd42a0e87 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:47.996132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc5d4146-805e-439a-89e0-baa30d134800 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:48.004898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fc5d4146-805e-439a-89e0-baa30d134800 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.200611 May 23 13:57:48.005769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1066/2216] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:47 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:48.050756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10052e99-3f3d-4a7d-92cd-61cdd42a0e87 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:48.059741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10052e99-3f3d-4a7d-92cd-61cdd42a0e87 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.186024 May 23 13:57:48.060328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1151/2217] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:47 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:48.639228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:48.639843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:48.647634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:48.648085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:48.648962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:48.649404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:48.653486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:48.783200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:48.791622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:48.793169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:48.794324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-899b3098-e8ad-4b4a-9232-c96584105012 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159028 May 23 13:57:48.794887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1067/2218] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:48.890210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d651e16c-dfaa-42aa-b42b-6a8886c3fb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:48.890852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d651e16c-dfaa-42aa-b42b-6a8886c3fb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:48.898470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d651e16c-dfaa-42aa-b42b-6a8886c3fb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:48.898914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d651e16c-dfaa-42aa-b42b-6a8886c3fb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:48.899671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d651e16c-dfaa-42aa-b42b-6a8886c3fb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:48.900106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d651e16c-dfaa-42aa-b42b-6a8886c3fb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:49.024181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-234c9f01-7126-4d9e-bebd-78ae398b4766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:49.024831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-234c9f01-7126-4d9e-bebd-78ae398b4766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:49.031088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-234c9f01-7126-4d9e-bebd-78ae398b4766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:49.031540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-234c9f01-7126-4d9e-bebd-78ae398b4766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:49.032307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-234c9f01-7126-4d9e-bebd-78ae398b4766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:49.032771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-234c9f01-7126-4d9e-bebd-78ae398b4766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:49.033515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d651e16c-dfaa-42aa-b42b-6a8886c3fb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:49.042089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d651e16c-dfaa-42aa-b42b-6a8886c3fb34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155778 May 23 13:57:49.042872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1152/2219] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:48 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:49.077753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-967af33e-d63f-4ff0-b228-78ef2e0c8275 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:49.078374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-967af33e-d63f-4ff0-b228-78ef2e0c8275 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:49.080275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:49.085323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967af33e-d63f-4ff0-b228-78ef2e0c8275 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:49.085772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967af33e-d63f-4ff0-b228-78ef2e0c8275 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:49.086554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967af33e-d63f-4ff0-b228-78ef2e0c8275 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:49.086995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-967af33e-d63f-4ff0-b228-78ef2e0c8275 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:49.185073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-234c9f01-7126-4d9e-bebd-78ae398b4766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:49.194881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-234c9f01-7126-4d9e-bebd-78ae398b4766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.175020 May 23 13:57:49.195590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1068/2220] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:49 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:49.222724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-967af33e-d63f-4ff0-b228-78ef2e0c8275 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:49.230655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-967af33e-d63f-4ff0-b228-78ef2e0c8275 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156961 May 23 13:57:49.231215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1153/2221] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:49 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:49.812392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:49.813028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:49.820788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:49.821268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:49.822038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:49.822481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:49.953447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:49.962200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:49.963794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:49.965002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bfb0902c-e2fb-42be-887c-1d0340f22dca tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.156480 May 23 13:57:49.965569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1069/2222] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:49 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:50.059264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9eea315-1c40-44e5-aadf-d3f7ed0c62da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:50.059937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9eea315-1c40-44e5-aadf-d3f7ed0c62da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:50.066537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9eea315-1c40-44e5-aadf-d3f7ed0c62da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:50.067018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9eea315-1c40-44e5-aadf-d3f7ed0c62da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:50.067848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9eea315-1c40-44e5-aadf-d3f7ed0c62da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:50.068536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9eea315-1c40-44e5-aadf-d3f7ed0c62da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:50.203239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9eea315-1c40-44e5-aadf-d3f7ed0c62da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:50.212870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6b7cd205-80f2-4be2-bb31-a488dbd41480 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:50.213391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9eea315-1c40-44e5-aadf-d3f7ed0c62da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.157932 May 23 13:57:50.213521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6b7cd205-80f2-4be2-bb31-a488dbd41480 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:50.213983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1154/2223] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:50 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:50.215504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:50.220525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b7cd205-80f2-4be2-bb31-a488dbd41480 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:50.221076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b7cd205-80f2-4be2-bb31-a488dbd41480 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:50.222148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b7cd205-80f2-4be2-bb31-a488dbd41480 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:50.222585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b7cd205-80f2-4be2-bb31-a488dbd41480 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:50.247336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4429c286-faa5-4e1d-8335-52d0e0b95fba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:50.247956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4429c286-faa5-4e1d-8335-52d0e0b95fba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:50.254187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4429c286-faa5-4e1d-8335-52d0e0b95fba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:50.254669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4429c286-faa5-4e1d-8335-52d0e0b95fba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:50.255529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4429c286-faa5-4e1d-8335-52d0e0b95fba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:50.256105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4429c286-faa5-4e1d-8335-52d0e0b95fba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:50.382645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6b7cd205-80f2-4be2-bb31-a488dbd41480 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:50.390640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6b7cd205-80f2-4be2-bb31-a488dbd41480 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.181849 May 23 13:57:50.391219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1070/2224] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:50 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:50.392636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4429c286-faa5-4e1d-8335-52d0e0b95fba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:50.402023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4429c286-faa5-4e1d-8335-52d0e0b95fba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158501 May 23 13:57:50.402604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1155/2225] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:50 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:50.984131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:50.984801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:50.992361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:50.992852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:50.993647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:50.994082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:51.135445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:51.144171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:51.148191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:51.148191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e31ba92a-6bd1-4bcf-a5c1-07d4825684a4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.167411 May 23 13:57:51.148191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1071/2226] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:50 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:51.231258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8539ed9c-9c80-42f2-a8fd-e884b210813c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:51.231899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8539ed9c-9c80-42f2-a8fd-e884b210813c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:51.238265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8539ed9c-9c80-42f2-a8fd-e884b210813c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:51.239295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8539ed9c-9c80-42f2-a8fd-e884b210813c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:51.240236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8539ed9c-9c80-42f2-a8fd-e884b210813c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:51.240703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8539ed9c-9c80-42f2-a8fd-e884b210813c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:51.407812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-afa64977-4e32-48e8-b8ad-70b561e3b3d5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:51.408469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-afa64977-4e32-48e8-b8ad-70b561e3b3d5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:51.414894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afa64977-4e32-48e8-b8ad-70b561e3b3d5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:51.415348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afa64977-4e32-48e8-b8ad-70b561e3b3d5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:51.416113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afa64977-4e32-48e8-b8ad-70b561e3b3d5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:51.416541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afa64977-4e32-48e8-b8ad-70b561e3b3d5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:51.451126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8539ed9c-9c80-42f2-a8fd-e884b210813c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:51.460492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8539ed9c-9c80-42f2-a8fd-e884b210813c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.233146 May 23 13:57:51.470713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1156/2227] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:51 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:51.475776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a783afc-4416-4d9f-9fe5-97af8dfe6b3f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:51.476592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a783afc-4416-4d9f-9fe5-97af8dfe6b3f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:51.482928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a783afc-4416-4d9f-9fe5-97af8dfe6b3f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:51.483469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a783afc-4416-4d9f-9fe5-97af8dfe6b3f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:51.484340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a783afc-4416-4d9f-9fe5-97af8dfe6b3f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:51.484833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a783afc-4416-4d9f-9fe5-97af8dfe6b3f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:51.571738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-afa64977-4e32-48e8-b8ad-70b561e3b3d5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:51.580474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-afa64977-4e32-48e8-b8ad-70b561e3b3d5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.176860 May 23 13:57:51.581101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1072/2228] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:51 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:51.624421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a783afc-4416-4d9f-9fe5-97af8dfe6b3f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:51.632760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a783afc-4416-4d9f-9fe5-97af8dfe6b3f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160837 May 23 13:57:51.633326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1157/2229] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:51 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:52.165915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:52.166507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:52.173021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:52.173463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:52.174213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:52.174643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:52.308212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:52.316864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:52.319474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:52.320674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b774fb3e-c1a9-4430-a3d4-01752f45086d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159388 May 23 13:57:52.321244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1073/2230] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:52 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:52.478226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b63799ef-4acd-49bc-8cf1-57c3c5759bb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:52.478798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b63799ef-4acd-49bc-8cf1-57c3c5759bb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:52.485348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b63799ef-4acd-49bc-8cf1-57c3c5759bb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:52.485794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b63799ef-4acd-49bc-8cf1-57c3c5759bb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:52.486545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b63799ef-4acd-49bc-8cf1-57c3c5759bb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:52.486980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b63799ef-4acd-49bc-8cf1-57c3c5759bb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:52.598225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb1378b2-9f94-4ae5-a621-e7b4600adc82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:52.598873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb1378b2-9f94-4ae5-a621-e7b4600adc82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:52.605856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb1378b2-9f94-4ae5-a621-e7b4600adc82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:52.606306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb1378b2-9f94-4ae5-a621-e7b4600adc82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:52.607076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb1378b2-9f94-4ae5-a621-e7b4600adc82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:52.607523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb1378b2-9f94-4ae5-a621-e7b4600adc82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:52.625219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b63799ef-4acd-49bc-8cf1-57c3c5759bb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:52.634306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b63799ef-4acd-49bc-8cf1-57c3c5759bb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159959 May 23 13:57:52.641953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1158/2231] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:52 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:52.649679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d99f9035-7daf-4671-b898-cf8d736a8ac7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:52.650300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d99f9035-7daf-4671-b898-cf8d736a8ac7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:52.656783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d99f9035-7daf-4671-b898-cf8d736a8ac7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:52.657221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d99f9035-7daf-4671-b898-cf8d736a8ac7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:52.658000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d99f9035-7daf-4671-b898-cf8d736a8ac7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:52.658441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d99f9035-7daf-4671-b898-cf8d736a8ac7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:52.679124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:52.757806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb1378b2-9f94-4ae5-a621-e7b4600adc82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:52.773278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb1378b2-9f94-4ae5-a621-e7b4600adc82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.178447 May 23 13:57:52.774319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1074/2232] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:52 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:52.813706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d99f9035-7daf-4671-b898-cf8d736a8ac7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:52.823282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d99f9035-7daf-4671-b898-cf8d736a8ac7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.177366 May 23 13:57:52.823868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1159/2233] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:52 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:53.339008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:53.339609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:53.346102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:53.346550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:53.347302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:53.347763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:53.482447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:53.491162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:53.492703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:53.494154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c0125ef-5647-4b11-9358-85e61ab19279 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159692 May 23 13:57:53.494714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1075/2234] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:53 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:53.651885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b7056ea-504c-4fd9-92c6-c0da506396cb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:53.652490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b7056ea-504c-4fd9-92c6-c0da506396cb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:53.659091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b7056ea-504c-4fd9-92c6-c0da506396cb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:53.659544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b7056ea-504c-4fd9-92c6-c0da506396cb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:53.660307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b7056ea-504c-4fd9-92c6-c0da506396cb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:53.660782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b7056ea-504c-4fd9-92c6-c0da506396cb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:53.793463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f0e3cdc-51ee-4970-bb45-52867a6e8810 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:53.794682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f0e3cdc-51ee-4970-bb45-52867a6e8810 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:53.796544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b7056ea-504c-4fd9-92c6-c0da506396cb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:53.801321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f0e3cdc-51ee-4970-bb45-52867a6e8810 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:53.801773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f0e3cdc-51ee-4970-bb45-52867a6e8810 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:53.802606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f0e3cdc-51ee-4970-bb45-52867a6e8810 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:53.804153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f0e3cdc-51ee-4970-bb45-52867a6e8810 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:53.805029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b7056ea-504c-4fd9-92c6-c0da506396cb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156817 May 23 13:57:53.805515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1160/2235] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:53 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:53.840887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-23ff3da7-b2e6-4fda-87ef-c9dfcf004bb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:53.841521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-23ff3da7-b2e6-4fda-87ef-c9dfcf004bb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:53.847892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23ff3da7-b2e6-4fda-87ef-c9dfcf004bb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:53.848405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23ff3da7-b2e6-4fda-87ef-c9dfcf004bb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:53.849236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23ff3da7-b2e6-4fda-87ef-c9dfcf004bb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:53.850310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-23ff3da7-b2e6-4fda-87ef-c9dfcf004bb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:53.938749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f0e3cdc-51ee-4970-bb45-52867a6e8810 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:53.947931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f0e3cdc-51ee-4970-bb45-52867a6e8810 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158381 May 23 13:57:53.948508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1076/2236] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:53 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:53.995814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-23ff3da7-b2e6-4fda-87ef-c9dfcf004bb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:54.003952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-23ff3da7-b2e6-4fda-87ef-c9dfcf004bb2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.166917 May 23 13:57:54.004527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1161/2237] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:53 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:54.512246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:54.512909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:54.519895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:54.520341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:54.521136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:54.521559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:54.675027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:54.684649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:54.686770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:54.688175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f8e7dcea-1e51-4d48-bf5a-cc893fc11599 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.179786 May 23 13:57:54.689017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1077/2238] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:54 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:54.823413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb5eed8b-3145-4d5d-9c1c-0ad03f6363d5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:54.823970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb5eed8b-3145-4d5d-9c1c-0ad03f6363d5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:54.830562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb5eed8b-3145-4d5d-9c1c-0ad03f6363d5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:54.831014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb5eed8b-3145-4d5d-9c1c-0ad03f6363d5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:54.831782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb5eed8b-3145-4d5d-9c1c-0ad03f6363d5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:54.832271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb5eed8b-3145-4d5d-9c1c-0ad03f6363d5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:54.973124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e948b0f2-2f82-4ddb-8046-191583713c2f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:54.975793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e948b0f2-2f82-4ddb-8046-191583713c2f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:54.987388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e948b0f2-2f82-4ddb-8046-191583713c2f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:54.988597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e948b0f2-2f82-4ddb-8046-191583713c2f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:54.989621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e948b0f2-2f82-4ddb-8046-191583713c2f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:54.990247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e948b0f2-2f82-4ddb-8046-191583713c2f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:54.992613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb5eed8b-3145-4d5d-9c1c-0ad03f6363d5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:55.003577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb5eed8b-3145-4d5d-9c1c-0ad03f6363d5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.184643 May 23 13:57:55.018557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1162/2239] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:54 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:55.025144 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01f25ecb-776d-444b-86d8-6dff03032170 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:55.025876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-01f25ecb-776d-444b-86d8-6dff03032170 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:55.034400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01f25ecb-776d-444b-86d8-6dff03032170 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:55.035086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01f25ecb-776d-444b-86d8-6dff03032170 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:55.036049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01f25ecb-776d-444b-86d8-6dff03032170 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:55.036581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01f25ecb-776d-444b-86d8-6dff03032170 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:55.142809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e948b0f2-2f82-4ddb-8046-191583713c2f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:55.152613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e948b0f2-2f82-4ddb-8046-191583713c2f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.187518 May 23 13:57:55.162803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1078/2240] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:54 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:55.195827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-01f25ecb-776d-444b-86d8-6dff03032170 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:55.204486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01f25ecb-776d-444b-86d8-6dff03032170 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.184576 May 23 13:57:55.204982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1163/2241] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:55 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:55.296385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-597ee92b-2563-4de8-9f38-5328388a0618 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:55.296977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-597ee92b-2563-4de8-9f38-5328388a0618 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:55.303891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-597ee92b-2563-4de8-9f38-5328388a0618 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:55.304421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-597ee92b-2563-4de8-9f38-5328388a0618 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:55.305274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-597ee92b-2563-4de8-9f38-5328388a0618 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:55.305769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-597ee92b-2563-4de8-9f38-5328388a0618 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:55.338047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-597ee92b-2563-4de8-9f38-5328388a0618 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 13:57:55.700288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-597ee92b-2563-4de8-9f38-5328388a0618 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 204 len: 0 microversion: 2.1 time: 0.407629 May 23 13:57:55.701008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1079/2242] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 13:57:55 2022] DELETE /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 13:57:55.708041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:55.718341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:55.718498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-667ee139-5c01-4ba7-b123-8021b6e87465 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:55.718498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-667ee139-5c01-4ba7-b123-8021b6e87465 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:55.718730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:55.718730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:55.718946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-667ee139-5c01-4ba7-b123-8021b6e87465 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:55.719048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:55.719145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-667ee139-5c01-4ba7-b123-8021b6e87465 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:55.719251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:55.719349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-667ee139-5c01-4ba7-b123-8021b6e87465 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:55.719349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-667ee139-5c01-4ba7-b123-8021b6e87465 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:55.862365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-667ee139-5c01-4ba7-b123-8021b6e87465 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:55.862571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:55.871656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-667ee139-5c01-4ba7-b123-8021b6e87465 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1718 microversion: 2.1 time: 0.166193 May 23 13:57:55.872234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1080/2243] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:55 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:55.873045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:55.874538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:55.875728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-53896ffe-a02e-4714-9ed7-b61efd69766a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.171672 May 23 13:57:55.876268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1164/2244] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:55 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:57:56.029072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-38aad7ea-a6ae-4968-95b6-c88d841481ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:56.029622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-38aad7ea-a6ae-4968-95b6-c88d841481ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:56.035958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38aad7ea-a6ae-4968-95b6-c88d841481ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.036405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38aad7ea-a6ae-4968-95b6-c88d841481ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:56.038129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38aad7ea-a6ae-4968-95b6-c88d841481ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.038636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38aad7ea-a6ae-4968-95b6-c88d841481ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:56.171691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-622d3796-2d2c-4309-b0d0-db974ebfc830 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:56.172426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-622d3796-2d2c-4309-b0d0-db974ebfc830 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:56.181854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-622d3796-2d2c-4309-b0d0-db974ebfc830 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.181854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-622d3796-2d2c-4309-b0d0-db974ebfc830 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:56.181854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-622d3796-2d2c-4309-b0d0-db974ebfc830 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.184396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-622d3796-2d2c-4309-b0d0-db974ebfc830 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:56.188335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-38aad7ea-a6ae-4968-95b6-c88d841481ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:56.199799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-38aad7ea-a6ae-4968-95b6-c88d841481ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.174595 May 23 13:57:56.200390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1081/2245] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:56 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:56.222108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77fdd3fa-307a-4d3d-9028-f41190a1c25f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:56.222988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-77fdd3fa-307a-4d3d-9028-f41190a1c25f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:56.230062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77fdd3fa-307a-4d3d-9028-f41190a1c25f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.230523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77fdd3fa-307a-4d3d-9028-f41190a1c25f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:56.231390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77fdd3fa-307a-4d3d-9028-f41190a1c25f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.231989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77fdd3fa-307a-4d3d-9028-f41190a1c25f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:56.236946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:57:56.331976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-622d3796-2d2c-4309-b0d0-db974ebfc830 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:56.341247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-622d3796-2d2c-4309-b0d0-db974ebfc830 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.173696 May 23 13:57:56.342182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1165/2246] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:56 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:56.380158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-77fdd3fa-307a-4d3d-9028-f41190a1c25f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:56.389815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-77fdd3fa-307a-4d3d-9028-f41190a1c25f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.171889 May 23 13:57:56.393768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1082/2247] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:56 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:56.890937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e686f457-8fc4-4c45-91ea-6ec0215cd60e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:56.891548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e686f457-8fc4-4c45-91ea-6ec0215cd60e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:56.894759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:56.895716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:56.899213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e686f457-8fc4-4c45-91ea-6ec0215cd60e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.899672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e686f457-8fc4-4c45-91ea-6ec0215cd60e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:56.900467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e686f457-8fc4-4c45-91ea-6ec0215cd60e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.900943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e686f457-8fc4-4c45-91ea-6ec0215cd60e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:56.904930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.905596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:56.906813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:56.907507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:57.059987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:57.069583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:57.071648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:57.072993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6727b943-3c74-48c7-8649-171107a53600 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.183108 May 23 13:57:57.073635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1083/2248] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:56 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:57:57.079432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e686f457-8fc4-4c45-91ea-6ec0215cd60e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:57.088313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e686f457-8fc4-4c45-91ea-6ec0215cd60e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1718 microversion: 2.1 time: 0.201404 May 23 13:57:57.089021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1166/2249] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:56 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1718 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:57.219402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f143b80-693c-45d9-9d0e-6e93398777b6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:57.220057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f143b80-693c-45d9-9d0e-6e93398777b6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:57.227199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f143b80-693c-45d9-9d0e-6e93398777b6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:57.227937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f143b80-693c-45d9-9d0e-6e93398777b6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:57.228865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f143b80-693c-45d9-9d0e-6e93398777b6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:57.229184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f143b80-693c-45d9-9d0e-6e93398777b6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:57.359024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-995b18df-e566-4702-9e7c-7e4f7114af3e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:57.360056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-995b18df-e566-4702-9e7c-7e4f7114af3e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:57.369801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f143b80-693c-45d9-9d0e-6e93398777b6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:57.373805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-995b18df-e566-4702-9e7c-7e4f7114af3e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:57.374270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-995b18df-e566-4702-9e7c-7e4f7114af3e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:57.375281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-995b18df-e566-4702-9e7c-7e4f7114af3e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:57.375728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-995b18df-e566-4702-9e7c-7e4f7114af3e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:57.378785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f143b80-693c-45d9-9d0e-6e93398777b6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.163210 May 23 13:57:57.379539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1084/2250] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:57 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:57.408959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e5130a2-6f0f-4b10-9c8a-c037ca412d9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:57.409570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e5130a2-6f0f-4b10-9c8a-c037ca412d9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:57.416542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e5130a2-6f0f-4b10-9c8a-c037ca412d9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:57.417154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e5130a2-6f0f-4b10-9c8a-c037ca412d9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:57.417982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e5130a2-6f0f-4b10-9c8a-c037ca412d9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:57.418411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e5130a2-6f0f-4b10-9c8a-c037ca412d9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:57.581454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e5130a2-6f0f-4b10-9c8a-c037ca412d9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:57.591555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e5130a2-6f0f-4b10-9c8a-c037ca412d9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.186453 May 23 13:57:57.592501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1085/2251] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:57 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:57.911716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-995b18df-e566-4702-9e7c-7e4f7114af3e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:57.920417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-995b18df-e566-4702-9e7c-7e4f7114af3e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.565188 May 23 13:57:57.921208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1167/2252] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:57 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:58.091535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:58.092325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:58.103857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.104731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.106168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.106474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a34368b-3952-47c5-b69b-0465269a219c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:58.106808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.107381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a34368b-3952-47c5-b69b-0465269a219c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:58.114821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a34368b-3952-47c5-b69b-0465269a219c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.116883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a34368b-3952-47c5-b69b-0465269a219c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.117983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a34368b-3952-47c5-b69b-0465269a219c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.118536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a34368b-3952-47c5-b69b-0465269a219c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.291026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:58.298415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a34368b-3952-47c5-b69b-0465269a219c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:58.300256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:58.301833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:58.303483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f74f9d36-fb7e-45c7-8775-4d0a2f5e227c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.215477 May 23 13:57:58.305427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1086/2253] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:58.308588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a34368b-3952-47c5-b69b-0465269a219c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1650 microversion: 2.1 time: 0.206534 May 23 13:57:58.310898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1168/2254] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:58 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1650 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:58.400933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-32b81d9e-ebb5-4eb6-9049-dc0d9bb71b27 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:58.401794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-32b81d9e-ebb5-4eb6-9049-dc0d9bb71b27 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:58.411428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32b81d9e-ebb5-4eb6-9049-dc0d9bb71b27 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.412208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32b81d9e-ebb5-4eb6-9049-dc0d9bb71b27 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.413233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32b81d9e-ebb5-4eb6-9049-dc0d9bb71b27 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.413894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32b81d9e-ebb5-4eb6-9049-dc0d9bb71b27 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.569919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-32b81d9e-ebb5-4eb6-9049-dc0d9bb71b27 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:58.579675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-32b81d9e-ebb5-4eb6-9049-dc0d9bb71b27 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.184100 May 23 13:57:58.580948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1087/2255] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:58 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:58.609837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4db9c90f-0187-456a-be70-82d1fc8895a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:58.610589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4db9c90f-0187-456a-be70-82d1fc8895a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:58.619126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db9c90f-0187-456a-be70-82d1fc8895a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.620043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db9c90f-0187-456a-be70-82d1fc8895a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.621155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db9c90f-0187-456a-be70-82d1fc8895a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.621626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db9c90f-0187-456a-be70-82d1fc8895a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.684841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-b4186d63-b5ef-4159-a335-b5703f8b59a7 req-337a173b-f5a7-4ab7-909f-c49e260c851a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2618bd92-79d0-43b5-8067-c26548f759c3", "name": "network-vif-deleted", "tag": "d30d25db-4d2c-4301-908b-bb216ff079eb"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:57:58.696089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b4186d63-b5ef-4159-a335-b5703f8b59a7 req-337a173b-f5a7-4ab7-909f-c49e260c851a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.697475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b4186d63-b5ef-4159-a335-b5703f8b59a7 req-337a173b-f5a7-4ab7-909f-c49e260c851a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.715080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-b4186d63-b5ef-4159-a335-b5703f8b59a7 req-337a173b-f5a7-4ab7-909f-c49e260c851a service nova] Creating event network-vif-deleted:d30d25db-4d2c-4301-908b-bb216ff079eb for instance 2618bd92-79d0-43b5-8067-c26548f759c3 on hv-cinder-82549 May 23 13:57:58.721238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-b4186d63-b5ef-4159-a335-b5703f8b59a7 req-337a173b-f5a7-4ab7-909f-c49e260c851a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121878 May 23 13:57:58.722257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1169/2256] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:57:58.846959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4db9c90f-0187-456a-be70-82d1fc8895a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:58.856547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4db9c90f-0187-456a-be70-82d1fc8895a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.250947 May 23 13:57:58.857382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1088/2257] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:58 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:58.948351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d772433e-a567-4bf8-a586-ce2b17cca0e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:58.949134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d772433e-a567-4bf8-a586-ce2b17cca0e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:58.955629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d772433e-a567-4bf8-a586-ce2b17cca0e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.956086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d772433e-a567-4bf8-a586-ce2b17cca0e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:58.956907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d772433e-a567-4bf8-a586-ce2b17cca0e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:58.957339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d772433e-a567-4bf8-a586-ce2b17cca0e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:59.112139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d772433e-a567-4bf8-a586-ce2b17cca0e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:59.121315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d772433e-a567-4bf8-a586-ce2b17cca0e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.178676 May 23 13:57:59.125134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1170/2258] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:58 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:59.322641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:59.323330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:59.330074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a93aedac-d652-46b5-8c89-990b6b1406e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:59.330958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a93aedac-d652-46b5-8c89-990b6b1406e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:59.331072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:59.331174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:59.331919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:59.332420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:59.337695 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a93aedac-d652-46b5-8c89-990b6b1406e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:59.338148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a93aedac-d652-46b5-8c89-990b6b1406e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:59.338930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a93aedac-d652-46b5-8c89-990b6b1406e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:59.339561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a93aedac-d652-46b5-8c89-990b6b1406e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:59.421632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a93aedac-d652-46b5-8c89-990b6b1406e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:59.433691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a93aedac-d652-46b5-8c89-990b6b1406e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.107294 May 23 13:57:59.434561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1171/2259] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:59 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:57:59.491469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:59.496345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:59.497985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:59.499192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f11ab955-3d09-48ce-9f15-4ddf2363ddc7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.180892 May 23 13:57:59.499755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1089/2260] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:57:59 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:57:59.598284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-35581aa5-5a68-4a71-a1a0-594b15f4d0da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:59.598909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-35581aa5-5a68-4a71-a1a0-594b15f4d0da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:59.605948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35581aa5-5a68-4a71-a1a0-594b15f4d0da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:59.606408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35581aa5-5a68-4a71-a1a0-594b15f4d0da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:59.607184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35581aa5-5a68-4a71-a1a0-594b15f4d0da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:59.607627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-35581aa5-5a68-4a71-a1a0-594b15f4d0da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:59.753373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-35581aa5-5a68-4a71-a1a0-594b15f4d0da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:57:59.761931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-35581aa5-5a68-4a71-a1a0-594b15f4d0da tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.167501 May 23 13:57:59.762499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1172/2261] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:59 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:57:59.875997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-503910ca-9190-47a4-a39f-c2938842e046 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:57:59.886316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-503910ca-9190-47a4-a39f-c2938842e046 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:57:59.886316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-503910ca-9190-47a4-a39f-c2938842e046 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:59.886316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-503910ca-9190-47a4-a39f-c2938842e046 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:57:59.886316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-503910ca-9190-47a4-a39f-c2938842e046 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:57:59.886729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-503910ca-9190-47a4-a39f-c2938842e046 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:00.024187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-503910ca-9190-47a4-a39f-c2938842e046 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:00.034093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-503910ca-9190-47a4-a39f-c2938842e046 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162795 May 23 13:58:00.034675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1090/2262] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:57:59 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:00.139518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b74674c5-1530-4058-80dc-c3c6a8368981 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:00.140062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b74674c5-1530-4058-80dc-c3c6a8368981 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:00.146869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74674c5-1530-4058-80dc-c3c6a8368981 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:00.147594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74674c5-1530-4058-80dc-c3c6a8368981 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:00.148410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74674c5-1530-4058-80dc-c3c6a8368981 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:00.148896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74674c5-1530-4058-80dc-c3c6a8368981 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:00.292601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b74674c5-1530-4058-80dc-c3c6a8368981 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:00.300712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b74674c5-1530-4058-80dc-c3c6a8368981 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165167 May 23 13:58:00.301280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1173/2263] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:00 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:00.451463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1fb4f87d-825b-42e6-aac5-58b3dc957c32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:00.452125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1fb4f87d-825b-42e6-aac5-58b3dc957c32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:00.458519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1fb4f87d-825b-42e6-aac5-58b3dc957c32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:00.459006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1fb4f87d-825b-42e6-aac5-58b3dc957c32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:00.459788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1fb4f87d-825b-42e6-aac5-58b3dc957c32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:00.460217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1fb4f87d-825b-42e6-aac5-58b3dc957c32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:00.518111 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:00.518682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:00.524243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1fb4f87d-825b-42e6-aac5-58b3dc957c32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:00.525829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:00.526290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:00.527091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:00.527565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:00.532232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1fb4f87d-825b-42e6-aac5-58b3dc957c32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084780 May 23 13:58:00.532830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1091/2264] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:00 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:00.666507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:00.675501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:00.677095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:00.678988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-42503c9f-a72f-4548-8a80-c7e4c113f988 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.164880 May 23 13:58:00.679569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1174/2265] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:00.779415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4a591491-4f2f-4eee-9757-6794d252a0ef tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:00.779941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4a591491-4f2f-4eee-9757-6794d252a0ef tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:00.786127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a591491-4f2f-4eee-9757-6794d252a0ef tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:00.786579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a591491-4f2f-4eee-9757-6794d252a0ef tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:00.788028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a591491-4f2f-4eee-9757-6794d252a0ef tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:00.788469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a591491-4f2f-4eee-9757-6794d252a0ef tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:00.925931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4a591491-4f2f-4eee-9757-6794d252a0ef tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:00.934929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4a591491-4f2f-4eee-9757-6794d252a0ef tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159429 May 23 13:58:00.935513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1092/2266] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:00 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:01.051521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c77212c1-a802-465d-945e-5a5f0db5a3ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:01.052055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c77212c1-a802-465d-945e-5a5f0db5a3ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:01.059077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c77212c1-a802-465d-945e-5a5f0db5a3ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.059533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c77212c1-a802-465d-945e-5a5f0db5a3ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:01.060315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c77212c1-a802-465d-945e-5a5f0db5a3ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.060794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c77212c1-a802-465d-945e-5a5f0db5a3ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:01.203910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c77212c1-a802-465d-945e-5a5f0db5a3ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:01.213092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c77212c1-a802-465d-945e-5a5f0db5a3ea tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.165507 May 23 13:58:01.213688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1175/2267] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:01 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:01.319972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c4f621f-54f0-4106-8414-cec6443e632e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:01.320503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c4f621f-54f0-4106-8414-cec6443e632e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:01.327041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c4f621f-54f0-4106-8414-cec6443e632e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.327480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c4f621f-54f0-4106-8414-cec6443e632e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:01.328252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c4f621f-54f0-4106-8414-cec6443e632e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.328716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c4f621f-54f0-4106-8414-cec6443e632e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:01.477641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3c4f621f-54f0-4106-8414-cec6443e632e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:01.486325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3c4f621f-54f0-4106-8414-cec6443e632e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.171349 May 23 13:58:01.486937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1093/2268] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:01 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:01.550557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f77667d3-6f07-43cb-bea8-c0d327fae04e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:01.551341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f77667d3-6f07-43cb-bea8-c0d327fae04e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:01.558171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f77667d3-6f07-43cb-bea8-c0d327fae04e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.558630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f77667d3-6f07-43cb-bea8-c0d327fae04e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:01.559417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f77667d3-6f07-43cb-bea8-c0d327fae04e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.559857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f77667d3-6f07-43cb-bea8-c0d327fae04e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:01.625590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f77667d3-6f07-43cb-bea8-c0d327fae04e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:01.628794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:01.637584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f77667d3-6f07-43cb-bea8-c0d327fae04e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089888 May 23 13:58:01.643374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1176/2269] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:01 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:01.698155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:01.698768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:01.705568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.706017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:01.706786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.707220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:01.839054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:01.847533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:01.849076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:01.850426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f53d59d6-252f-4a4b-842a-af2998341776 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.156313 May 23 13:58:01.851068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1094/2270] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:01 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:01.953359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-27c8bbf4-f5d9-4f11-86da-48df75c6b9b7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:01.953891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-27c8bbf4-f5d9-4f11-86da-48df75c6b9b7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:01.961088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27c8bbf4-f5d9-4f11-86da-48df75c6b9b7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.961550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27c8bbf4-f5d9-4f11-86da-48df75c6b9b7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:01.962332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27c8bbf4-f5d9-4f11-86da-48df75c6b9b7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:01.962775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27c8bbf4-f5d9-4f11-86da-48df75c6b9b7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:02.103599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27c8bbf4-f5d9-4f11-86da-48df75c6b9b7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:02.112115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-27c8bbf4-f5d9-4f11-86da-48df75c6b9b7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.162794 May 23 13:58:02.112718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1177/2271] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:01 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:02.230932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59d73fac-4acc-41b4-b011-0cc99baee225 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:02.231463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59d73fac-4acc-41b4-b011-0cc99baee225 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:02.238077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59d73fac-4acc-41b4-b011-0cc99baee225 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:02.238523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59d73fac-4acc-41b4-b011-0cc99baee225 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:02.239284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59d73fac-4acc-41b4-b011-0cc99baee225 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:02.239717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59d73fac-4acc-41b4-b011-0cc99baee225 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:02.379603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59d73fac-4acc-41b4-b011-0cc99baee225 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:02.387978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59d73fac-4acc-41b4-b011-0cc99baee225 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160990 May 23 13:58:02.388655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1095/2272] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:02 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:02.503650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-997186e4-5186-4846-8810-cb55f437f2a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:02.504200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-997186e4-5186-4846-8810-cb55f437f2a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:02.511066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-997186e4-5186-4846-8810-cb55f437f2a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:02.511521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-997186e4-5186-4846-8810-cb55f437f2a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:02.512295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-997186e4-5186-4846-8810-cb55f437f2a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:02.512774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-997186e4-5186-4846-8810-cb55f437f2a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:02.644612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-997186e4-5186-4846-8810-cb55f437f2a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:02.653749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-997186e4-5186-4846-8810-cb55f437f2a2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.153947 May 23 13:58:02.654586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1178/2273] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:02 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:02.658964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b163329-24c1-4ee3-a3b5-02a37464d657 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:02.660193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b163329-24c1-4ee3-a3b5-02a37464d657 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:02.667591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b163329-24c1-4ee3-a3b5-02a37464d657 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:02.668043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b163329-24c1-4ee3-a3b5-02a37464d657 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:02.668845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b163329-24c1-4ee3-a3b5-02a37464d657 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:02.669277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b163329-24c1-4ee3-a3b5-02a37464d657 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:02.737217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b163329-24c1-4ee3-a3b5-02a37464d657 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:02.751296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b163329-24c1-4ee3-a3b5-02a37464d657 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.096493 May 23 13:58:02.751949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1096/2274] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:02 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:02.868155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:02.868786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:02.874988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:02.875433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:02.876191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:02.876645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:03.017490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:03.034034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:03.035596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:03.037098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-59aac4e1-9488-421c-a1c0-846b00bed499 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.172798 May 23 13:58:03.037728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1179/2275] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:02 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:03.129903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7a90b0a-54d2-406b-80e1-2050e25d12ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:03.130466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7a90b0a-54d2-406b-80e1-2050e25d12ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:03.137415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7a90b0a-54d2-406b-80e1-2050e25d12ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:03.137868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7a90b0a-54d2-406b-80e1-2050e25d12ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:03.138629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7a90b0a-54d2-406b-80e1-2050e25d12ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:03.139060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7a90b0a-54d2-406b-80e1-2050e25d12ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:03.272805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7a90b0a-54d2-406b-80e1-2050e25d12ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:03.281553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7a90b0a-54d2-406b-80e1-2050e25d12ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155625 May 23 13:58:03.282163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1097/2276] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:03 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:03.407577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d35b2f73-cbcf-4a1c-9f22-ab7aea501bc6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:03.408114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d35b2f73-cbcf-4a1c-9f22-ab7aea501bc6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:03.415333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d35b2f73-cbcf-4a1c-9f22-ab7aea501bc6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:03.415779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d35b2f73-cbcf-4a1c-9f22-ab7aea501bc6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:03.416555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d35b2f73-cbcf-4a1c-9f22-ab7aea501bc6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:03.417006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d35b2f73-cbcf-4a1c-9f22-ab7aea501bc6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:03.555057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d35b2f73-cbcf-4a1c-9f22-ab7aea501bc6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:03.563258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d35b2f73-cbcf-4a1c-9f22-ab7aea501bc6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159613 May 23 13:58:03.563828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1180/2277] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:03 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:03.672322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d5c40d68-c0bc-4710-8edd-1c1e801a4688 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:03.672892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d5c40d68-c0bc-4710-8edd-1c1e801a4688 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:03.680243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5c40d68-c0bc-4710-8edd-1c1e801a4688 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:03.680768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5c40d68-c0bc-4710-8edd-1c1e801a4688 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:03.681682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5c40d68-c0bc-4710-8edd-1c1e801a4688 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:03.682108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5c40d68-c0bc-4710-8edd-1c1e801a4688 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:03.769106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3b25dd52-2bcb-45a7-a09b-19320fd63218 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:03.769777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3b25dd52-2bcb-45a7-a09b-19320fd63218 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:03.777369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b25dd52-2bcb-45a7-a09b-19320fd63218 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:03.777826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b25dd52-2bcb-45a7-a09b-19320fd63218 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:03.778609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b25dd52-2bcb-45a7-a09b-19320fd63218 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:03.779051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b25dd52-2bcb-45a7-a09b-19320fd63218 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:03.820137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d5c40d68-c0bc-4710-8edd-1c1e801a4688 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:03.823777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:03.828767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d5c40d68-c0bc-4710-8edd-1c1e801a4688 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160505 May 23 13:58:03.829363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1098/2278] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:03 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:03.846317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b25dd52-2bcb-45a7-a09b-19320fd63218 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:03.855818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3b25dd52-2bcb-45a7-a09b-19320fd63218 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089987 May 23 13:58:03.856428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1181/2279] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:03 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:04.056921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:04.057440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:04.064005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.064448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.065223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.065651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.205313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:04.214868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:04.215953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:04.217218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2dd0f91-bc71-4bb5-9dd9-c723d1715137 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.165284 May 23 13:58:04.217777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1099/2280] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:04 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:04.299254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77bf5f0e-4a27-437d-9175-c8081350d91b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:04.299876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-77bf5f0e-4a27-437d-9175-c8081350d91b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:04.307193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77bf5f0e-4a27-437d-9175-c8081350d91b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.307574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77bf5f0e-4a27-437d-9175-c8081350d91b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.308349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77bf5f0e-4a27-437d-9175-c8081350d91b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.308824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77bf5f0e-4a27-437d-9175-c8081350d91b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.447769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77bf5f0e-4a27-437d-9175-c8081350d91b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:04.456423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77bf5f0e-4a27-437d-9175-c8081350d91b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160976 May 23 13:58:04.457121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1182/2281] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:04 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:04.581928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0b12b4a7-e458-45d2-aede-a6e1e639fa33 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:04.582583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0b12b4a7-e458-45d2-aede-a6e1e639fa33 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:04.590291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b12b4a7-e458-45d2-aede-a6e1e639fa33 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.590748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b12b4a7-e458-45d2-aede-a6e1e639fa33 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.591528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b12b4a7-e458-45d2-aede-a6e1e639fa33 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.591964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b12b4a7-e458-45d2-aede-a6e1e639fa33 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.729641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0b12b4a7-e458-45d2-aede-a6e1e639fa33 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:04.738016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0b12b4a7-e458-45d2-aede-a6e1e639fa33 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160123 May 23 13:58:04.738593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1100/2282] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:04 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:04.852236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-67e007d3-1829-44ea-b2ff-73fd13e0a5f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:04.852902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-67e007d3-1829-44ea-b2ff-73fd13e0a5f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:04.859583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67e007d3-1829-44ea-b2ff-73fd13e0a5f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.860055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67e007d3-1829-44ea-b2ff-73fd13e0a5f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.860846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67e007d3-1829-44ea-b2ff-73fd13e0a5f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.861286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-67e007d3-1829-44ea-b2ff-73fd13e0a5f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.872060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e7a99e9a-4771-405c-a96f-ca535dfc77cf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:04.872695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e7a99e9a-4771-405c-a96f-ca535dfc77cf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:04.879163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7a99e9a-4771-405c-a96f-ca535dfc77cf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.879607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7a99e9a-4771-405c-a96f-ca535dfc77cf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.880376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7a99e9a-4771-405c-a96f-ca535dfc77cf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:04.881425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7a99e9a-4771-405c-a96f-ca535dfc77cf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:04.949530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e7a99e9a-4771-405c-a96f-ca535dfc77cf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:04.958037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e7a99e9a-4771-405c-a96f-ca535dfc77cf tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089775 May 23 13:58:04.958748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1101/2283] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:04 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:05.017631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-67e007d3-1829-44ea-b2ff-73fd13e0a5f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:05.026714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-67e007d3-1829-44ea-b2ff-73fd13e0a5f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.178763 May 23 13:58:05.027301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1183/2284] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:04 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:05.236602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:05.237232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:05.245330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:05.245799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:05.246573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:05.247012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:05.400125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:05.408839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:05.410350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:05.412653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d892eae-b765-4548-9446-f9cfc444f8de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.179977 May 23 13:58:05.413226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1102/2285] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:05 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:05.473622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-84139cbf-b4d7-4dd0-b925-d496486b7b6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:05.474865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-84139cbf-b4d7-4dd0-b925-d496486b7b6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:05.481448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84139cbf-b4d7-4dd0-b925-d496486b7b6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:05.481904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84139cbf-b4d7-4dd0-b925-d496486b7b6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:05.482700 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84139cbf-b4d7-4dd0-b925-d496486b7b6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:05.483143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84139cbf-b4d7-4dd0-b925-d496486b7b6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:05.619479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84139cbf-b4d7-4dd0-b925-d496486b7b6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:05.627771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-84139cbf-b4d7-4dd0-b925-d496486b7b6b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158127 May 23 13:58:05.628342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1184/2286] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:05 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:05.756275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-973a8b7d-01ee-4cf2-a44d-da972e3791f0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:05.757011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-973a8b7d-01ee-4cf2-a44d-da972e3791f0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:05.763425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-973a8b7d-01ee-4cf2-a44d-da972e3791f0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:05.763876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-973a8b7d-01ee-4cf2-a44d-da972e3791f0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:05.764656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-973a8b7d-01ee-4cf2-a44d-da972e3791f0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:05.765091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-973a8b7d-01ee-4cf2-a44d-da972e3791f0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:05.978955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b89717c-f4cd-4a82-bcfe-9a60eb108cf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:05.979649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b89717c-f4cd-4a82-bcfe-9a60eb108cf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:05.990110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b89717c-f4cd-4a82-bcfe-9a60eb108cf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:05.990942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b89717c-f4cd-4a82-bcfe-9a60eb108cf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:05.992308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b89717c-f4cd-4a82-bcfe-9a60eb108cf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:05.993141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b89717c-f4cd-4a82-bcfe-9a60eb108cf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:06.068737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b89717c-f4cd-4a82-bcfe-9a60eb108cf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:06.075169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b89717c-f4cd-4a82-bcfe-9a60eb108cf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.103008 May 23 13:58:06.075756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1185/2287] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:05 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:06.080502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-211b155a-0804-4089-8764-c4299d01f118 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:06.081140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-211b155a-0804-4089-8764-c4299d01f118 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:06.089012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-211b155a-0804-4089-8764-c4299d01f118 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:06.089527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-211b155a-0804-4089-8764-c4299d01f118 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:06.090634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-973a8b7d-01ee-4cf2-a44d-da972e3791f0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:06.090780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-211b155a-0804-4089-8764-c4299d01f118 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:06.091296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-211b155a-0804-4089-8764-c4299d01f118 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:06.098781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-973a8b7d-01ee-4cf2-a44d-da972e3791f0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.346958 May 23 13:58:06.102151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1103/2288] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:05 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:06.247407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-211b155a-0804-4089-8764-c4299d01f118 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:06.262710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-211b155a-0804-4089-8764-c4299d01f118 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.185706 May 23 13:58:06.263344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1186/2289] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:06 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:06.434560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:06.435176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:06.441573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:06.442021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:06.443610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:06.444050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:06.586312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:06.595418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:06.597266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:06.598484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e0f1928b-99c9-4195-8253-9081498475e1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.167926 May 23 13:58:06.599084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1104/2290] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:06 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:06.645454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e99b931-fb81-4dce-a1d1-f8f2199847c5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:06.646889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e99b931-fb81-4dce-a1d1-f8f2199847c5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:06.653595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e99b931-fb81-4dce-a1d1-f8f2199847c5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:06.654054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e99b931-fb81-4dce-a1d1-f8f2199847c5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:06.654831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e99b931-fb81-4dce-a1d1-f8f2199847c5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:06.655275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e99b931-fb81-4dce-a1d1-f8f2199847c5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:06.792287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e99b931-fb81-4dce-a1d1-f8f2199847c5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:06.800734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e99b931-fb81-4dce-a1d1-f8f2199847c5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159057 May 23 13:58:06.801329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1187/2291] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:06 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:07.093676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-107b4fef-7090-4e00-99f6-a2171815dde3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:07.094194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-107b4fef-7090-4e00-99f6-a2171815dde3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:07.101367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-107b4fef-7090-4e00-99f6-a2171815dde3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.101817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-107b4fef-7090-4e00-99f6-a2171815dde3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.102571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-107b4fef-7090-4e00-99f6-a2171815dde3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.103002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-107b4fef-7090-4e00-99f6-a2171815dde3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.118003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e3186dde-7da9-4b33-bb7e-c2ae5aa2ae6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:07.118618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e3186dde-7da9-4b33-bb7e-c2ae5aa2ae6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:07.125063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3186dde-7da9-4b33-bb7e-c2ae5aa2ae6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.125516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3186dde-7da9-4b33-bb7e-c2ae5aa2ae6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.126275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3186dde-7da9-4b33-bb7e-c2ae5aa2ae6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.126712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3186dde-7da9-4b33-bb7e-c2ae5aa2ae6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.166205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-107b4fef-7090-4e00-99f6-a2171815dde3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:07.174458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-107b4fef-7090-4e00-99f6-a2171815dde3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084624 May 23 13:58:07.175223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1105/2292] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:07 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:07.269730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e3186dde-7da9-4b33-bb7e-c2ae5aa2ae6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:07.278534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e3186dde-7da9-4b33-bb7e-c2ae5aa2ae6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164936 May 23 13:58:07.279107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1188/2293] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:07 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:07.280315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e69bffa3-78f2-4953-99e4-1b6340ed802a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:07.281150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e69bffa3-78f2-4953-99e4-1b6340ed802a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:07.287726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e69bffa3-78f2-4953-99e4-1b6340ed802a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.288236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e69bffa3-78f2-4953-99e4-1b6340ed802a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.289040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e69bffa3-78f2-4953-99e4-1b6340ed802a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.289471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e69bffa3-78f2-4953-99e4-1b6340ed802a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.419999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e69bffa3-78f2-4953-99e4-1b6340ed802a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:07.428873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e69bffa3-78f2-4953-99e4-1b6340ed802a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.152457 May 23 13:58:07.429434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1106/2294] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:07 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:07.617872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:07.618537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:07.624652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.625107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.625880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.626327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.763799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:07.772933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:07.774462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:07.775640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-14e959d8-99e2-4182-956a-04b30aeb7232 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.162218 May 23 13:58:07.776200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1189/2295] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:07 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:07.819906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5ca2a90c-6961-4c00-aae2-fdfcc7927361 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:07.820521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5ca2a90c-6961-4c00-aae2-fdfcc7927361 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:07.826629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ca2a90c-6961-4c00-aae2-fdfcc7927361 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.827069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ca2a90c-6961-4c00-aae2-fdfcc7927361 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.827836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ca2a90c-6961-4c00-aae2-fdfcc7927361 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:07.828270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ca2a90c-6961-4c00-aae2-fdfcc7927361 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:07.964475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5ca2a90c-6961-4c00-aae2-fdfcc7927361 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:07.972549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5ca2a90c-6961-4c00-aae2-fdfcc7927361 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.157735 May 23 13:58:07.973135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1107/2296] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:07 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:08.191684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d597cc33-4a54-48c6-9c35-3870e3c2e5a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:08.194061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d597cc33-4a54-48c6-9c35-3870e3c2e5a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:08.199430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d597cc33-4a54-48c6-9c35-3870e3c2e5a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.199925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d597cc33-4a54-48c6-9c35-3870e3c2e5a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:08.200796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d597cc33-4a54-48c6-9c35-3870e3c2e5a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.201271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d597cc33-4a54-48c6-9c35-3870e3c2e5a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:08.266541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d597cc33-4a54-48c6-9c35-3870e3c2e5a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:08.274883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d597cc33-4a54-48c6-9c35-3870e3c2e5a4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087009 May 23 13:58:08.275456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1190/2297] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:08 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:08.296805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-724d999b-1247-401c-b440-e293c60ad2ee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:08.297473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-724d999b-1247-401c-b440-e293c60ad2ee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:08.304734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-724d999b-1247-401c-b440-e293c60ad2ee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.305185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-724d999b-1247-401c-b440-e293c60ad2ee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:08.305936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-724d999b-1247-401c-b440-e293c60ad2ee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.306373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-724d999b-1247-401c-b440-e293c60ad2ee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:08.438326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-724d999b-1247-401c-b440-e293c60ad2ee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:08.446164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-18281deb-d1d0-4c8a-9780-473c193c68a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:08.446793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-18281deb-d1d0-4c8a-9780-473c193c68a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:08.447089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-724d999b-1247-401c-b440-e293c60ad2ee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154131 May 23 13:58:08.447662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1108/2298] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:08 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:08.452980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18281deb-d1d0-4c8a-9780-473c193c68a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.453440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18281deb-d1d0-4c8a-9780-473c193c68a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:08.454204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18281deb-d1d0-4c8a-9780-473c193c68a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.454645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18281deb-d1d0-4c8a-9780-473c193c68a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:08.597614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-18281deb-d1d0-4c8a-9780-473c193c68a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:08.606012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-18281deb-d1d0-4c8a-9780-473c193c68a4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.164505 May 23 13:58:08.606595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1191/2299] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:08 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:08.795216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:08.795748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:08.804047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.804804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:08.805633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.806144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:08.953783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:08.962541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:08.964038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:08.965236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1f79ef7e-a764-4345-9064-fb421a64b5ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.174114 May 23 13:58:08.965790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1109/2300] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:08 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:08.991291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d951663b-eb57-4165-b722-50297addffd4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:08.991900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d951663b-eb57-4165-b722-50297addffd4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:08.998089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d951663b-eb57-4165-b722-50297addffd4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.998542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d951663b-eb57-4165-b722-50297addffd4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:08.999348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d951663b-eb57-4165-b722-50297addffd4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:08.999780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d951663b-eb57-4165-b722-50297addffd4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:09.132877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d951663b-eb57-4165-b722-50297addffd4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:09.140844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d951663b-eb57-4165-b722-50297addffd4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.154211 May 23 13:58:09.141416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1192/2301] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:08 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:09.292873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-69af49dd-5e27-45ee-995f-12e879de3f3e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:09.293490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-69af49dd-5e27-45ee-995f-12e879de3f3e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:09.299641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69af49dd-5e27-45ee-995f-12e879de3f3e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:09.300227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69af49dd-5e27-45ee-995f-12e879de3f3e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:09.300868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69af49dd-5e27-45ee-995f-12e879de3f3e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:09.301307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69af49dd-5e27-45ee-995f-12e879de3f3e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:09.366583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-69af49dd-5e27-45ee-995f-12e879de3f3e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:09.374490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-69af49dd-5e27-45ee-995f-12e879de3f3e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085524 May 23 13:58:09.375043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1110/2302] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:09 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:09.464771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56869e57-46ea-45f6-b55b-0d0a990a3161 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:09.465420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56869e57-46ea-45f6-b55b-0d0a990a3161 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:09.472416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56869e57-46ea-45f6-b55b-0d0a990a3161 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:09.472929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56869e57-46ea-45f6-b55b-0d0a990a3161 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:09.473897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56869e57-46ea-45f6-b55b-0d0a990a3161 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:09.474562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56869e57-46ea-45f6-b55b-0d0a990a3161 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:09.493187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:09.610170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56869e57-46ea-45f6-b55b-0d0a990a3161 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:09.619536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56869e57-46ea-45f6-b55b-0d0a990a3161 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158548 May 23 13:58:09.620039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1193/2303] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:09 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:09.623422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e8c82ba-348c-428f-90cc-9bbc3b0ec48c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:09.624036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e8c82ba-348c-428f-90cc-9bbc3b0ec48c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:09.630177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e8c82ba-348c-428f-90cc-9bbc3b0ec48c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:09.630707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e8c82ba-348c-428f-90cc-9bbc3b0ec48c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:09.631389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e8c82ba-348c-428f-90cc-9bbc3b0ec48c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:09.632001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e8c82ba-348c-428f-90cc-9bbc3b0ec48c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:09.764531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e8c82ba-348c-428f-90cc-9bbc3b0ec48c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:09.773295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e8c82ba-348c-428f-90cc-9bbc3b0ec48c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.153620 May 23 13:58:09.773910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1111/2304] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:09 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:09.983913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:09.984445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:09.991012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:09.991467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:09.992250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:09.992720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:10.132657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:10.142495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:10.144046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:10.145236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff62b485-4efa-4e1a-9871-21ce109ea9bf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.165602 May 23 13:58:10.146300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1194/2305] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:09 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:10.158372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d88a0da-445c-466f-9562-27b1498cd2f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:10.158986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d88a0da-445c-466f-9562-27b1498cd2f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:10.166472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d88a0da-445c-466f-9562-27b1498cd2f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:10.166922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d88a0da-445c-466f-9562-27b1498cd2f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:10.167680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d88a0da-445c-466f-9562-27b1498cd2f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:10.168110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d88a0da-445c-466f-9562-27b1498cd2f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:10.310799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d88a0da-445c-466f-9562-27b1498cd2f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:10.319619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d88a0da-445c-466f-9562-27b1498cd2f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165104 May 23 13:58:10.320329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1112/2306] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:10 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:10.391223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c5dcecce-0ba1-4c03-a811-81b245fc9eed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:10.391878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c5dcecce-0ba1-4c03-a811-81b245fc9eed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:10.398662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5dcecce-0ba1-4c03-a811-81b245fc9eed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:10.399136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5dcecce-0ba1-4c03-a811-81b245fc9eed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:10.399909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5dcecce-0ba1-4c03-a811-81b245fc9eed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:10.400358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5dcecce-0ba1-4c03-a811-81b245fc9eed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:10.461562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c5dcecce-0ba1-4c03-a811-81b245fc9eed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:10.469461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c5dcecce-0ba1-4c03-a811-81b245fc9eed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.082113 May 23 13:58:10.470037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1195/2307] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:10 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:10.637539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb54627f-f7cb-4bf3-9926-93d1324ec21f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:10.638163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb54627f-f7cb-4bf3-9926-93d1324ec21f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:10.644317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb54627f-f7cb-4bf3-9926-93d1324ec21f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:10.644790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb54627f-f7cb-4bf3-9926-93d1324ec21f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:10.645564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb54627f-f7cb-4bf3-9926-93d1324ec21f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:10.646018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb54627f-f7cb-4bf3-9926-93d1324ec21f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:10.777434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb54627f-f7cb-4bf3-9926-93d1324ec21f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:10.785599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb54627f-f7cb-4bf3-9926-93d1324ec21f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152076 May 23 13:58:10.786372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1113/2308] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:10 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:10.792948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f46adaf8-d14f-4377-bb20-77fb8e6257e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:10.793580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f46adaf8-d14f-4377-bb20-77fb8e6257e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:10.805030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f46adaf8-d14f-4377-bb20-77fb8e6257e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:10.805487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f46adaf8-d14f-4377-bb20-77fb8e6257e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:10.806255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f46adaf8-d14f-4377-bb20-77fb8e6257e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:10.806693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f46adaf8-d14f-4377-bb20-77fb8e6257e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:10.949060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f46adaf8-d14f-4377-bb20-77fb8e6257e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:10.957159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f46adaf8-d14f-4377-bb20-77fb8e6257e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.170517 May 23 13:58:10.957736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1196/2309] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:10 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:11.164519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:11.165073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:11.173670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.174365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:11.175565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.176283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:11.339668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a95119d-8a33-4426-8c6a-a88dca470d08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:11.340822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a95119d-8a33-4426-8c6a-a88dca470d08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:11.350265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a95119d-8a33-4426-8c6a-a88dca470d08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.351443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a95119d-8a33-4426-8c6a-a88dca470d08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:11.351644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:11.352779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a95119d-8a33-4426-8c6a-a88dca470d08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.353519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a95119d-8a33-4426-8c6a-a88dca470d08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:11.366750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:11.369595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:11.371646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-072f94c9-5407-40c5-a8f3-cbb4d359078a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.211751 May 23 13:58:11.372595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1114/2310] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:11.488627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a94f654-0fdf-4c8a-9dfe-ef95345c50c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:11.489299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a94f654-0fdf-4c8a-9dfe-ef95345c50c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:11.498995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a94f654-0fdf-4c8a-9dfe-ef95345c50c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.499441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a94f654-0fdf-4c8a-9dfe-ef95345c50c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:11.500468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a94f654-0fdf-4c8a-9dfe-ef95345c50c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.501283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a94f654-0fdf-4c8a-9dfe-ef95345c50c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:11.503760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a95119d-8a33-4426-8c6a-a88dca470d08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:11.512890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a95119d-8a33-4426-8c6a-a88dca470d08 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.177644 May 23 13:58:11.513354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1197/2311] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:11 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:11.528269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:11.578427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a94f654-0fdf-4c8a-9dfe-ef95345c50c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:11.603473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a94f654-0fdf-4c8a-9dfe-ef95345c50c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.121084 May 23 13:58:11.604044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1115/2312] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:11 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:11.803690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-850b49dd-1e17-48b7-aff4-b5b6283c4dcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:11.804229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-850b49dd-1e17-48b7-aff4-b5b6283c4dcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:11.811041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-850b49dd-1e17-48b7-aff4-b5b6283c4dcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.811496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-850b49dd-1e17-48b7-aff4-b5b6283c4dcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:11.812277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-850b49dd-1e17-48b7-aff4-b5b6283c4dcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.812828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-850b49dd-1e17-48b7-aff4-b5b6283c4dcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:11.971976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-850b49dd-1e17-48b7-aff4-b5b6283c4dcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:11.979972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cce5d349-fa6c-4d19-bdf1-c9df6b95f126 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:11.981187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cce5d349-fa6c-4d19-bdf1-c9df6b95f126 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:11.981337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-850b49dd-1e17-48b7-aff4-b5b6283c4dcd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.182019 May 23 13:58:11.981782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1198/2313] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:11 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:11.992640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cce5d349-fa6c-4d19-bdf1-c9df6b95f126 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.993438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cce5d349-fa6c-4d19-bdf1-c9df6b95f126 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:11.994857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cce5d349-fa6c-4d19-bdf1-c9df6b95f126 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:11.995646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cce5d349-fa6c-4d19-bdf1-c9df6b95f126 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:12.170028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cce5d349-fa6c-4d19-bdf1-c9df6b95f126 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:12.179317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cce5d349-fa6c-4d19-bdf1-c9df6b95f126 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.207147 May 23 13:58:12.179897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1116/2314] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:11 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:12.391193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:12.391742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:12.398326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:12.398782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:12.399604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:12.400049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:12.532396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0acfce07-04f0-4d50-a6cd-e451fa196466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:12.533242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0acfce07-04f0-4d50-a6cd-e451fa196466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:12.535508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:12.541480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0acfce07-04f0-4d50-a6cd-e451fa196466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:12.541939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0acfce07-04f0-4d50-a6cd-e451fa196466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:12.542954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0acfce07-04f0-4d50-a6cd-e451fa196466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:12.543402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0acfce07-04f0-4d50-a6cd-e451fa196466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:12.548989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:12.559459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:12.561000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:12.562201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cfd17caf-da8a-419c-8b35-e165c79439c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.175236 May 23 13:58:12.562759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1199/2315] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:12.623690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-53d149f9-93f5-434e-b574-bb05653bc66d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:12.624317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-53d149f9-93f5-434e-b574-bb05653bc66d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:12.630715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53d149f9-93f5-434e-b574-bb05653bc66d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:12.634373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53d149f9-93f5-434e-b574-bb05653bc66d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:12.634373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53d149f9-93f5-434e-b574-bb05653bc66d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:12.634373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53d149f9-93f5-434e-b574-bb05653bc66d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:12.700491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0acfce07-04f0-4d50-a6cd-e451fa196466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:12.702149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-53d149f9-93f5-434e-b574-bb05653bc66d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:12.709376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0acfce07-04f0-4d50-a6cd-e451fa196466 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.181821 May 23 13:58:12.709956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1117/2316] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:12 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:12.710830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-53d149f9-93f5-434e-b574-bb05653bc66d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091550 May 23 13:58:12.711375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1200/2317] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:12 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:13.003678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-308b6d9f-946f-41b9-bd1b-400fa80e2366 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:13.004206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-308b6d9f-946f-41b9-bd1b-400fa80e2366 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:13.012953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-308b6d9f-946f-41b9-bd1b-400fa80e2366 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.013638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-308b6d9f-946f-41b9-bd1b-400fa80e2366 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.014814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-308b6d9f-946f-41b9-bd1b-400fa80e2366 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.015502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-308b6d9f-946f-41b9-bd1b-400fa80e2366 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.163193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-308b6d9f-946f-41b9-bd1b-400fa80e2366 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:13.173787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-308b6d9f-946f-41b9-bd1b-400fa80e2366 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.174335 May 23 13:58:13.174367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1118/2318] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:12 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:13.199866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae2bf9ef-235c-4f8b-8ccc-eb5011d2021d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:13.200898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae2bf9ef-235c-4f8b-8ccc-eb5011d2021d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:13.207845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae2bf9ef-235c-4f8b-8ccc-eb5011d2021d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.208981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae2bf9ef-235c-4f8b-8ccc-eb5011d2021d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.209765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae2bf9ef-235c-4f8b-8ccc-eb5011d2021d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.210207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae2bf9ef-235c-4f8b-8ccc-eb5011d2021d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.372134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae2bf9ef-235c-4f8b-8ccc-eb5011d2021d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:13.381235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae2bf9ef-235c-4f8b-8ccc-eb5011d2021d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.186707 May 23 13:58:13.381859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1201/2319] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:13 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:13.584241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:13.584828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:13.591768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.592217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.593024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.593456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.739285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02fb05df-a63e-44fe-917d-e8c470ae9bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:13.740402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02fb05df-a63e-44fe-917d-e8c470ae9bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:13.751679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fb05df-a63e-44fe-917d-e8c470ae9bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.752447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fb05df-a63e-44fe-917d-e8c470ae9bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.753703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fb05df-a63e-44fe-917d-e8c470ae9bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.754510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fb05df-a63e-44fe-917d-e8c470ae9bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.765115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:13.775292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:13.776991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:13.778212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fb97016b-148f-4cb8-a516-464ff73c39cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.198545 May 23 13:58:13.778781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1119/2320] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:13 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:13.783493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-152dc417-e032-4a9d-ab8a-38854d6d6f6c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:13.784138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-152dc417-e032-4a9d-ab8a-38854d6d6f6c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:13.798030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152dc417-e032-4a9d-ab8a-38854d6d6f6c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.798930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152dc417-e032-4a9d-ab8a-38854d6d6f6c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.800140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152dc417-e032-4a9d-ab8a-38854d6d6f6c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:13.800794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-152dc417-e032-4a9d-ab8a-38854d6d6f6c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:13.887020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-152dc417-e032-4a9d-ab8a-38854d6d6f6c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:13.897278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-152dc417-e032-4a9d-ab8a-38854d6d6f6c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.116988 May 23 13:58:13.898205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1120/2321] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:13 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:13.933544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02fb05df-a63e-44fe-917d-e8c470ae9bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:13.942072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02fb05df-a63e-44fe-917d-e8c470ae9bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.218718 May 23 13:58:13.943523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1202/2322] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:13 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:14.190488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f60903a6-9717-43cb-9079-063f5fc48121 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:14.191100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f60903a6-9717-43cb-9079-063f5fc48121 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:14.198821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f60903a6-9717-43cb-9079-063f5fc48121 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:14.199296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f60903a6-9717-43cb-9079-063f5fc48121 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:14.200046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f60903a6-9717-43cb-9079-063f5fc48121 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:14.200516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f60903a6-9717-43cb-9079-063f5fc48121 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:14.348381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f60903a6-9717-43cb-9079-063f5fc48121 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:14.357107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f60903a6-9717-43cb-9079-063f5fc48121 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.170373 May 23 13:58:14.357678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1121/2323] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:14 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:14.399458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b3457aa3-d14d-42c1-90f2-7983ee060900 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:14.400068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b3457aa3-d14d-42c1-90f2-7983ee060900 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:14.402406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:14.407541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3457aa3-d14d-42c1-90f2-7983ee060900 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:14.407975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3457aa3-d14d-42c1-90f2-7983ee060900 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:14.408775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3457aa3-d14d-42c1-90f2-7983ee060900 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:14.409210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3457aa3-d14d-42c1-90f2-7983ee060900 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:14.566981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3457aa3-d14d-42c1-90f2-7983ee060900 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:14.581380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b3457aa3-d14d-42c1-90f2-7983ee060900 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.185971 May 23 13:58:14.581972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1203/2324] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:14 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:14.807288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:14.807866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:14.814788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:14.815237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:14.816011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:14.816452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:14.918336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b505bce4-1a43-4b49-8b13-a1c82b322329 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:14.919333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b505bce4-1a43-4b49-8b13-a1c82b322329 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:14.928418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b505bce4-1a43-4b49-8b13-a1c82b322329 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:14.929118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b505bce4-1a43-4b49-8b13-a1c82b322329 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:14.930295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b505bce4-1a43-4b49-8b13-a1c82b322329 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:14.930924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b505bce4-1a43-4b49-8b13-a1c82b322329 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:14.982959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:14.992813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:14.994524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:14.995842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59bed265-67b3-44f5-b4d9-a667a67e85ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.192698 May 23 13:58:14.996504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1122/2325] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:14 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:15.002646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db89c8e1-9f5d-4b80-8d4e-90b15a04ee48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:15.002646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db89c8e1-9f5d-4b80-8d4e-90b15a04ee48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:15.009526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db89c8e1-9f5d-4b80-8d4e-90b15a04ee48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:15.010150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db89c8e1-9f5d-4b80-8d4e-90b15a04ee48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:15.010935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db89c8e1-9f5d-4b80-8d4e-90b15a04ee48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:15.011372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db89c8e1-9f5d-4b80-8d4e-90b15a04ee48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:15.031886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b505bce4-1a43-4b49-8b13-a1c82b322329 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:15.040731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b505bce4-1a43-4b49-8b13-a1c82b322329 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.128033 May 23 13:58:15.041335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1204/2326] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:14 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:15.187933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db89c8e1-9f5d-4b80-8d4e-90b15a04ee48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:15.198357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db89c8e1-9f5d-4b80-8d4e-90b15a04ee48 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.200742 May 23 13:58:15.198938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1123/2327] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:14 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:15.375056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2ea81f9-5757-4733-946c-62b2d66d5eaf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:15.375650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2ea81f9-5757-4733-946c-62b2d66d5eaf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:15.382894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2ea81f9-5757-4733-946c-62b2d66d5eaf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:15.383435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2ea81f9-5757-4733-946c-62b2d66d5eaf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:15.384211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2ea81f9-5757-4733-946c-62b2d66d5eaf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:15.384676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2ea81f9-5757-4733-946c-62b2d66d5eaf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:15.528024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2ea81f9-5757-4733-946c-62b2d66d5eaf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:15.536421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2ea81f9-5757-4733-946c-62b2d66d5eaf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164948 May 23 13:58:15.537178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1205/2328] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:15 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:15.610077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-544acd8d-9240-4ec9-a8e5-1d49df7c307b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:15.610874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-544acd8d-9240-4ec9-a8e5-1d49df7c307b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:15.617709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-544acd8d-9240-4ec9-a8e5-1d49df7c307b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:15.618153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-544acd8d-9240-4ec9-a8e5-1d49df7c307b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:15.618909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-544acd8d-9240-4ec9-a8e5-1d49df7c307b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:15.619336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-544acd8d-9240-4ec9-a8e5-1d49df7c307b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:15.774600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-544acd8d-9240-4ec9-a8e5-1d49df7c307b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:15.782989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-544acd8d-9240-4ec9-a8e5-1d49df7c307b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.177014 May 23 13:58:15.783606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1124/2329] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:15 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:16.021435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:16.022155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:16.031925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.032388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:16.033204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.033683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:16.062426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95d60285-b0b8-4772-bac9-0ec0749b5631 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:16.063057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95d60285-b0b8-4772-bac9-0ec0749b5631 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:16.070358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95d60285-b0b8-4772-bac9-0ec0749b5631 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.070901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95d60285-b0b8-4772-bac9-0ec0749b5631 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:16.071747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95d60285-b0b8-4772-bac9-0ec0749b5631 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.072192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95d60285-b0b8-4772-bac9-0ec0749b5631 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:16.152474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95d60285-b0b8-4772-bac9-0ec0749b5631 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:16.160769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95d60285-b0b8-4772-bac9-0ec0749b5631 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.102083 May 23 13:58:16.162560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1125/2330] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:16 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:16.185243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:16.203966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:16.203966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:16.203966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5df0302b-0a72-4c5e-9bcd-e69f7a0136fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.183461 May 23 13:58:16.204641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1206/2331] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:16.218872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45dee7ed-5fcc-4c76-9ed4-606584985b02 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:16.219497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45dee7ed-5fcc-4c76-9ed4-606584985b02 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:16.234284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45dee7ed-5fcc-4c76-9ed4-606584985b02 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.237252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45dee7ed-5fcc-4c76-9ed4-606584985b02 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:16.238125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45dee7ed-5fcc-4c76-9ed4-606584985b02 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.238572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45dee7ed-5fcc-4c76-9ed4-606584985b02 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:16.389665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45dee7ed-5fcc-4c76-9ed4-606584985b02 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:16.398941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45dee7ed-5fcc-4c76-9ed4-606584985b02 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.184704 May 23 13:58:16.399536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1126/2332] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:16 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:16.554647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c90e2485-339d-4c28-b711-13354bafb000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:16.555279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c90e2485-339d-4c28-b711-13354bafb000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:16.561683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c90e2485-339d-4c28-b711-13354bafb000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.562138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c90e2485-339d-4c28-b711-13354bafb000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:16.562910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c90e2485-339d-4c28-b711-13354bafb000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.563345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c90e2485-339d-4c28-b711-13354bafb000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:16.709214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c90e2485-339d-4c28-b711-13354bafb000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:16.717594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c90e2485-339d-4c28-b711-13354bafb000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.167527 May 23 13:58:16.718739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1207/2333] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:16 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:16.804849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c92412a9-bc3d-4a2c-b67b-3f11cbd15f30 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:16.805527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c92412a9-bc3d-4a2c-b67b-3f11cbd15f30 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:16.812396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c92412a9-bc3d-4a2c-b67b-3f11cbd15f30 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.813921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c92412a9-bc3d-4a2c-b67b-3f11cbd15f30 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:16.814783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c92412a9-bc3d-4a2c-b67b-3f11cbd15f30 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:16.815238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c92412a9-bc3d-4a2c-b67b-3f11cbd15f30 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:17.000415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c92412a9-bc3d-4a2c-b67b-3f11cbd15f30 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:17.009841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c92412a9-bc3d-4a2c-b67b-3f11cbd15f30 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.211627 May 23 13:58:17.010701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1127/2334] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:16 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:17.188086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3045b016-d854-4399-9206-6da90c5b92e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:17.188744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3045b016-d854-4399-9206-6da90c5b92e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:17.195677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3045b016-d854-4399-9206-6da90c5b92e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:17.196124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3045b016-d854-4399-9206-6da90c5b92e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:17.196922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3045b016-d854-4399-9206-6da90c5b92e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:17.197362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3045b016-d854-4399-9206-6da90c5b92e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:17.219254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:17.220028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:17.227719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:17.228167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:17.228975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:17.229418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:17.277613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3045b016-d854-4399-9206-6da90c5b92e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:17.291003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3045b016-d854-4399-9206-6da90c5b92e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.107181 May 23 13:58:17.291805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1208/2335] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:17 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:17.381255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:17.390531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:17.392062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:17.393280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-25217fc6-8107-4399-96dc-f3884bb14146 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.177966 May 23 13:58:17.393839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1128/2336] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:17.421063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5f6ee301-9fcc-4936-a712-a951c8291385 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:17.421995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5f6ee301-9fcc-4936-a712-a951c8291385 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:17.430594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f6ee301-9fcc-4936-a712-a951c8291385 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:17.431048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f6ee301-9fcc-4936-a712-a951c8291385 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:17.431845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f6ee301-9fcc-4936-a712-a951c8291385 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:17.432469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f6ee301-9fcc-4936-a712-a951c8291385 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:17.592864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5f6ee301-9fcc-4936-a712-a951c8291385 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:17.601976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5f6ee301-9fcc-4936-a712-a951c8291385 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.188057 May 23 13:58:17.602569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1209/2337] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:17 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:17.735428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f4a132de-fe23-49e5-ac60-beba0a3136e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:17.736042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f4a132de-fe23-49e5-ac60-beba0a3136e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:17.742348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4a132de-fe23-49e5-ac60-beba0a3136e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:17.742792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4a132de-fe23-49e5-ac60-beba0a3136e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:17.743559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4a132de-fe23-49e5-ac60-beba0a3136e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:17.743987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4a132de-fe23-49e5-ac60-beba0a3136e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:17.887568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f4a132de-fe23-49e5-ac60-beba0a3136e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:17.897119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f4a132de-fe23-49e5-ac60-beba0a3136e4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.165464 May 23 13:58:17.897741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1129/2338] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:17 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:18.028451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-57348a0e-3183-4471-a5a3-95142e5df8cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:18.029114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-57348a0e-3183-4471-a5a3-95142e5df8cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:18.035315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57348a0e-3183-4471-a5a3-95142e5df8cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.035942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57348a0e-3183-4471-a5a3-95142e5df8cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:18.036793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57348a0e-3183-4471-a5a3-95142e5df8cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.037416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57348a0e-3183-4471-a5a3-95142e5df8cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:18.041879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:18.173015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-57348a0e-3183-4471-a5a3-95142e5df8cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:18.185503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-57348a0e-3183-4471-a5a3-95142e5df8cf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160446 May 23 13:58:18.188671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1210/2339] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:18 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:18.311741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c21122bb-c4ba-43a9-96fb-9af28c9a0c43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:18.312355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c21122bb-c4ba-43a9-96fb-9af28c9a0c43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:18.326158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c21122bb-c4ba-43a9-96fb-9af28c9a0c43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.326158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c21122bb-c4ba-43a9-96fb-9af28c9a0c43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:18.326158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c21122bb-c4ba-43a9-96fb-9af28c9a0c43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.326158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c21122bb-c4ba-43a9-96fb-9af28c9a0c43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:18.409781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c21122bb-c4ba-43a9-96fb-9af28c9a0c43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:18.412302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:18.412974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:18.419978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.420433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:18.421244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.421681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:18.424259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c21122bb-c4ba-43a9-96fb-9af28c9a0c43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.116252 May 23 13:58:18.425638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1130/2340] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:18 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:18.584882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:18.594504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:18.596036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:18.597235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97280587-3fbd-4167-a224-8b65110f3d23 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.189432 May 23 13:58:18.597792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1211/2341] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:18 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:18.621914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36bfaab3-3a81-4f22-b01f-47f56f188511 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:18.622533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36bfaab3-3a81-4f22-b01f-47f56f188511 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:18.629059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36bfaab3-3a81-4f22-b01f-47f56f188511 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.630500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36bfaab3-3a81-4f22-b01f-47f56f188511 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:18.631343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36bfaab3-3a81-4f22-b01f-47f56f188511 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.631788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36bfaab3-3a81-4f22-b01f-47f56f188511 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:18.775017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36bfaab3-3a81-4f22-b01f-47f56f188511 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:18.783277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36bfaab3-3a81-4f22-b01f-47f56f188511 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165151 May 23 13:58:18.783834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1131/2342] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:18 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:18.915761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d240480-851b-458f-bbe1-3ead089a2d8a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:18.916470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6d240480-851b-458f-bbe1-3ead089a2d8a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:18.922774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d240480-851b-458f-bbe1-3ead089a2d8a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.923228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d240480-851b-458f-bbe1-3ead089a2d8a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:18.923998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d240480-851b-458f-bbe1-3ead089a2d8a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:18.924437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d240480-851b-458f-bbe1-3ead089a2d8a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:19.075989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d240480-851b-458f-bbe1-3ead089a2d8a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:19.085921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6d240480-851b-458f-bbe1-3ead089a2d8a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.175223 May 23 13:58:19.086511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1212/2343] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:18 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:19.206157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f9aa84c9-acdc-43c8-b615-ea51952d4f87 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:19.207261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f9aa84c9-acdc-43c8-b615-ea51952d4f87 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:19.216102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9aa84c9-acdc-43c8-b615-ea51952d4f87 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:19.216551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9aa84c9-acdc-43c8-b615-ea51952d4f87 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:19.217363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9aa84c9-acdc-43c8-b615-ea51952d4f87 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:19.217806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9aa84c9-acdc-43c8-b615-ea51952d4f87 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:19.222318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:19.361904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f9aa84c9-acdc-43c8-b615-ea51952d4f87 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:19.370502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f9aa84c9-acdc-43c8-b615-ea51952d4f87 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.170499 May 23 13:58:19.371079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1132/2344] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:19 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:19.452211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e690029e-fb7f-4d2f-bbe1-9fbf6bf32b43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:19.452854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e690029e-fb7f-4d2f-bbe1-9fbf6bf32b43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:19.461136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e690029e-fb7f-4d2f-bbe1-9fbf6bf32b43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:19.461587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e690029e-fb7f-4d2f-bbe1-9fbf6bf32b43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:19.462385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e690029e-fb7f-4d2f-bbe1-9fbf6bf32b43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:19.462830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e690029e-fb7f-4d2f-bbe1-9fbf6bf32b43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:19.540847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e690029e-fb7f-4d2f-bbe1-9fbf6bf32b43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:19.549546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e690029e-fb7f-4d2f-bbe1-9fbf6bf32b43 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.101340 May 23 13:58:19.550168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1213/2345] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:19 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:19.616949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:19.617684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:19.624494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:19.624971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:19.625754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:19.626193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:19.769993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:19.778801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:19.780319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:19.781523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-20593d4c-e85a-47bc-807a-c5897c3c49e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.169305 May 23 13:58:19.782075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1133/2346] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:19 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:19.801139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e6ef67cc-67e7-4f91-b947-13e43ba16adb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:19.802384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e6ef67cc-67e7-4f91-b947-13e43ba16adb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:19.808670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6ef67cc-67e7-4f91-b947-13e43ba16adb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:19.809131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6ef67cc-67e7-4f91-b947-13e43ba16adb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:19.809897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6ef67cc-67e7-4f91-b947-13e43ba16adb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:19.810332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6ef67cc-67e7-4f91-b947-13e43ba16adb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:19.947613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6ef67cc-67e7-4f91-b947-13e43ba16adb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:19.955493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e6ef67cc-67e7-4f91-b947-13e43ba16adb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158231 May 23 13:58:19.956052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1214/2347] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:19 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:20.103578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-18a6e999-835f-4de7-ad40-58a6995f08b6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:20.104186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-18a6e999-835f-4de7-ad40-58a6995f08b6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:20.110330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18a6e999-835f-4de7-ad40-58a6995f08b6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.110783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18a6e999-835f-4de7-ad40-58a6995f08b6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:20.111542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18a6e999-835f-4de7-ad40-58a6995f08b6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.111979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-18a6e999-835f-4de7-ad40-58a6995f08b6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:20.243310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-18a6e999-835f-4de7-ad40-58a6995f08b6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:20.251395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-18a6e999-835f-4de7-ad40-58a6995f08b6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.151668 May 23 13:58:20.251962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1134/2348] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:20 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:20.392354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf57e62f-e413-40c2-9ceb-9f1520627ab7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:20.393527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf57e62f-e413-40c2-9ceb-9f1520627ab7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:20.402520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf57e62f-e413-40c2-9ceb-9f1520627ab7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.402967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf57e62f-e413-40c2-9ceb-9f1520627ab7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:20.403726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf57e62f-e413-40c2-9ceb-9f1520627ab7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.404163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf57e62f-e413-40c2-9ceb-9f1520627ab7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:20.539302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf57e62f-e413-40c2-9ceb-9f1520627ab7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:20.547251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf57e62f-e413-40c2-9ceb-9f1520627ab7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161693 May 23 13:58:20.547823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1215/2349] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:20 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:20.567885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9b04fe6d-32ef-45ab-b416-98b82db6a9f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:20.568518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9b04fe6d-32ef-45ab-b416-98b82db6a9f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:20.575162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b04fe6d-32ef-45ab-b416-98b82db6a9f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.575611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b04fe6d-32ef-45ab-b416-98b82db6a9f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:20.576377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b04fe6d-32ef-45ab-b416-98b82db6a9f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.576839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b04fe6d-32ef-45ab-b416-98b82db6a9f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:20.640389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b04fe6d-32ef-45ab-b416-98b82db6a9f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:20.650474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9b04fe6d-32ef-45ab-b416-98b82db6a9f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086551 May 23 13:58:20.651691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1135/2350] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:20 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:20.799929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:20.800452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:20.806947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.807390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:20.808149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.808600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:20.939713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:20.949389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:20.950911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:20.952085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2ca53211-dcd5-4d44-b3ed-2cc127967745 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.156143 May 23 13:58:20.952683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1216/2351] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:20.972909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-68baeb8c-0688-4c21-9e99-771247c5c130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:20.974488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-68baeb8c-0688-4c21-9e99-771247c5c130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:20.980602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68baeb8c-0688-4c21-9e99-771247c5c130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.981340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68baeb8c-0688-4c21-9e99-771247c5c130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:20.982169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68baeb8c-0688-4c21-9e99-771247c5c130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:20.982545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68baeb8c-0688-4c21-9e99-771247c5c130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:21.119773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-68baeb8c-0688-4c21-9e99-771247c5c130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:21.127826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-68baeb8c-0688-4c21-9e99-771247c5c130 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158751 May 23 13:58:21.128392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1136/2352] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:20 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:21.267484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5973e3c2-a9f3-4bc8-836b-2f704ba0cc6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:21.268099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5973e3c2-a9f3-4bc8-836b-2f704ba0cc6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:21.274839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5973e3c2-a9f3-4bc8-836b-2f704ba0cc6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:21.275286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5973e3c2-a9f3-4bc8-836b-2f704ba0cc6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:21.281241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5973e3c2-a9f3-4bc8-836b-2f704ba0cc6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:21.281241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5973e3c2-a9f3-4bc8-836b-2f704ba0cc6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:21.426762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5973e3c2-a9f3-4bc8-836b-2f704ba0cc6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:21.435839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5973e3c2-a9f3-4bc8-836b-2f704ba0cc6e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.172211 May 23 13:58:21.436467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1217/2353] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:21 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:21.564877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06d7013a-6857-4b82-9c1f-178ff327d94f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:21.565513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06d7013a-6857-4b82-9c1f-178ff327d94f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:21.573272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06d7013a-6857-4b82-9c1f-178ff327d94f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:21.574025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06d7013a-6857-4b82-9c1f-178ff327d94f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:21.574485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06d7013a-6857-4b82-9c1f-178ff327d94f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:21.574926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06d7013a-6857-4b82-9c1f-178ff327d94f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:21.668281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b3f085bb-2fda-4d1e-b8cc-1dbe2dafaf26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:21.669218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b3f085bb-2fda-4d1e-b8cc-1dbe2dafaf26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:21.675655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3f085bb-2fda-4d1e-b8cc-1dbe2dafaf26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:21.676629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3f085bb-2fda-4d1e-b8cc-1dbe2dafaf26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:21.677584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3f085bb-2fda-4d1e-b8cc-1dbe2dafaf26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:21.678036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3f085bb-2fda-4d1e-b8cc-1dbe2dafaf26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:21.709257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06d7013a-6857-4b82-9c1f-178ff327d94f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:21.717764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06d7013a-6857-4b82-9c1f-178ff327d94f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156754 May 23 13:58:21.718349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1137/2354] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:21 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:21.746381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3f085bb-2fda-4d1e-b8cc-1dbe2dafaf26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:21.755253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b3f085bb-2fda-4d1e-b8cc-1dbe2dafaf26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090617 May 23 13:58:21.755870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1218/2355] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:21 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:21.971193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:21.971704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:21.977843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:21.978290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:21.979037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:21.979465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:22.115030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:22.123512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:22.125065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:22.126233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9b56d4bf-4450-4e49-8d29-e2ba81aed849 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159032 May 23 13:58:22.126785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1138/2356] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:21 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:22.145453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-942ef1ef-cb31-402c-acf6-0feaa39feda9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:22.145902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-942ef1ef-cb31-402c-acf6-0feaa39feda9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:22.151918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-942ef1ef-cb31-402c-acf6-0feaa39feda9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:22.152361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-942ef1ef-cb31-402c-acf6-0feaa39feda9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:22.153142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-942ef1ef-cb31-402c-acf6-0feaa39feda9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:22.153578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-942ef1ef-cb31-402c-acf6-0feaa39feda9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:22.291891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-942ef1ef-cb31-402c-acf6-0feaa39feda9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:22.300433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-942ef1ef-cb31-402c-acf6-0feaa39feda9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158920 May 23 13:58:22.301143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1219/2357] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:22 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:22.454817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9cc61b37-6ad2-4673-973b-d3b285e08d71 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:22.455430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9cc61b37-6ad2-4673-973b-d3b285e08d71 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:22.461549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cc61b37-6ad2-4673-973b-d3b285e08d71 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:22.462001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cc61b37-6ad2-4673-973b-d3b285e08d71 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:22.462754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cc61b37-6ad2-4673-973b-d3b285e08d71 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:22.463187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cc61b37-6ad2-4673-973b-d3b285e08d71 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:22.497406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:58:22.497626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 (ip 10.222.0.70) !!! May 23 13:58:22.596445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9cc61b37-6ad2-4673-973b-d3b285e08d71 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:22.604700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9cc61b37-6ad2-4673-973b-d3b285e08d71 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153736 May 23 13:58:22.605272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1139/2358] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:22 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:22.735594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f841330c-7a21-4cc4-8200-44ee881f391c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:22.736211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f841330c-7a21-4cc4-8200-44ee881f391c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:22.743508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f841330c-7a21-4cc4-8200-44ee881f391c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:22.743961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f841330c-7a21-4cc4-8200-44ee881f391c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:22.744759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f841330c-7a21-4cc4-8200-44ee881f391c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:22.745201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f841330c-7a21-4cc4-8200-44ee881f391c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:22.771268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b75131ea-e162-4656-8d2b-d088ab94154e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:22.771806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b75131ea-e162-4656-8d2b-d088ab94154e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:22.778069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b75131ea-e162-4656-8d2b-d088ab94154e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:22.778525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b75131ea-e162-4656-8d2b-d088ab94154e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:22.779294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b75131ea-e162-4656-8d2b-d088ab94154e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:22.779730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b75131ea-e162-4656-8d2b-d088ab94154e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:22.847763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b75131ea-e162-4656-8d2b-d088ab94154e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:22.866365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b75131ea-e162-4656-8d2b-d088ab94154e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.098489 May 23 13:58:22.867463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1140/2359] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:22 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:22.883058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f841330c-7a21-4cc4-8200-44ee881f391c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:22.891187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f841330c-7a21-4cc4-8200-44ee881f391c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159482 May 23 13:58:22.891878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1220/2360] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:22 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:23.145359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:23.145978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:23.152334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.152817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.153586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.154023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.302310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:23.311157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:23.312727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:23.314013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ebe62fd2-c9a1-48cb-aa58-9b7e1721fdd4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.172724 May 23 13:58:23.314569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1141/2361] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:23.319878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a00f72e-b828-41d9-8a96-9a09a1127a0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:23.320846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a00f72e-b828-41d9-8a96-9a09a1127a0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:23.327554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a00f72e-b828-41d9-8a96-9a09a1127a0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.328001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a00f72e-b828-41d9-8a96-9a09a1127a0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.328800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a00f72e-b828-41d9-8a96-9a09a1127a0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.329266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a00f72e-b828-41d9-8a96-9a09a1127a0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.464774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a00f72e-b828-41d9-8a96-9a09a1127a0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:23.473713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a00f72e-b828-41d9-8a96-9a09a1127a0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158065 May 23 13:58:23.474434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1221/2362] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:23 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:23.622714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-62723d24-a33d-4035-8e76-84cde816a5dc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:23.628935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-62723d24-a33d-4035-8e76-84cde816a5dc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:23.629910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62723d24-a33d-4035-8e76-84cde816a5dc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.630363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62723d24-a33d-4035-8e76-84cde816a5dc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.631126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62723d24-a33d-4035-8e76-84cde816a5dc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.631556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62723d24-a33d-4035-8e76-84cde816a5dc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.764985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-62723d24-a33d-4035-8e76-84cde816a5dc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:23.773681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-62723d24-a33d-4035-8e76-84cde816a5dc tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154813 May 23 13:58:23.774247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1142/2363] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:23 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:23.884145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a74f141-f820-4559-aeff-1d2daa15afee tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:23.884822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a74f141-f820-4559-aeff-1d2daa15afee tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:23.891340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a74f141-f820-4559-aeff-1d2daa15afee tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.891789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a74f141-f820-4559-aeff-1d2daa15afee tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.892553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a74f141-f820-4559-aeff-1d2daa15afee tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.893017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a74f141-f820-4559-aeff-1d2daa15afee tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.909126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-419cd52f-8740-4f9b-8f5e-3c38af7f73d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:23.909742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-419cd52f-8740-4f9b-8f5e-3c38af7f73d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:23.916718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-419cd52f-8740-4f9b-8f5e-3c38af7f73d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.917098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-419cd52f-8740-4f9b-8f5e-3c38af7f73d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.917865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-419cd52f-8740-4f9b-8f5e-3c38af7f73d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:23.918308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-419cd52f-8740-4f9b-8f5e-3c38af7f73d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:23.962153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a74f141-f820-4559-aeff-1d2daa15afee tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:23.971096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a74f141-f820-4559-aeff-1d2daa15afee tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091566 May 23 13:58:23.971687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1222/2364] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:23 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:24.065491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-419cd52f-8740-4f9b-8f5e-3c38af7f73d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:24.075141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-419cd52f-8740-4f9b-8f5e-3c38af7f73d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.169828 May 23 13:58:24.075718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1143/2365] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:23 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:24.333943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:24.334562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:24.340881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:24.341341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:24.342116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:24.342559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:24.484400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:24.490877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-81ab48a3-2044-4f09-83e2-c3dc5fcf2b9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:24.491587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-81ab48a3-2044-4f09-83e2-c3dc5fcf2b9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:24.493676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:24.495236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:24.496597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15ec9144-bc91-4110-b442-27f01f0a2352 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.167733 May 23 13:58:24.497165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1223/2366] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:24 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:24.498087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-81ab48a3-2044-4f09-83e2-c3dc5fcf2b9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:24.498569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-81ab48a3-2044-4f09-83e2-c3dc5fcf2b9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:24.499323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-81ab48a3-2044-4f09-83e2-c3dc5fcf2b9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:24.499769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-81ab48a3-2044-4f09-83e2-c3dc5fcf2b9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:24.632167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-81ab48a3-2044-4f09-83e2-c3dc5fcf2b9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:24.640160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-81ab48a3-2044-4f09-83e2-c3dc5fcf2b9e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.153541 May 23 13:58:24.641327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1144/2367] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:24 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:24.791284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1666e2ca-d9a4-4d8a-9278-98ccb56e9b2a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:24.791853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1666e2ca-d9a4-4d8a-9278-98ccb56e9b2a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:24.798672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1666e2ca-d9a4-4d8a-9278-98ccb56e9b2a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:24.799123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1666e2ca-d9a4-4d8a-9278-98ccb56e9b2a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:24.799906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1666e2ca-d9a4-4d8a-9278-98ccb56e9b2a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:24.800346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1666e2ca-d9a4-4d8a-9278-98ccb56e9b2a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:24.943921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1666e2ca-d9a4-4d8a-9278-98ccb56e9b2a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:24.953495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1666e2ca-d9a4-4d8a-9278-98ccb56e9b2a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.166208 May 23 13:58:24.954086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1224/2368] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:24 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:24.987630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-105c5dde-28e1-4f21-a766-c4be78d7f0f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:24.988255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-105c5dde-28e1-4f21-a766-c4be78d7f0f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:24.995761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-105c5dde-28e1-4f21-a766-c4be78d7f0f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:24.996207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-105c5dde-28e1-4f21-a766-c4be78d7f0f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:24.997004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-105c5dde-28e1-4f21-a766-c4be78d7f0f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:24.997433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-105c5dde-28e1-4f21-a766-c4be78d7f0f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:25.063165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-105c5dde-28e1-4f21-a766-c4be78d7f0f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:25.072920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-105c5dde-28e1-4f21-a766-c4be78d7f0f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088983 May 23 13:58:25.074349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1145/2369] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:24 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:25.093514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c81ab6a4-3c5f-4cab-9e45-c261428d6431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:25.094159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c81ab6a4-3c5f-4cab-9e45-c261428d6431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:25.101312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c81ab6a4-3c5f-4cab-9e45-c261428d6431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:25.101769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c81ab6a4-3c5f-4cab-9e45-c261428d6431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:25.102549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c81ab6a4-3c5f-4cab-9e45-c261428d6431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:25.102990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c81ab6a4-3c5f-4cab-9e45-c261428d6431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:25.242550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c81ab6a4-3c5f-4cab-9e45-c261428d6431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:25.250786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c81ab6a4-3c5f-4cab-9e45-c261428d6431 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161250 May 23 13:58:25.251241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1225/2370] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:25 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:25.514787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:25.515397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:25.521848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:25.522305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:25.523068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:25.523506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:25.658692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4ec85f0d-191f-48b6-8a6a-da6734d8cf81 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:25.658842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:25.659290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4ec85f0d-191f-48b6-8a6a-da6734d8cf81 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:25.665666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ec85f0d-191f-48b6-8a6a-da6734d8cf81 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:25.666117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ec85f0d-191f-48b6-8a6a-da6734d8cf81 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:25.666883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ec85f0d-191f-48b6-8a6a-da6734d8cf81 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:25.667323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ec85f0d-191f-48b6-8a6a-da6734d8cf81 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:25.668190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:25.669728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:25.670980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7fdb05f5-eba9-422b-a6ee-033fe379a7ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.160182 May 23 13:58:25.671579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1146/2371] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:25.804258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4ec85f0d-191f-48b6-8a6a-da6734d8cf81 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:25.807783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:25.812766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4ec85f0d-191f-48b6-8a6a-da6734d8cf81 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158285 May 23 13:58:25.813379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1226/2372] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:25 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:25.971722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8b49c601-8f10-4cfd-add7-b7ab3c1050c5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:25.972408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8b49c601-8f10-4cfd-add7-b7ab3c1050c5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:25.979302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b49c601-8f10-4cfd-add7-b7ab3c1050c5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:25.979743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b49c601-8f10-4cfd-add7-b7ab3c1050c5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:25.980507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b49c601-8f10-4cfd-add7-b7ab3c1050c5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:25.980961 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b49c601-8f10-4cfd-add7-b7ab3c1050c5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:26.091091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e54bd8d0-d06d-458f-9c2a-bf9f0e1c0554 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:26.091708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e54bd8d0-d06d-458f-9c2a-bf9f0e1c0554 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:26.099957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e54bd8d0-d06d-458f-9c2a-bf9f0e1c0554 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:26.100412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e54bd8d0-d06d-458f-9c2a-bf9f0e1c0554 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:26.101257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e54bd8d0-d06d-458f-9c2a-bf9f0e1c0554 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:26.101707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e54bd8d0-d06d-458f-9c2a-bf9f0e1c0554 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:26.119927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8b49c601-8f10-4cfd-add7-b7ab3c1050c5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:26.128040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8b49c601-8f10-4cfd-add7-b7ab3c1050c5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160869 May 23 13:58:26.128736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1147/2373] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:25 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:26.167466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e54bd8d0-d06d-458f-9c2a-bf9f0e1c0554 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:26.175688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e54bd8d0-d06d-458f-9c2a-bf9f0e1c0554 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088429 May 23 13:58:26.180951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1227/2374] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:26 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:26.268640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f79943a4-39e4-44ab-92b1-562329129c3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:26.269274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f79943a4-39e4-44ab-92b1-562329129c3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:26.275494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f79943a4-39e4-44ab-92b1-562329129c3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:26.275934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f79943a4-39e4-44ab-92b1-562329129c3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:26.276717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f79943a4-39e4-44ab-92b1-562329129c3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:26.277148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f79943a4-39e4-44ab-92b1-562329129c3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:26.416856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f79943a4-39e4-44ab-92b1-562329129c3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:26.420280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:26.425026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f79943a4-39e4-44ab-92b1-562329129c3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160381 May 23 13:58:26.425587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1148/2375] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:26 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:26.690166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:26.690671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:26.697882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:26.698334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:26.699108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:26.699540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:26.838905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b537eb60-9daf-4818-95d8-bf700777b4a3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:26.838905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b537eb60-9daf-4818-95d8-bf700777b4a3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:26.844020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b537eb60-9daf-4818-95d8-bf700777b4a3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:26.844467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b537eb60-9daf-4818-95d8-bf700777b4a3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:26.845257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b537eb60-9daf-4818-95d8-bf700777b4a3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:26.845867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b537eb60-9daf-4818-95d8-bf700777b4a3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:26.845988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:26.855119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:26.856676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:26.857895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dda20b99-f267-44ee-986a-ade097347b61 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.171722 May 23 13:58:26.858461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1228/2376] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:26.977332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b537eb60-9daf-4818-95d8-bf700777b4a3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:26.985559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b537eb60-9daf-4818-95d8-bf700777b4a3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.154133 May 23 13:58:26.986129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1149/2377] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:26 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:27.146374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ba9fd1c3-a927-46fc-bc13-a5cb9577600a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:27.147005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ba9fd1c3-a927-46fc-bc13-a5cb9577600a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:27.153625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba9fd1c3-a927-46fc-bc13-a5cb9577600a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:27.154090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba9fd1c3-a927-46fc-bc13-a5cb9577600a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:27.154875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba9fd1c3-a927-46fc-bc13-a5cb9577600a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:27.155319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba9fd1c3-a927-46fc-bc13-a5cb9577600a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:27.194958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-230039a9-2e94-4298-8688-5eec2114afa2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:27.195879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-230039a9-2e94-4298-8688-5eec2114afa2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:27.203530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-230039a9-2e94-4298-8688-5eec2114afa2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:27.203530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-230039a9-2e94-4298-8688-5eec2114afa2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:27.203530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-230039a9-2e94-4298-8688-5eec2114afa2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:27.203932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-230039a9-2e94-4298-8688-5eec2114afa2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:27.270395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-230039a9-2e94-4298-8688-5eec2114afa2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:27.278492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-230039a9-2e94-4298-8688-5eec2114afa2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088366 May 23 13:58:27.279146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1150/2378] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:27 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:27.296447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ba9fd1c3-a927-46fc-bc13-a5cb9577600a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:27.305334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ba9fd1c3-a927-46fc-bc13-a5cb9577600a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.163552 May 23 13:58:27.305913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1229/2379] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:27 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:27.443608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0848526d-de3d-4c72-9040-edd114ffab15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:27.444235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0848526d-de3d-4c72-9040-edd114ffab15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:27.450589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0848526d-de3d-4c72-9040-edd114ffab15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:27.451035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0848526d-de3d-4c72-9040-edd114ffab15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:27.451801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0848526d-de3d-4c72-9040-edd114ffab15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:27.452234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0848526d-de3d-4c72-9040-edd114ffab15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:27.590164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0848526d-de3d-4c72-9040-edd114ffab15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:27.599246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0848526d-de3d-4c72-9040-edd114ffab15 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160218 May 23 13:58:27.599828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1151/2380] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:27 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:27.875610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:27.876223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:27.882831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:27.883286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:27.884035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:27.884503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:28.002844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4fb41329-325b-40a9-bb14-b7ba7e98a84a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:28.003458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4fb41329-325b-40a9-bb14-b7ba7e98a84a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:28.010898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fb41329-325b-40a9-bb14-b7ba7e98a84a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:28.011346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fb41329-325b-40a9-bb14-b7ba7e98a84a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:28.012202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fb41329-325b-40a9-bb14-b7ba7e98a84a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:28.012555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4fb41329-325b-40a9-bb14-b7ba7e98a84a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:28.018984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:28.027800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:28.029558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:28.030740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6b454ff-b108-4636-80a3-86f55d1940a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.159036 May 23 13:58:28.031289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1230/2381] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:28.146072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4fb41329-325b-40a9-bb14-b7ba7e98a84a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:28.154097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4fb41329-325b-40a9-bb14-b7ba7e98a84a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155065 May 23 13:58:28.154672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1152/2382] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:27 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:28.296252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b5fd01b-2021-45f0-9425-a4a56e23801d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:28.296904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b5fd01b-2021-45f0-9425-a4a56e23801d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:28.304907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b5fd01b-2021-45f0-9425-a4a56e23801d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:28.305362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b5fd01b-2021-45f0-9425-a4a56e23801d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:28.306573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b5fd01b-2021-45f0-9425-a4a56e23801d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:28.306697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b5fd01b-2021-45f0-9425-a4a56e23801d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:28.323658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a817c985-f13d-4341-a184-ccaa572a65be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:28.324275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a817c985-f13d-4341-a184-ccaa572a65be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:28.330670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a817c985-f13d-4341-a184-ccaa572a65be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:28.331123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a817c985-f13d-4341-a184-ccaa572a65be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:28.331960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a817c985-f13d-4341-a184-ccaa572a65be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:28.333096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a817c985-f13d-4341-a184-ccaa572a65be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:28.374982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b5fd01b-2021-45f0-9425-a4a56e23801d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:28.388450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b5fd01b-2021-45f0-9425-a4a56e23801d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.095859 May 23 13:58:28.394622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1231/2383] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:28 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:28.473748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a817c985-f13d-4341-a184-ccaa572a65be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:28.481923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a817c985-f13d-4341-a184-ccaa572a65be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162248 May 23 13:58:28.482488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1153/2384] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:28 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:28.617846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ea1671f8-9403-4fba-8338-9c42cec72a72 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:28.618680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ea1671f8-9403-4fba-8338-9c42cec72a72 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:28.624721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea1671f8-9403-4fba-8338-9c42cec72a72 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:28.625176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea1671f8-9403-4fba-8338-9c42cec72a72 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:28.625955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea1671f8-9403-4fba-8338-9c42cec72a72 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:28.626393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea1671f8-9403-4fba-8338-9c42cec72a72 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:28.756632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ea1671f8-9403-4fba-8338-9c42cec72a72 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:28.764655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ea1671f8-9403-4fba-8338-9c42cec72a72 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.151897 May 23 13:58:28.765225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1232/2385] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:28 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:29.048921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:29.049446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:29.056930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.057384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.058152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.058598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.171528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10eca20e-0d96-464f-baf4-ab0597bb8fc6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:29.175507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10eca20e-0d96-464f-baf4-ab0597bb8fc6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:29.179846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10eca20e-0d96-464f-baf4-ab0597bb8fc6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.180298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10eca20e-0d96-464f-baf4-ab0597bb8fc6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.181118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10eca20e-0d96-464f-baf4-ab0597bb8fc6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.181569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10eca20e-0d96-464f-baf4-ab0597bb8fc6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.196816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:29.205845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:29.207392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:29.208656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d414b59-2b48-484d-8ba6-5ecf6d5aad37 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.163702 May 23 13:58:29.209226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1154/2386] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:29 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:29.324386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10eca20e-0d96-464f-baf4-ab0597bb8fc6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:29.332614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10eca20e-0d96-464f-baf4-ab0597bb8fc6 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164888 May 23 13:58:29.333197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1233/2387] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:29 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:29.414164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b695e62d-8b1f-4aae-9c57-6f3e84f56357 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:29.414783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b695e62d-8b1f-4aae-9c57-6f3e84f56357 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:29.421317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b695e62d-8b1f-4aae-9c57-6f3e84f56357 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.421763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b695e62d-8b1f-4aae-9c57-6f3e84f56357 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.422545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b695e62d-8b1f-4aae-9c57-6f3e84f56357 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.422998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b695e62d-8b1f-4aae-9c57-6f3e84f56357 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.501977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-26aff36b-6ee1-4179-b06b-3ccba2d3cf20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:29.502604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-26aff36b-6ee1-4179-b06b-3ccba2d3cf20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:29.504853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b695e62d-8b1f-4aae-9c57-6f3e84f56357 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:29.509480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26aff36b-6ee1-4179-b06b-3ccba2d3cf20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.509941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26aff36b-6ee1-4179-b06b-3ccba2d3cf20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.510720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26aff36b-6ee1-4179-b06b-3ccba2d3cf20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.511163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26aff36b-6ee1-4179-b06b-3ccba2d3cf20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.512888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b695e62d-8b1f-4aae-9c57-6f3e84f56357 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.104068 May 23 13:58:29.513469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1155/2388] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:29 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:29.653770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-26aff36b-6ee1-4179-b06b-3ccba2d3cf20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:29.662093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-26aff36b-6ee1-4179-b06b-3ccba2d3cf20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.166313 May 23 13:58:29.662672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1234/2389] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:29 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:29.783233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1b39adbf-fea3-4391-8d8c-fe842417a658 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:29.783894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1b39adbf-fea3-4391-8d8c-fe842417a658 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:29.791224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b39adbf-fea3-4391-8d8c-fe842417a658 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.791676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b39adbf-fea3-4391-8d8c-fe842417a658 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.792451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b39adbf-fea3-4391-8d8c-fe842417a658 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:29.792936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b39adbf-fea3-4391-8d8c-fe842417a658 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:29.928006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b39adbf-fea3-4391-8d8c-fe842417a658 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:29.936691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1b39adbf-fea3-4391-8d8c-fe842417a658 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158318 May 23 13:58:29.937267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1156/2390] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:29 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:30.227644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:30.228421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:30.235189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.235630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:30.236406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.236870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:30.351382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0da92caa-4f09-4f10-a142-d388c1672796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:30.352008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0da92caa-4f09-4f10-a142-d388c1672796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:30.358096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0da92caa-4f09-4f10-a142-d388c1672796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.358640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0da92caa-4f09-4f10-a142-d388c1672796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:30.359309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0da92caa-4f09-4f10-a142-d388c1672796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.359746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0da92caa-4f09-4f10-a142-d388c1672796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:30.377010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:30.390711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:30.392222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:30.393434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-adc47e3c-321e-4278-80cd-54eb75e3f93c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.170055 May 23 13:58:30.393991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1235/2391] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:30.537707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6028e109-ca74-4bf2-9d6e-f65814b5606b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:30.538257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6028e109-ca74-4bf2-9d6e-f65814b5606b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:30.545131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6028e109-ca74-4bf2-9d6e-f65814b5606b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.545587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6028e109-ca74-4bf2-9d6e-f65814b5606b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:30.546452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6028e109-ca74-4bf2-9d6e-f65814b5606b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.546897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6028e109-ca74-4bf2-9d6e-f65814b5606b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:30.620776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6028e109-ca74-4bf2-9d6e-f65814b5606b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:30.630072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6028e109-ca74-4bf2-9d6e-f65814b5606b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.096396 May 23 13:58:30.630665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1236/2392] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:30 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:30.680281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6fe79f86-46de-4536-b0b8-0ceaa56aa768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:30.680937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6fe79f86-46de-4536-b0b8-0ceaa56aa768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:30.687386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fe79f86-46de-4536-b0b8-0ceaa56aa768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.687805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fe79f86-46de-4536-b0b8-0ceaa56aa768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:30.688556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fe79f86-46de-4536-b0b8-0ceaa56aa768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.689029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fe79f86-46de-4536-b0b8-0ceaa56aa768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:30.760195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0da92caa-4f09-4f10-a142-d388c1672796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:30.768312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0da92caa-4f09-4f10-a142-d388c1672796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.421455 May 23 13:58:30.768939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1157/2393] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:30 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:30.826300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6fe79f86-46de-4536-b0b8-0ceaa56aa768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:30.835351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6fe79f86-46de-4536-b0b8-0ceaa56aa768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159892 May 23 13:58:30.835968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1237/2394] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:30 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:30.954814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-50616a2b-c883-410f-8f6e-077a858ee36a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:30.955423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-50616a2b-c883-410f-8f6e-077a858ee36a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:30.961888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50616a2b-c883-410f-8f6e-077a858ee36a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.962334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50616a2b-c883-410f-8f6e-077a858ee36a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:30.963089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50616a2b-c883-410f-8f6e-077a858ee36a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:30.963520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50616a2b-c883-410f-8f6e-077a858ee36a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:31.092831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-50616a2b-c883-410f-8f6e-077a858ee36a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:31.102097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-50616a2b-c883-410f-8f6e-077a858ee36a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.151151 May 23 13:58:31.102669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1158/2395] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:30 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:31.414844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:31.415538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:31.422923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:31.423240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:31.423849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:31.424295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:31.570080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:31.578909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:31.580463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:31.582350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-846607cd-6991-4cf9-8162-7156fec496af tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.172349 May 23 13:58:31.583603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1238/2396] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:31 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:31.651547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-472a3bbe-857e-41bc-9796-58ee2efe557c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:31.652151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-472a3bbe-857e-41bc-9796-58ee2efe557c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:31.658328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-472a3bbe-857e-41bc-9796-58ee2efe557c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:31.658778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-472a3bbe-857e-41bc-9796-58ee2efe557c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:31.659537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-472a3bbe-857e-41bc-9796-58ee2efe557c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:31.660130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-472a3bbe-857e-41bc-9796-58ee2efe557c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:31.726920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-472a3bbe-857e-41bc-9796-58ee2efe557c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:31.735254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-472a3bbe-857e-41bc-9796-58ee2efe557c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087636 May 23 13:58:31.735856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1159/2397] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:31 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:31.785672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66abf74f-98a6-4170-b2be-3746e8f26831 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:31.786293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-66abf74f-98a6-4170-b2be-3746e8f26831 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:31.793759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66abf74f-98a6-4170-b2be-3746e8f26831 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:31.794345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66abf74f-98a6-4170-b2be-3746e8f26831 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:31.795217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66abf74f-98a6-4170-b2be-3746e8f26831 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:31.795849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66abf74f-98a6-4170-b2be-3746e8f26831 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:31.853281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d4e279b-b5df-4663-a551-99ee2febd45d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:31.853882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d4e279b-b5df-4663-a551-99ee2febd45d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:31.859852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d4e279b-b5df-4663-a551-99ee2febd45d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:31.860294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d4e279b-b5df-4663-a551-99ee2febd45d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:31.861064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d4e279b-b5df-4663-a551-99ee2febd45d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:31.861497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d4e279b-b5df-4663-a551-99ee2febd45d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:31.929632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-66abf74f-98a6-4170-b2be-3746e8f26831 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:31.937901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-66abf74f-98a6-4170-b2be-3746e8f26831 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156002 May 23 13:58:31.938729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1239/2398] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:31 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:32.001706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d4e279b-b5df-4663-a551-99ee2febd45d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:32.010427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d4e279b-b5df-4663-a551-99ee2febd45d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161430 May 23 13:58:32.010990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1160/2399] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:31 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:32.120309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7b2dfe5d-1eb6-40e1-ab91-145e7f4b3203 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:32.121091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7b2dfe5d-1eb6-40e1-ab91-145e7f4b3203 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:32.127131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe5d-1eb6-40e1-ab91-145e7f4b3203 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:32.127587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe5d-1eb6-40e1-ab91-145e7f4b3203 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:32.128364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe5d-1eb6-40e1-ab91-145e7f4b3203 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:32.129406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe5d-1eb6-40e1-ab91-145e7f4b3203 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:32.264348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7b2dfe5d-1eb6-40e1-ab91-145e7f4b3203 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:32.272817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7b2dfe5d-1eb6-40e1-ab91-145e7f4b3203 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156418 May 23 13:58:32.273409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1240/2400] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:32 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:32.496499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:58:32.496792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 13:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:58:32.601668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:32.602203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:32.608743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:32.609200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:32.609957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:32.610392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:32.748668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:32.753217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-51e684c7-062f-4c73-a2c0-1f200e4c72ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:32.754516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-51e684c7-062f-4c73-a2c0-1f200e4c72ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:32.758491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:32.760009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:32.761113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51e684c7-062f-4c73-a2c0-1f200e4c72ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:32.761242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-abf5061d-3bcc-4998-a4bb-ff4fcb2f61fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.164000 May 23 13:58:32.761565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51e684c7-062f-4c73-a2c0-1f200e4c72ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:32.771728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1161/2401] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:32 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:32.771935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51e684c7-062f-4c73-a2c0-1f200e4c72ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:32.771935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51e684c7-062f-4c73-a2c0-1f200e4c72ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:32.828360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51e684c7-062f-4c73-a2c0-1f200e4c72ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:32.836947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-51e684c7-062f-4c73-a2c0-1f200e4c72ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087782 May 23 13:58:32.837532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1241/2402] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:32 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:32.958237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99361a6f-f660-4482-aa76-39545f46bac0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:32.958911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99361a6f-f660-4482-aa76-39545f46bac0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:32.966842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99361a6f-f660-4482-aa76-39545f46bac0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:32.967329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99361a6f-f660-4482-aa76-39545f46bac0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:32.968095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99361a6f-f660-4482-aa76-39545f46bac0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:32.968528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99361a6f-f660-4482-aa76-39545f46bac0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:33.028109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e006f36b-587f-4db4-973b-1c50c38b2506 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:33.028942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e006f36b-587f-4db4-973b-1c50c38b2506 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:33.035837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e006f36b-587f-4db4-973b-1c50c38b2506 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:33.036286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e006f36b-587f-4db4-973b-1c50c38b2506 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:33.037112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e006f36b-587f-4db4-973b-1c50c38b2506 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:33.037553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e006f36b-587f-4db4-973b-1c50c38b2506 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:33.115281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99361a6f-f660-4482-aa76-39545f46bac0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:33.123892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99361a6f-f660-4482-aa76-39545f46bac0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.170430 May 23 13:58:33.124595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1162/2403] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:32 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:33.185054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e006f36b-587f-4db4-973b-1c50c38b2506 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:33.194313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e006f36b-587f-4db4-973b-1c50c38b2506 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.170165 May 23 13:58:33.194907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1242/2404] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:33 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:33.291467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d892c4d9-2aff-46bd-8cc3-f952014c8d34 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:33.292002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d892c4d9-2aff-46bd-8cc3-f952014c8d34 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:33.298251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d892c4d9-2aff-46bd-8cc3-f952014c8d34 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:33.298692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d892c4d9-2aff-46bd-8cc3-f952014c8d34 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:33.299459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d892c4d9-2aff-46bd-8cc3-f952014c8d34 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:33.299900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d892c4d9-2aff-46bd-8cc3-f952014c8d34 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:33.436876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d892c4d9-2aff-46bd-8cc3-f952014c8d34 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:33.445622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d892c4d9-2aff-46bd-8cc3-f952014c8d34 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158228 May 23 13:58:33.446196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1163/2405] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:33 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:33.779440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:33.780115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:33.787901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:33.788384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:33.789221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:33.789662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:33.810506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:33.854545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a22cc319-90a4-447e-bf44-01ccf3864f42 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:33.855262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a22cc319-90a4-447e-bf44-01ccf3864f42 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:33.861405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a22cc319-90a4-447e-bf44-01ccf3864f42 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:33.861857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a22cc319-90a4-447e-bf44-01ccf3864f42 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:33.862831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a22cc319-90a4-447e-bf44-01ccf3864f42 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:33.863848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a22cc319-90a4-447e-bf44-01ccf3864f42 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:33.935357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a22cc319-90a4-447e-bf44-01ccf3864f42 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:33.939280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:33.945072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a22cc319-90a4-447e-bf44-01ccf3864f42 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094670 May 23 13:58:33.945650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1164/2406] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:33 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:33.949906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:33.959031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:33.959031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2da9cace-ebdd-4bfd-9ffd-9cbb1ef86ef5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.177851 May 23 13:58:33.964000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1243/2407] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:34.142709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cd8306ee-5942-4f52-9fcf-f73abf0d46ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:34.143328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cd8306ee-5942-4f52-9fcf-f73abf0d46ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:34.150896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd8306ee-5942-4f52-9fcf-f73abf0d46ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.151349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd8306ee-5942-4f52-9fcf-f73abf0d46ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:34.152124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd8306ee-5942-4f52-9fcf-f73abf0d46ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.152587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd8306ee-5942-4f52-9fcf-f73abf0d46ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:34.172005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:34.212298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f37a4a4-638e-4249-8e5b-b6d28778fd31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:34.212955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f37a4a4-638e-4249-8e5b-b6d28778fd31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:34.219598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f37a4a4-638e-4249-8e5b-b6d28778fd31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.220052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f37a4a4-638e-4249-8e5b-b6d28778fd31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:34.220870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f37a4a4-638e-4249-8e5b-b6d28778fd31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.221360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f37a4a4-638e-4249-8e5b-b6d28778fd31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:34.291208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd8306ee-5942-4f52-9fcf-f73abf0d46ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:34.299823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cd8306ee-5942-4f52-9fcf-f73abf0d46ab tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160948 May 23 13:58:34.301091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1165/2408] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:34 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:34.367515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f37a4a4-638e-4249-8e5b-b6d28778fd31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:34.376149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f37a4a4-638e-4249-8e5b-b6d28778fd31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.167968 May 23 13:58:34.376771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1244/2409] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:34 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:34.463526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf36377c-a1bc-4cba-a932-bb9f1186ad1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:34.464049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf36377c-a1bc-4cba-a932-bb9f1186ad1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:34.470386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf36377c-a1bc-4cba-a932-bb9f1186ad1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.470840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf36377c-a1bc-4cba-a932-bb9f1186ad1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:34.472180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf36377c-a1bc-4cba-a932-bb9f1186ad1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.473554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf36377c-a1bc-4cba-a932-bb9f1186ad1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:34.616932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bf36377c-a1bc-4cba-a932-bb9f1186ad1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:34.625039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf36377c-a1bc-4cba-a932-bb9f1186ad1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165457 May 23 13:58:34.627852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1166/2410] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:34 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:34.963453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-03ad4720-2f42-4016-a7e9-cfafb8c18525 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:34.964127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-03ad4720-2f42-4016-a7e9-cfafb8c18525 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:34.970922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03ad4720-2f42-4016-a7e9-cfafb8c18525 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.971314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:34.971810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03ad4720-2f42-4016-a7e9-cfafb8c18525 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:34.971923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:34.972177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03ad4720-2f42-4016-a7e9-cfafb8c18525 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.973193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03ad4720-2f42-4016-a7e9-cfafb8c18525 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:34.974515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:34.979657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.980105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:34.981112 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:34.981399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:35.045467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03ad4720-2f42-4016-a7e9-cfafb8c18525 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:35.054242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-03ad4720-2f42-4016-a7e9-cfafb8c18525 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.095128 May 23 13:58:35.060557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1245/2411] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:34 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:35.135434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:35.144680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:35.146190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:35.147360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-08c8ffff-493f-414a-8fbb-7ace98a0a95c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1802 microversion: 2.20 time: 0.179987 May 23 13:58:35.147911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1167/2412] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:34 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:35.319256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-89289f2b-77dc-485b-91e3-8b9be69f7f6e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:35.319803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-89289f2b-77dc-485b-91e3-8b9be69f7f6e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:35.326307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89289f2b-77dc-485b-91e3-8b9be69f7f6e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:35.326755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89289f2b-77dc-485b-91e3-8b9be69f7f6e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:35.327545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89289f2b-77dc-485b-91e3-8b9be69f7f6e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:35.327987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89289f2b-77dc-485b-91e3-8b9be69f7f6e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:35.395075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8ca65f71-23ce-4a37-a08a-eaa788e27746 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:35.395982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8ca65f71-23ce-4a37-a08a-eaa788e27746 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:35.402581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ca65f71-23ce-4a37-a08a-eaa788e27746 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:35.403027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ca65f71-23ce-4a37-a08a-eaa788e27746 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:35.403939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ca65f71-23ce-4a37-a08a-eaa788e27746 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:35.404378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ca65f71-23ce-4a37-a08a-eaa788e27746 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:35.467715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-89289f2b-77dc-485b-91e3-8b9be69f7f6e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:35.477796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-89289f2b-77dc-485b-91e3-8b9be69f7f6e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.163404 May 23 13:58:35.479659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1246/2413] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:35 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:35.556067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8ca65f71-23ce-4a37-a08a-eaa788e27746 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:35.565624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8ca65f71-23ce-4a37-a08a-eaa788e27746 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.174267 May 23 13:58:35.566711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1168/2414] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:35 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:35.642387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-551d084b-2570-4f67-8a93-4875a33d3713 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:35.643018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-551d084b-2570-4f67-8a93-4875a33d3713 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:35.650035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-551d084b-2570-4f67-8a93-4875a33d3713 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:35.650496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-551d084b-2570-4f67-8a93-4875a33d3713 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:35.651273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-551d084b-2570-4f67-8a93-4875a33d3713 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:35.651720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-551d084b-2570-4f67-8a93-4875a33d3713 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:35.863653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-551d084b-2570-4f67-8a93-4875a33d3713 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:35.872126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-551d084b-2570-4f67-8a93-4875a33d3713 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.233616 May 23 13:58:35.872786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1247/2415] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:35 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:36.071998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-25a13745-99cb-4b32-aa06-1b29282b66ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:36.072676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-25a13745-99cb-4b32-aa06-1b29282b66ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:36.078952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25a13745-99cb-4b32-aa06-1b29282b66ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.079401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25a13745-99cb-4b32-aa06-1b29282b66ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.080628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25a13745-99cb-4b32-aa06-1b29282b66ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.081064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25a13745-99cb-4b32-aa06-1b29282b66ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.147583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25a13745-99cb-4b32-aa06-1b29282b66ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:36.158631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-25a13745-99cb-4b32-aa06-1b29282b66ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090418 May 23 13:58:36.159230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1169/2416] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:36 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:36.170907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:36.171513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:36.180260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.180952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.182160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.182835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.283444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:36.294051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:36.295608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:36.296883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2bcdd64-ba16-4053-a5ff-fd4fd7b62e36 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1735 microversion: 2.20 time: 0.133438 May 23 13:58:36.297435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1248/2417] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:36 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1735 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:36.497947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99d27fdd-625c-437f-841f-00f978c3f918 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:36.498515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99d27fdd-625c-437f-841f-00f978c3f918 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:36.508216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99d27fdd-625c-437f-841f-00f978c3f918 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.508710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99d27fdd-625c-437f-841f-00f978c3f918 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.509553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99d27fdd-625c-437f-841f-00f978c3f918 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.509909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99d27fdd-625c-437f-841f-00f978c3f918 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.573922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-a3860415-f2f3-4b2d-8fe0-92185e4eec3c req-a52937ab-87bd-49d3-8dbd-52c0a0abf12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011172-f0cf-4b8a-9791-2535bb8bcaa4", "name": "network-vif-deleted", "tag": "8fcc06ea-c028-490c-8ab1-e434a5b0c699"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 13:58:36.584830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a3860415-f2f3-4b2d-8fe0-92185e4eec3c req-a52937ab-87bd-49d3-8dbd-52c0a0abf12d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.585392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a3860415-f2f3-4b2d-8fe0-92185e4eec3c req-a52937ab-87bd-49d3-8dbd-52c0a0abf12d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.598237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-a3860415-f2f3-4b2d-8fe0-92185e4eec3c req-a52937ab-87bd-49d3-8dbd-52c0a0abf12d service nova] Creating event network-vif-deleted:8fcc06ea-c028-490c-8ab1-e434a5b0c699 for instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 on hv-cinder-82549 May 23 13:58:36.606193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-a3860415-f2f3-4b2d-8fe0-92185e4eec3c req-a52937ab-87bd-49d3-8dbd-52c0a0abf12d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033644 May 23 13:58:36.607147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1249/2418] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 13:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 13:58:36.616910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6878ce59-0ade-4bd1-a0c3-6885b3c580fb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:36.629984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6878ce59-0ade-4bd1-a0c3-6885b3c580fb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:36.629984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6878ce59-0ade-4bd1-a0c3-6885b3c580fb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.629984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6878ce59-0ade-4bd1-a0c3-6885b3c580fb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.629984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6878ce59-0ade-4bd1-a0c3-6885b3c580fb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.630620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6878ce59-0ade-4bd1-a0c3-6885b3c580fb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.673606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99d27fdd-625c-437f-841f-00f978c3f918 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:36.683147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99d27fdd-625c-437f-841f-00f978c3f918 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.189402 May 23 13:58:36.683736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1170/2419] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:36 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:36.818127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6878ce59-0ade-4bd1-a0c3-6885b3c580fb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:36.827090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6878ce59-0ade-4bd1-a0c3-6885b3c580fb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.218371 May 23 13:58:36.828748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1250/2420] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:36 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:36.871936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:58:36.872143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:58:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:58:36.890523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3bc2c15f-fa89-4263-a1c7-aecf88f1adcf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:36.891348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3bc2c15f-fa89-4263-a1c7-aecf88f1adcf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:36.898615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bc2c15f-fa89-4263-a1c7-aecf88f1adcf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.899062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bc2c15f-fa89-4263-a1c7-aecf88f1adcf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:36.899838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bc2c15f-fa89-4263-a1c7-aecf88f1adcf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:36.900270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bc2c15f-fa89-4263-a1c7-aecf88f1adcf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:37.041146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3bc2c15f-fa89-4263-a1c7-aecf88f1adcf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:37.051617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3bc2c15f-fa89-4263-a1c7-aecf88f1adcf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.164739 May 23 13:58:37.052242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1171/2421] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:36 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:37.175750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-064b6993-385c-4527-aaf1-b1b0561de52c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:37.181173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-064b6993-385c-4527-aaf1-b1b0561de52c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:37.190126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-064b6993-385c-4527-aaf1-b1b0561de52c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:37.191372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-064b6993-385c-4527-aaf1-b1b0561de52c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:37.192423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-064b6993-385c-4527-aaf1-b1b0561de52c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:37.192900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-064b6993-385c-4527-aaf1-b1b0561de52c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:37.279575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-064b6993-385c-4527-aaf1-b1b0561de52c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:37.291562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-064b6993-385c-4527-aaf1-b1b0561de52c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.119808 May 23 13:58:37.293512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1251/2422] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:37 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:37.326304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:37.327164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:37.334369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:37.334815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:37.335599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:37.336033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:37.427826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:37.437091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:37.438624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:37.439810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-851da156-4be3-410c-b724-c4a3511e0786 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.117712 May 23 13:58:37.440378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1172/2423] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:37 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:37.703719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f287e43-e759-4a8a-bdae-cf7bced53f03 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:37.704901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f287e43-e759-4a8a-bdae-cf7bced53f03 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:37.716275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f287e43-e759-4a8a-bdae-cf7bced53f03 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:37.717132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f287e43-e759-4a8a-bdae-cf7bced53f03 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:37.718547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f287e43-e759-4a8a-bdae-cf7bced53f03 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:37.719376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f287e43-e759-4a8a-bdae-cf7bced53f03 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:37.845627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf8c9b13-d81e-4417-a3ef-33e7309dcafb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:37.846273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf8c9b13-d81e-4417-a3ef-33e7309dcafb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:37.855860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf8c9b13-d81e-4417-a3ef-33e7309dcafb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:37.856709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf8c9b13-d81e-4417-a3ef-33e7309dcafb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:37.858141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf8c9b13-d81e-4417-a3ef-33e7309dcafb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:37.858975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf8c9b13-d81e-4417-a3ef-33e7309dcafb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:37.887304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f287e43-e759-4a8a-bdae-cf7bced53f03 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:37.903094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f287e43-e759-4a8a-bdae-cf7bced53f03 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.204421 May 23 13:58:37.904179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1252/2424] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:37 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:38.052064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bf8c9b13-d81e-4417-a3ef-33e7309dcafb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:38.060926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf8c9b13-d81e-4417-a3ef-33e7309dcafb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.219172 May 23 13:58:38.061517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1173/2425] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:37 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:38.073681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-93a633f2-dc43-4708-ba7c-0195e67bd335 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:38.074410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-93a633f2-dc43-4708-ba7c-0195e67bd335 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:38.076796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:38.082966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93a633f2-dc43-4708-ba7c-0195e67bd335 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:38.087148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93a633f2-dc43-4708-ba7c-0195e67bd335 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:38.087148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93a633f2-dc43-4708-ba7c-0195e67bd335 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:38.087148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93a633f2-dc43-4708-ba7c-0195e67bd335 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:38.233375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93a633f2-dc43-4708-ba7c-0195e67bd335 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:38.242414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-93a633f2-dc43-4708-ba7c-0195e67bd335 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.174333 May 23 13:58:38.242994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1253/2426] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:38 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:38.310879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd8ee196-d6d4-4ba6-92f5-db835bee3544 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:38.311500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd8ee196-d6d4-4ba6-92f5-db835bee3544 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:38.319162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd8ee196-d6d4-4ba6-92f5-db835bee3544 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:38.319823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd8ee196-d6d4-4ba6-92f5-db835bee3544 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:38.320860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd8ee196-d6d4-4ba6-92f5-db835bee3544 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:38.321425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd8ee196-d6d4-4ba6-92f5-db835bee3544 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:38.389662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd8ee196-d6d4-4ba6-92f5-db835bee3544 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:38.399151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd8ee196-d6d4-4ba6-92f5-db835bee3544 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092408 May 23 13:58:38.399735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1174/2427] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:38 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:38.460171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:38.460823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:38.467488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:38.468043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:38.468760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:38.469211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:38.539125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:38.548496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:38.550085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:38.551843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-063ca1e0-ec2c-43c9-bc07-0e1dd01295ba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.096477 May 23 13:58:38.552429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1254/2428] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:38 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:38.922495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77b15b77-3313-4d6b-9180-937c5b305968 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:38.923211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-77b15b77-3313-4d6b-9180-937c5b305968 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:38.931280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77b15b77-3313-4d6b-9180-937c5b305968 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:38.931798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77b15b77-3313-4d6b-9180-937c5b305968 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:38.932732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77b15b77-3313-4d6b-9180-937c5b305968 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:38.933237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77b15b77-3313-4d6b-9180-937c5b305968 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:39.082762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0d07dca7-eea1-4f5b-8b39-eafff61ddda9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:39.083047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-77b15b77-3313-4d6b-9180-937c5b305968 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:39.083383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0d07dca7-eea1-4f5b-8b39-eafff61ddda9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:39.089802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d07dca7-eea1-4f5b-8b39-eafff61ddda9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:39.090255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d07dca7-eea1-4f5b-8b39-eafff61ddda9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:39.091061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d07dca7-eea1-4f5b-8b39-eafff61ddda9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:39.091501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d07dca7-eea1-4f5b-8b39-eafff61ddda9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:39.091980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-77b15b77-3313-4d6b-9180-937c5b305968 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.173723 May 23 13:58:39.092702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1175/2429] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:38 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:39.241028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0d07dca7-eea1-4f5b-8b39-eafff61ddda9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:39.251991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0d07dca7-eea1-4f5b-8b39-eafff61ddda9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.172612 May 23 13:58:39.253132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1255/2430] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:39 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:39.264843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45006919-6466-4f58-9196-050af7a4b76f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:39.266042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45006919-6466-4f58-9196-050af7a4b76f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:39.280734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45006919-6466-4f58-9196-050af7a4b76f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:39.280734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45006919-6466-4f58-9196-050af7a4b76f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:39.280734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45006919-6466-4f58-9196-050af7a4b76f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:39.280734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45006919-6466-4f58-9196-050af7a4b76f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:39.416000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-03c58fc1-e1b9-47e1-a1df-fdeeaa12f7f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:39.416640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-03c58fc1-e1b9-47e1-a1df-fdeeaa12f7f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:39.417120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45006919-6466-4f58-9196-050af7a4b76f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:39.422746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03c58fc1-e1b9-47e1-a1df-fdeeaa12f7f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:39.423192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03c58fc1-e1b9-47e1-a1df-fdeeaa12f7f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:39.424012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03c58fc1-e1b9-47e1-a1df-fdeeaa12f7f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:39.424451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-03c58fc1-e1b9-47e1-a1df-fdeeaa12f7f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:39.425636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45006919-6466-4f58-9196-050af7a4b76f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.168067 May 23 13:58:39.426213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1176/2431] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:39 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:39.490201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03c58fc1-e1b9-47e1-a1df-fdeeaa12f7f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:39.499013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-03c58fc1-e1b9-47e1-a1df-fdeeaa12f7f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086767 May 23 13:58:39.499597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1256/2432] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:39 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:39.570684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:39.571361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:39.577623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:39.578075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:39.578836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:39.579279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:39.642980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:39.652277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:39.654004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:39.655160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d0ff538-8d95-4564-b7f3-33376871bdf9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088741 May 23 13:58:39.655820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1177/2433] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:39 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:40.114593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a7851462-0d34-48f2-a0e1-808357183d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:40.115794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a7851462-0d34-48f2-a0e1-808357183d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:40.126888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7851462-0d34-48f2-a0e1-808357183d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.127653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7851462-0d34-48f2-a0e1-808357183d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.131866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7851462-0d34-48f2-a0e1-808357183d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.132745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7851462-0d34-48f2-a0e1-808357183d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.273957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a7851462-0d34-48f2-a0e1-808357183d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:40.277004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5f6c2c1-196b-4890-a815-ec53de32b208 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:40.277629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5f6c2c1-196b-4890-a815-ec53de32b208 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:40.282122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a7851462-0d34-48f2-a0e1-808357183d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.175842 May 23 13:58:40.282702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1257/2434] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:40 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:40.284333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f6c2c1-196b-4890-a815-ec53de32b208 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.284899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f6c2c1-196b-4890-a815-ec53de32b208 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.285680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f6c2c1-196b-4890-a815-ec53de32b208 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.286119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5f6c2c1-196b-4890-a815-ec53de32b208 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.419975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f5f6c2c1-196b-4890-a815-ec53de32b208 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:40.428544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5f6c2c1-196b-4890-a815-ec53de32b208 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155313 May 23 13:58:40.429135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1178/2435] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:40 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:40.444020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-462c61dd-5bf7-4b61-81c1-12fc434c98a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:40.444667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-462c61dd-5bf7-4b61-81c1-12fc434c98a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:40.450625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-462c61dd-5bf7-4b61-81c1-12fc434c98a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.451071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-462c61dd-5bf7-4b61-81c1-12fc434c98a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.451826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-462c61dd-5bf7-4b61-81c1-12fc434c98a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.452261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-462c61dd-5bf7-4b61-81c1-12fc434c98a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.515551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d42ec54d-e752-4d60-990c-b9b03e1e84cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:40.516527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d42ec54d-e752-4d60-990c-b9b03e1e84cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:40.523371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d42ec54d-e752-4d60-990c-b9b03e1e84cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.523825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d42ec54d-e752-4d60-990c-b9b03e1e84cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.524798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d42ec54d-e752-4d60-990c-b9b03e1e84cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.525239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d42ec54d-e752-4d60-990c-b9b03e1e84cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.588788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-462c61dd-5bf7-4b61-81c1-12fc434c98a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:40.596066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d42ec54d-e752-4d60-990c-b9b03e1e84cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:40.597857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-462c61dd-5bf7-4b61-81c1-12fc434c98a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158370 May 23 13:58:40.598478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1258/2436] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:40 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:40.605880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d42ec54d-e752-4d60-990c-b9b03e1e84cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094314 May 23 13:58:40.606447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1179/2437] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:40 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:40.674119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:40.674665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:40.681862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.682310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.683194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:40.683673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:40.748464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:40.757569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:40.759090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:40.760238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f5a6c69-478e-468c-96ff-17b50c857cbd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090185 May 23 13:58:40.760832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1259/2438] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:41.299597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bbe3134c-6a83-4b2c-ac8a-735945b9beaa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:41.300215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bbe3134c-6a83-4b2c-ac8a-735945b9beaa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:41.306859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbe3134c-6a83-4b2c-ac8a-735945b9beaa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.307317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbe3134c-6a83-4b2c-ac8a-735945b9beaa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.308079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbe3134c-6a83-4b2c-ac8a-735945b9beaa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.308542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbe3134c-6a83-4b2c-ac8a-735945b9beaa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.441552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbe3134c-6a83-4b2c-ac8a-735945b9beaa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:41.446780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f89a980c-963c-4d4d-8f6c-87a5751bbd1c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:41.447405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f89a980c-963c-4d4d-8f6c-87a5751bbd1c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:41.450075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bbe3134c-6a83-4b2c-ac8a-735945b9beaa tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.154316 May 23 13:58:41.450751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1180/2439] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:41 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:41.457783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f89a980c-963c-4d4d-8f6c-87a5751bbd1c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.458229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f89a980c-963c-4d4d-8f6c-87a5751bbd1c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.459071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f89a980c-963c-4d4d-8f6c-87a5751bbd1c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.459536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f89a980c-963c-4d4d-8f6c-87a5751bbd1c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.598644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f89a980c-963c-4d4d-8f6c-87a5751bbd1c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:41.602111 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:41.606972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f89a980c-963c-4d4d-8f6c-87a5751bbd1c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164101 May 23 13:58:41.607546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1260/2440] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:41 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:41.615350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e6c93b0-24d4-4bf8-93da-d4ae0ef43710 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:41.616032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e6c93b0-24d4-4bf8-93da-d4ae0ef43710 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:41.625679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e6c93b0-24d4-4bf8-93da-d4ae0ef43710 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.625679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e6c93b0-24d4-4bf8-93da-d4ae0ef43710 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.625952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-72a2a560-fd4b-4d3c-b0aa-976d9f8214ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:41.626061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e6c93b0-24d4-4bf8-93da-d4ae0ef43710 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.626061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e6c93b0-24d4-4bf8-93da-d4ae0ef43710 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.626233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-72a2a560-fd4b-4d3c-b0aa-976d9f8214ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:41.630764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72a2a560-fd4b-4d3c-b0aa-976d9f8214ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.631286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72a2a560-fd4b-4d3c-b0aa-976d9f8214ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.632064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72a2a560-fd4b-4d3c-b0aa-976d9f8214ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.632680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72a2a560-fd4b-4d3c-b0aa-976d9f8214ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.696938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-72a2a560-fd4b-4d3c-b0aa-976d9f8214ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:41.705337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-72a2a560-fd4b-4d3c-b0aa-976d9f8214ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085747 May 23 13:58:41.705936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1261/2441] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:41 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:41.764308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6e6c93b0-24d4-4bf8-93da-d4ae0ef43710 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:41.773185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e6c93b0-24d4-4bf8-93da-d4ae0ef43710 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162184 May 23 13:58:41.773878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1181/2442] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:41 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:41.778746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:41.779365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:41.785532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.786051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.786749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:41.787187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:41.849838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:41.858262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:41.859754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:41.860920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e3976105-ede1-4367-878b-17bc204e8390 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.086028 May 23 13:58:41.861481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1262/2443] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:41 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:42.467140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34411f49-0670-4d72-b899-f5bfe5245283 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:42.467687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-34411f49-0670-4d72-b899-f5bfe5245283 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:42.475319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34411f49-0670-4d72-b899-f5bfe5245283 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.475760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34411f49-0670-4d72-b899-f5bfe5245283 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.476517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34411f49-0670-4d72-b899-f5bfe5245283 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.476977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34411f49-0670-4d72-b899-f5bfe5245283 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.481037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:42.625274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-84ddc0bd-49da-4751-8fca-e02e3d3261e8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:42.626055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-84ddc0bd-49da-4751-8fca-e02e3d3261e8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:42.630106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34411f49-0670-4d72-b899-f5bfe5245283 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:42.633739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84ddc0bd-49da-4751-8fca-e02e3d3261e8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.634188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84ddc0bd-49da-4751-8fca-e02e3d3261e8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.635087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84ddc0bd-49da-4751-8fca-e02e3d3261e8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.635396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84ddc0bd-49da-4751-8fca-e02e3d3261e8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.639138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34411f49-0670-4d72-b899-f5bfe5245283 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.175919 May 23 13:58:42.639751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1182/2444] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:42 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:42.724349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5da4ff2-af35-4f54-863e-0cd557a12677 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:42.725011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5da4ff2-af35-4f54-863e-0cd557a12677 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:42.731275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5da4ff2-af35-4f54-863e-0cd557a12677 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.731754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5da4ff2-af35-4f54-863e-0cd557a12677 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.732622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5da4ff2-af35-4f54-863e-0cd557a12677 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.733070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5da4ff2-af35-4f54-863e-0cd557a12677 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.794253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84ddc0bd-49da-4751-8fca-e02e3d3261e8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:42.798514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5da4ff2-af35-4f54-863e-0cd557a12677 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:42.803236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-84ddc0bd-49da-4751-8fca-e02e3d3261e8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.181937 May 23 13:58:42.803829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1263/2445] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:42 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:42.807093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5da4ff2-af35-4f54-863e-0cd557a12677 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087453 May 23 13:58:42.808230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1183/2446] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:42 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:42.808786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-653709df-4abf-4f6d-a46c-d99299663c7c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:42.809420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-653709df-4abf-4f6d-a46c-d99299663c7c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:42.816040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-653709df-4abf-4f6d-a46c-d99299663c7c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.816894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-653709df-4abf-4f6d-a46c-d99299663c7c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.817672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-653709df-4abf-4f6d-a46c-d99299663c7c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.818253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-653709df-4abf-4f6d-a46c-d99299663c7c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.879869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:42.880485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:42.886984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.887433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.888191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:42.888647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:42.955308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-653709df-4abf-4f6d-a46c-d99299663c7c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:42.955694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:42.965939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:42.967554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:42.968017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-653709df-4abf-4f6d-a46c-d99299663c7c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163140 May 23 13:58:42.968637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1264/2447] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:42 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:42.968899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-51dd23b9-179a-478c-ad61-7eb1d71375c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.093503 May 23 13:58:42.969607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1184/2448] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:42 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:43.663247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c048657-d022-4a55-abdf-8e9ffb72fa04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:43.664201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c048657-d022-4a55-abdf-8e9ffb72fa04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:43.671314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c048657-d022-4a55-abdf-8e9ffb72fa04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:43.671768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c048657-d022-4a55-abdf-8e9ffb72fa04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:43.672623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c048657-d022-4a55-abdf-8e9ffb72fa04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:43.673069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c048657-d022-4a55-abdf-8e9ffb72fa04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:43.825457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3c048657-d022-4a55-abdf-8e9ffb72fa04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:43.828669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-583785a4-2d5a-4b4f-8692-f1597465b61a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:43.830217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-583785a4-2d5a-4b4f-8692-f1597465b61a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:43.834258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c048657-d022-4a55-abdf-8e9ffb72fa04 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.176241 May 23 13:58:43.835046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1265/2449] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:43 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:43.839732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-893fa271-3961-48c2-a73e-6db474cc2e2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:43.840343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-893fa271-3961-48c2-a73e-6db474cc2e2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:43.842483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-583785a4-2d5a-4b4f-8692-f1597465b61a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:43.843134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-583785a4-2d5a-4b4f-8692-f1597465b61a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:43.843687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-583785a4-2d5a-4b4f-8692-f1597465b61a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:43.844121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-583785a4-2d5a-4b4f-8692-f1597465b61a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:43.847843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-893fa271-3961-48c2-a73e-6db474cc2e2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:43.848300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-893fa271-3961-48c2-a73e-6db474cc2e2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:43.849341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-893fa271-3961-48c2-a73e-6db474cc2e2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:43.849782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-893fa271-3961-48c2-a73e-6db474cc2e2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:43.927893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-893fa271-3961-48c2-a73e-6db474cc2e2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:43.939917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-893fa271-3961-48c2-a73e-6db474cc2e2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.103651 May 23 13:58:43.941345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1266/2450] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:43 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:43.988095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ceeeda0a-cfc4-4b0c-be23-31b9c9375ea9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:43.988746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ceeeda0a-cfc4-4b0c-be23-31b9c9375ea9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:43.998046 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceeeda0a-cfc4-4b0c-be23-31b9c9375ea9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:43.999307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceeeda0a-cfc4-4b0c-be23-31b9c9375ea9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:44.000595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceeeda0a-cfc4-4b0c-be23-31b9c9375ea9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:44.001040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceeeda0a-cfc4-4b0c-be23-31b9c9375ea9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:44.012939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-583785a4-2d5a-4b4f-8692-f1597465b61a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:44.025306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-583785a4-2d5a-4b4f-8692-f1597465b61a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.202374 May 23 13:58:44.026181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1185/2451] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:43 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:44.041327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:44.041946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:44.049269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:44.049851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:44.050676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:44.051079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:44.122991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:44.131589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:44.132972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:44.134141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-061fb7a4-9461-4675-9982-e4bcb2156b7c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.097030 May 23 13:58:44.134914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1186/2452] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:44 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:44.171125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ceeeda0a-cfc4-4b0c-be23-31b9c9375ea9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:44.182826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ceeeda0a-cfc4-4b0c-be23-31b9c9375ea9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.199762 May 23 13:58:44.183681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1267/2453] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:43 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:44.853233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1ab0a284-12c6-4c65-a2e0-59ef1699c407 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:44.853848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1ab0a284-12c6-4c65-a2e0-59ef1699c407 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:44.860309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ab0a284-12c6-4c65-a2e0-59ef1699c407 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:44.860804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ab0a284-12c6-4c65-a2e0-59ef1699c407 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:44.861553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ab0a284-12c6-4c65-a2e0-59ef1699c407 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:44.861986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ab0a284-12c6-4c65-a2e0-59ef1699c407 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:44.958605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d499caca-b2fd-4732-8712-4cd395934eb2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:44.959305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d499caca-b2fd-4732-8712-4cd395934eb2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:44.965681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d499caca-b2fd-4732-8712-4cd395934eb2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:44.966131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d499caca-b2fd-4732-8712-4cd395934eb2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:44.966934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d499caca-b2fd-4732-8712-4cd395934eb2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:44.967349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d499caca-b2fd-4732-8712-4cd395934eb2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:44.999070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ab0a284-12c6-4c65-a2e0-59ef1699c407 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:45.008377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1ab0a284-12c6-4c65-a2e0-59ef1699c407 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158883 May 23 13:58:45.008993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1187/2454] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:44 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:45.032651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d499caca-b2fd-4732-8712-4cd395934eb2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:45.041834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d499caca-b2fd-4732-8712-4cd395934eb2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087353 May 23 13:58:45.042829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1268/2455] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:44 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:45.043847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-595fe791-dcbf-4ce1-98b3-4cab908493d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:45.044479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-595fe791-dcbf-4ce1-98b3-4cab908493d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:45.052779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-595fe791-dcbf-4ce1-98b3-4cab908493d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:45.053238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-595fe791-dcbf-4ce1-98b3-4cab908493d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:45.054042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-595fe791-dcbf-4ce1-98b3-4cab908493d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:45.054548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-595fe791-dcbf-4ce1-98b3-4cab908493d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:45.152418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:45.153070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:45.163940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:45.164405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:45.165232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:45.165676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:45.197992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-595fe791-dcbf-4ce1-98b3-4cab908493d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:45.207173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-595fe791-dcbf-4ce1-98b3-4cab908493d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.166469 May 23 13:58:45.207937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1188/2456] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:45 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:45.212795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b430eb81-4214-4835-a152-5d6e3f0fff76 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:45.213401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b430eb81-4214-4835-a152-5d6e3f0fff76 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:45.219574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b430eb81-4214-4835-a152-5d6e3f0fff76 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:45.220004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b430eb81-4214-4835-a152-5d6e3f0fff76 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:45.220820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b430eb81-4214-4835-a152-5d6e3f0fff76 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:45.221321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b430eb81-4214-4835-a152-5d6e3f0fff76 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:45.237522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:45.246891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:45.248791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:45.250188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49216918-2f53-471a-b4c3-92fa028a7411 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.101517 May 23 13:58:45.250893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1269/2457] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:45.360596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b430eb81-4214-4835-a152-5d6e3f0fff76 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:45.369661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b430eb81-4214-4835-a152-5d6e3f0fff76 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160706 May 23 13:58:45.370238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1189/2458] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:45 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:46.034734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ede06fd-7659-46ea-832f-d24cce153332 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:46.035734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8ede06fd-7659-46ea-832f-d24cce153332 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:46.042542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ede06fd-7659-46ea-832f-d24cce153332 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.042998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ede06fd-7659-46ea-832f-d24cce153332 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.043781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ede06fd-7659-46ea-832f-d24cce153332 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.044224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ede06fd-7659-46ea-832f-d24cce153332 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.059853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2ce9fe7-0b6d-41de-90cc-3e59fa5c2518 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:46.060661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c2ce9fe7-0b6d-41de-90cc-3e59fa5c2518 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:46.068448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2ce9fe7-0b6d-41de-90cc-3e59fa5c2518 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.068931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2ce9fe7-0b6d-41de-90cc-3e59fa5c2518 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.069757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2ce9fe7-0b6d-41de-90cc-3e59fa5c2518 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.070203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2ce9fe7-0b6d-41de-90cc-3e59fa5c2518 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.139750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c2ce9fe7-0b6d-41de-90cc-3e59fa5c2518 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:46.148608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c2ce9fe7-0b6d-41de-90cc-3e59fa5c2518 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092589 May 23 13:58:46.149378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1190/2459] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:46 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:46.187863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ede06fd-7659-46ea-832f-d24cce153332 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:46.196530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8ede06fd-7659-46ea-832f-d24cce153332 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.174530 May 23 13:58:46.197115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1270/2460] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:46 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:46.224945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a609a783-6ad9-450e-9a6e-da1cad45bf31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:46.225571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a609a783-6ad9-450e-9a6e-da1cad45bf31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:46.232557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a609a783-6ad9-450e-9a6e-da1cad45bf31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.233055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a609a783-6ad9-450e-9a6e-da1cad45bf31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.233831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a609a783-6ad9-450e-9a6e-da1cad45bf31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.234264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a609a783-6ad9-450e-9a6e-da1cad45bf31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.269692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:46.270410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:46.278654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.279131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.280042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.280491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.351087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:46.361421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:46.363391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:46.364617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a8095a8a-65cd-4860-9e2e-44db22b786dc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.099645 May 23 13:58:46.365196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1271/2461] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:46.380890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a609a783-6ad9-450e-9a6e-da1cad45bf31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:46.387336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4bb056a4-363f-4086-88c0-152e4036edd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:46.387877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4bb056a4-363f-4086-88c0-152e4036edd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:46.389435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a609a783-6ad9-450e-9a6e-da1cad45bf31 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.168990 May 23 13:58:46.390216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1191/2462] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:46 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:46.394833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb056a4-363f-4086-88c0-152e4036edd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.399967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb056a4-363f-4086-88c0-152e4036edd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.399967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb056a4-363f-4086-88c0-152e4036edd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:46.399967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb056a4-363f-4086-88c0-152e4036edd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:46.531054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4bb056a4-363f-4086-88c0-152e4036edd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:46.540034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4bb056a4-363f-4086-88c0-152e4036edd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156653 May 23 13:58:46.540730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1272/2463] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:46 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:47.165784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13149490-e08f-4114-9d39-818cbc0235b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:47.166369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-13149490-e08f-4114-9d39-818cbc0235b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:47.173009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13149490-e08f-4114-9d39-818cbc0235b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.173457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13149490-e08f-4114-9d39-818cbc0235b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.174248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13149490-e08f-4114-9d39-818cbc0235b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.175219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13149490-e08f-4114-9d39-818cbc0235b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.214891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-32fa1414-1045-4f88-8dd7-88730efb4eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:47.215515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-32fa1414-1045-4f88-8dd7-88730efb4eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:47.222653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32fa1414-1045-4f88-8dd7-88730efb4eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.223117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32fa1414-1045-4f88-8dd7-88730efb4eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.223902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32fa1414-1045-4f88-8dd7-88730efb4eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.224339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32fa1414-1045-4f88-8dd7-88730efb4eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.245190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-13149490-e08f-4114-9d39-818cbc0235b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:47.253817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-13149490-e08f-4114-9d39-818cbc0235b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091933 May 23 13:58:47.254387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1192/2464] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:47 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:47.360657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-32fa1414-1045-4f88-8dd7-88730efb4eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:47.372216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-32fa1414-1045-4f88-8dd7-88730efb4eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161636 May 23 13:58:47.372839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1273/2465] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:47 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:47.384007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:47.384630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:47.390641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.391089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.391832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.392262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.407203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-decab748-89e1-4280-ba89-0dabb42d6097 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:47.407828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-decab748-89e1-4280-ba89-0dabb42d6097 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:47.414671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-decab748-89e1-4280-ba89-0dabb42d6097 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.415125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-decab748-89e1-4280-ba89-0dabb42d6097 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.415981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-decab748-89e1-4280-ba89-0dabb42d6097 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.416336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-decab748-89e1-4280-ba89-0dabb42d6097 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.456054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:47.465219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:47.466766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:47.468030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3af5c962-5d74-4800-83dd-255c5d2a7ba7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088010 May 23 13:58:47.468030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1193/2466] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:47 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:47.549151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-decab748-89e1-4280-ba89-0dabb42d6097 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:47.560462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2b27ea37-c1e2-4be7-bd5b-4d9313856614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:47.561529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2b27ea37-c1e2-4be7-bd5b-4d9313856614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:47.562382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-decab748-89e1-4280-ba89-0dabb42d6097 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158687 May 23 13:58:47.563303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1274/2467] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:47 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:47.570106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b27ea37-c1e2-4be7-bd5b-4d9313856614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.570545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b27ea37-c1e2-4be7-bd5b-4d9313856614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.571302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b27ea37-c1e2-4be7-bd5b-4d9313856614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:47.571730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b27ea37-c1e2-4be7-bd5b-4d9313856614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:47.704770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2b27ea37-c1e2-4be7-bd5b-4d9313856614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:47.714575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2b27ea37-c1e2-4be7-bd5b-4d9313856614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160591 May 23 13:58:47.715147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1194/2468] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:47 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:48.270762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-898dd1a5-fa45-4d70-a825-ddc93601c44f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:48.271371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-898dd1a5-fa45-4d70-a825-ddc93601c44f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:48.278716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-898dd1a5-fa45-4d70-a825-ddc93601c44f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.279165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-898dd1a5-fa45-4d70-a825-ddc93601c44f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.279922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-898dd1a5-fa45-4d70-a825-ddc93601c44f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.280355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-898dd1a5-fa45-4d70-a825-ddc93601c44f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.389671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6091c186-8a1d-42d1-aa4c-b803725b594a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:48.390290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6091c186-8a1d-42d1-aa4c-b803725b594a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:48.398664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6091c186-8a1d-42d1-aa4c-b803725b594a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.399119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6091c186-8a1d-42d1-aa4c-b803725b594a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.399916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6091c186-8a1d-42d1-aa4c-b803725b594a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.400355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6091c186-8a1d-42d1-aa4c-b803725b594a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.547265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6091c186-8a1d-42d1-aa4c-b803725b594a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:48.557011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6091c186-8a1d-42d1-aa4c-b803725b594a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.171149 May 23 13:58:48.557600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1195/2469] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:48 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:48.562183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:48.562806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:48.572197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.573680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.574514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.574969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.605412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-898dd1a5-fa45-4d70-a825-ddc93601c44f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:48.614687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-898dd1a5-fa45-4d70-a825-ddc93601c44f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.347763 May 23 13:58:48.615259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1275/2470] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:48.620003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-96af71f5-12c3-4400-a8b9-4e18314a0da4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:48.620692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-96af71f5-12c3-4400-a8b9-4e18314a0da4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:48.626795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96af71f5-12c3-4400-a8b9-4e18314a0da4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.627258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96af71f5-12c3-4400-a8b9-4e18314a0da4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.628621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96af71f5-12c3-4400-a8b9-4e18314a0da4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.629066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96af71f5-12c3-4400-a8b9-4e18314a0da4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.640710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:48.653988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:48.655625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:48.656804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ccb64721-2264-4662-b3ea-fabe00df4c0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098253 May 23 13:58:48.657803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1196/2471] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:48.735349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5e65c7fa-c02e-45a1-b7c8-952e119eea86 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:48.735971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5e65c7fa-c02e-45a1-b7c8-952e119eea86 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:48.742491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e65c7fa-c02e-45a1-b7c8-952e119eea86 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.743015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e65c7fa-c02e-45a1-b7c8-952e119eea86 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.743785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e65c7fa-c02e-45a1-b7c8-952e119eea86 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:48.744218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e65c7fa-c02e-45a1-b7c8-952e119eea86 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:48.761793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-96af71f5-12c3-4400-a8b9-4e18314a0da4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:48.769915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-96af71f5-12c3-4400-a8b9-4e18314a0da4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153652 May 23 13:58:48.776019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1276/2472] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:48 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:48.873648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e65c7fa-c02e-45a1-b7c8-952e119eea86 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:48.882105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5e65c7fa-c02e-45a1-b7c8-952e119eea86 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.150589 May 23 13:58:48.882682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1197/2473] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:48 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:49.575481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee6d6940-c071-4a2c-9ed6-87c0e3f7fc69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:49.576097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee6d6940-c071-4a2c-9ed6-87c0e3f7fc69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:49.583635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee6d6940-c071-4a2c-9ed6-87c0e3f7fc69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.584112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee6d6940-c071-4a2c-9ed6-87c0e3f7fc69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.584908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee6d6940-c071-4a2c-9ed6-87c0e3f7fc69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.585349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee6d6940-c071-4a2c-9ed6-87c0e3f7fc69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.603973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:49.631761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-39a520ca-ff18-4b70-9e52-6954cf0a62d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:49.632555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-39a520ca-ff18-4b70-9e52-6954cf0a62d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:49.640085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39a520ca-ff18-4b70-9e52-6954cf0a62d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.640542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39a520ca-ff18-4b70-9e52-6954cf0a62d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.641343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39a520ca-ff18-4b70-9e52-6954cf0a62d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.641783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-39a520ca-ff18-4b70-9e52-6954cf0a62d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.710081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-39a520ca-ff18-4b70-9e52-6954cf0a62d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:49.713569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:49.719752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-39a520ca-ff18-4b70-9e52-6954cf0a62d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091484 May 23 13:58:49.720078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1198/2474] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:49 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:49.723752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee6d6940-c071-4a2c-9ed6-87c0e3f7fc69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:49.732460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:49.733081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee6d6940-c071-4a2c-9ed6-87c0e3f7fc69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161489 May 23 13:58:49.733230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:49.734330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1277/2475] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:49 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:49.739214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.740008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.740858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.741294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.785038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:58:49.785498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 13:58:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:58:49.791858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50624498-7b0b-4b6d-8c49-6564d9be0452 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:49.792474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50624498-7b0b-4b6d-8c49-6564d9be0452 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:49.800714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50624498-7b0b-4b6d-8c49-6564d9be0452 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.801724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50624498-7b0b-4b6d-8c49-6564d9be0452 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.802601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50624498-7b0b-4b6d-8c49-6564d9be0452 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.803038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50624498-7b0b-4b6d-8c49-6564d9be0452 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.804788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:49.813275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:49.814788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:49.816228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-25a203ae-9101-4cd2-90a0-cb0fb46304c6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.095443 May 23 13:58:49.816815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1199/2476] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:49 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:49.900324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4702e79b-37b6-47af-97ba-35242d03c353 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:49.900966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4702e79b-37b6-47af-97ba-35242d03c353 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:49.907009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4702e79b-37b6-47af-97ba-35242d03c353 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.907461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4702e79b-37b6-47af-97ba-35242d03c353 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.908230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4702e79b-37b6-47af-97ba-35242d03c353 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:49.909345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4702e79b-37b6-47af-97ba-35242d03c353 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:49.934346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-50624498-7b0b-4b6d-8c49-6564d9be0452 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:49.943395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50624498-7b0b-4b6d-8c49-6564d9be0452 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155993 May 23 13:58:49.943974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1278/2477] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:49 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:50.044337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4702e79b-37b6-47af-97ba-35242d03c353 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:50.053489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4702e79b-37b6-47af-97ba-35242d03c353 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156892 May 23 13:58:50.054088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1200/2478] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:49 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:50.737819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b4e54fe-8738-4659-af33-424b6a30735e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:50.738483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b4e54fe-8738-4659-af33-424b6a30735e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:50.745205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b4e54fe-8738-4659-af33-424b6a30735e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:50.745671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b4e54fe-8738-4659-af33-424b6a30735e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:50.746499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b4e54fe-8738-4659-af33-424b6a30735e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:50.746942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b4e54fe-8738-4659-af33-424b6a30735e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:50.750933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46bcc994-f7d2-4fdf-9eaa-39ab10b81250 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:50.758100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46bcc994-f7d2-4fdf-9eaa-39ab10b81250 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:50.758747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46bcc994-f7d2-4fdf-9eaa-39ab10b81250 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:50.759202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46bcc994-f7d2-4fdf-9eaa-39ab10b81250 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:50.759967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46bcc994-f7d2-4fdf-9eaa-39ab10b81250 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:50.760398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46bcc994-f7d2-4fdf-9eaa-39ab10b81250 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:50.814241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b4e54fe-8738-4659-af33-424b6a30735e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:50.823218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b4e54fe-8738-4659-af33-424b6a30735e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089844 May 23 13:58:50.823892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1279/2479] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:50.834206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:50.834870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:50.842821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:50.843345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:50.844205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:50.844745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:50.903060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46bcc994-f7d2-4fdf-9eaa-39ab10b81250 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:50.912370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46bcc994-f7d2-4fdf-9eaa-39ab10b81250 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165774 May 23 13:58:50.913352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1201/2480] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:50 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:50.915771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:50.925631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:50.927192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:50.928523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-34ef2853-49d9-4d52-8d5e-d2fcd0202829 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098408 May 23 13:58:50.929111 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1280/2481] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:50 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:50.960620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92404849-fa99-45e6-85f2-6e11eb4b4472 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:50.961241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-92404849-fa99-45e6-85f2-6e11eb4b4472 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:50.967511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92404849-fa99-45e6-85f2-6e11eb4b4472 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:50.967956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92404849-fa99-45e6-85f2-6e11eb4b4472 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:50.968757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92404849-fa99-45e6-85f2-6e11eb4b4472 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:50.969192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92404849-fa99-45e6-85f2-6e11eb4b4472 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:51.071488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02f8596f-547c-45e5-a3e1-eb2fb4cd2ec6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:51.072207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02f8596f-547c-45e5-a3e1-eb2fb4cd2ec6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:51.078333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02f8596f-547c-45e5-a3e1-eb2fb4cd2ec6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:51.078786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02f8596f-547c-45e5-a3e1-eb2fb4cd2ec6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:51.079554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02f8596f-547c-45e5-a3e1-eb2fb4cd2ec6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:51.079989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02f8596f-547c-45e5-a3e1-eb2fb4cd2ec6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:51.103903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-92404849-fa99-45e6-85f2-6e11eb4b4472 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:51.112792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-92404849-fa99-45e6-85f2-6e11eb4b4472 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155255 May 23 13:58:51.113370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1202/2482] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:50 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:51.214126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02f8596f-547c-45e5-a3e1-eb2fb4cd2ec6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:51.223215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02f8596f-547c-45e5-a3e1-eb2fb4cd2ec6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.155588 May 23 13:58:51.223787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1281/2483] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:51 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:51.840922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92fcda22-52f2-41ee-85e2-7aac5be12244 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:51.841488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-92fcda22-52f2-41ee-85e2-7aac5be12244 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:51.848255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92fcda22-52f2-41ee-85e2-7aac5be12244 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:51.848745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92fcda22-52f2-41ee-85e2-7aac5be12244 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:51.849518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92fcda22-52f2-41ee-85e2-7aac5be12244 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:51.849960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92fcda22-52f2-41ee-85e2-7aac5be12244 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:51.914594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-92fcda22-52f2-41ee-85e2-7aac5be12244 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:51.923095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-92fcda22-52f2-41ee-85e2-7aac5be12244 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086027 May 23 13:58:51.925846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1203/2484] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:51 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:51.930241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4805d6cd-ce63-431f-bc4a-a051ccfcd0f9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:51.930862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4805d6cd-ce63-431f-bc4a-a051ccfcd0f9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:51.938981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4805d6cd-ce63-431f-bc4a-a051ccfcd0f9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:51.939459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4805d6cd-ce63-431f-bc4a-a051ccfcd0f9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:51.941213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4805d6cd-ce63-431f-bc4a-a051ccfcd0f9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:51.941552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4805d6cd-ce63-431f-bc4a-a051ccfcd0f9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:51.948053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:51.948480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:51.954701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:51.955153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:51.956381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:51.956985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:52.029684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:52.039425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:52.040906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:52.042069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5dc3c3aa-c6dc-435b-a545-3131d5665145 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098491 May 23 13:58:52.042621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1204/2485] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:51 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:52.131179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d3db35e9-5a60-4fd7-9113-9855213d85df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:52.131950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d3db35e9-5a60-4fd7-9113-9855213d85df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:52.138083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3db35e9-5a60-4fd7-9113-9855213d85df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:52.138535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3db35e9-5a60-4fd7-9113-9855213d85df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:52.139301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3db35e9-5a60-4fd7-9113-9855213d85df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:52.139739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3db35e9-5a60-4fd7-9113-9855213d85df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:52.193134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4805d6cd-ce63-431f-bc4a-a051ccfcd0f9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:52.202157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4805d6cd-ce63-431f-bc4a-a051ccfcd0f9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.275352 May 23 13:58:52.203124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1282/2486] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:51 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:52.241900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-86847030-5823-4719-a663-99c10c90791f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:52.242525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-86847030-5823-4719-a663-99c10c90791f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:52.248638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86847030-5823-4719-a663-99c10c90791f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:52.249095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86847030-5823-4719-a663-99c10c90791f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:52.249871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86847030-5823-4719-a663-99c10c90791f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:52.250307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86847030-5823-4719-a663-99c10c90791f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:52.288144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d3db35e9-5a60-4fd7-9113-9855213d85df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:52.296600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d3db35e9-5a60-4fd7-9113-9855213d85df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.170531 May 23 13:58:52.297729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1205/2487] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:52 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:52.392237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-86847030-5823-4719-a663-99c10c90791f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:52.400870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-86847030-5823-4719-a663-99c10c90791f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162702 May 23 13:58:52.401446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1283/2488] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:52 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:52.941937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cf5e067e-0ab8-4912-a2a6-39cf4228087e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:52.942543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cf5e067e-0ab8-4912-a2a6-39cf4228087e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:52.949062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf5e067e-0ab8-4912-a2a6-39cf4228087e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:52.949551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf5e067e-0ab8-4912-a2a6-39cf4228087e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:52.950278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf5e067e-0ab8-4912-a2a6-39cf4228087e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:52.950713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf5e067e-0ab8-4912-a2a6-39cf4228087e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:53.019545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf5e067e-0ab8-4912-a2a6-39cf4228087e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:53.027754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cf5e067e-0ab8-4912-a2a6-39cf4228087e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090280 May 23 13:58:53.028316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1206/2489] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:52 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:53.062236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:53.063188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:53.073322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:53.074013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:53.075182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:53.075862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:53.147002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:53.155481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:53.157023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:53.158163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d6ff9210-50e2-463e-8b95-1dfcbe256b16 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.101231 May 23 13:58:53.158790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1284/2490] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:53 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:53.218496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6c23e9a5-1d86-45fe-b3d3-518f0b9f793e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:53.219027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6c23e9a5-1d86-45fe-b3d3-518f0b9f793e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:53.225506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c23e9a5-1d86-45fe-b3d3-518f0b9f793e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:53.225953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c23e9a5-1d86-45fe-b3d3-518f0b9f793e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:53.226714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c23e9a5-1d86-45fe-b3d3-518f0b9f793e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:53.227149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c23e9a5-1d86-45fe-b3d3-518f0b9f793e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:53.315591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b3a77495-3072-4345-87da-48b69a604eb9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:53.316207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b3a77495-3072-4345-87da-48b69a604eb9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:53.322544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3a77495-3072-4345-87da-48b69a604eb9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:53.322994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3a77495-3072-4345-87da-48b69a604eb9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:53.323765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3a77495-3072-4345-87da-48b69a604eb9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:53.324208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3a77495-3072-4345-87da-48b69a604eb9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:53.365380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6c23e9a5-1d86-45fe-b3d3-518f0b9f793e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:53.373909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6c23e9a5-1d86-45fe-b3d3-518f0b9f793e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159287 May 23 13:58:53.374495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1207/2491] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:53 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:53.420241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0b93f794-6d39-404f-a4fe-129b5859b078 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:53.421075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0b93f794-6d39-404f-a4fe-129b5859b078 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:53.427769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b93f794-6d39-404f-a4fe-129b5859b078 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:53.428221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b93f794-6d39-404f-a4fe-129b5859b078 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:53.429082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b93f794-6d39-404f-a4fe-129b5859b078 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:53.429461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b93f794-6d39-404f-a4fe-129b5859b078 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:53.463576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3a77495-3072-4345-87da-48b69a604eb9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:53.471933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b3a77495-3072-4345-87da-48b69a604eb9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160520 May 23 13:58:53.472445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1285/2492] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:53 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:53.567058 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0b93f794-6d39-404f-a4fe-129b5859b078 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:53.575172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0b93f794-6d39-404f-a4fe-129b5859b078 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159741 May 23 13:58:53.575741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1208/2493] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:53 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:54.044556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a2b0816-145f-4cec-a8ae-9858e5aaec68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:54.045193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a2b0816-145f-4cec-a8ae-9858e5aaec68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:54.052212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a2b0816-145f-4cec-a8ae-9858e5aaec68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.052705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a2b0816-145f-4cec-a8ae-9858e5aaec68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.053487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a2b0816-145f-4cec-a8ae-9858e5aaec68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.053925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a2b0816-145f-4cec-a8ae-9858e5aaec68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.117001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a2b0816-145f-4cec-a8ae-9858e5aaec68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:54.124983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a2b0816-145f-4cec-a8ae-9858e5aaec68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084312 May 23 13:58:54.125542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1286/2494] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:54 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:54.177610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:54.178152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:54.184918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.185374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.186140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.186583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.250532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:54.259095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:54.260614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:54.261756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0cfd4336-3be5-4e23-b84f-8aac9be44f68 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089816 May 23 13:58:54.262311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1209/2495] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:54 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:54.391783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6c5465bb-247c-4933-9d69-726d1306aa0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:54.392436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6c5465bb-247c-4933-9d69-726d1306aa0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:54.399716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c5465bb-247c-4933-9d69-726d1306aa0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.400176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c5465bb-247c-4933-9d69-726d1306aa0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.400985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c5465bb-247c-4933-9d69-726d1306aa0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.401448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c5465bb-247c-4933-9d69-726d1306aa0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.490122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db50f5f0-fecb-4b0e-8e8e-12ffdb689cff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:54.490774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db50f5f0-fecb-4b0e-8e8e-12ffdb689cff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:54.496894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db50f5f0-fecb-4b0e-8e8e-12ffdb689cff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.497345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db50f5f0-fecb-4b0e-8e8e-12ffdb689cff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.498114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db50f5f0-fecb-4b0e-8e8e-12ffdb689cff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.498554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db50f5f0-fecb-4b0e-8e8e-12ffdb689cff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.533686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c5465bb-247c-4933-9d69-726d1306aa0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:54.541973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6c5465bb-247c-4933-9d69-726d1306aa0d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.154063 May 23 13:58:54.542585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1287/2496] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:54 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:54.592314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c0a0d1f-9936-46a9-bda4-fe475f39e911 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:54.592994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c0a0d1f-9936-46a9-bda4-fe475f39e911 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:54.600097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c0a0d1f-9936-46a9-bda4-fe475f39e911 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.600546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c0a0d1f-9936-46a9-bda4-fe475f39e911 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.601350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c0a0d1f-9936-46a9-bda4-fe475f39e911 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:54.601783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c0a0d1f-9936-46a9-bda4-fe475f39e911 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:54.643403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db50f5f0-fecb-4b0e-8e8e-12ffdb689cff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:54.653590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db50f5f0-fecb-4b0e-8e8e-12ffdb689cff tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.168114 May 23 13:58:54.663746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1210/2497] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:54 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:54.753313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c0a0d1f-9936-46a9-bda4-fe475f39e911 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:54.761335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c0a0d1f-9936-46a9-bda4-fe475f39e911 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.173077 May 23 13:58:54.761988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1288/2498] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:54 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:55.143113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d91713cf-148b-468a-80e9-285c1bc5ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:55.143715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d91713cf-148b-468a-80e9-285c1bc5ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:55.150549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d91713cf-148b-468a-80e9-285c1bc5ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.151010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d91713cf-148b-468a-80e9-285c1bc5ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.151953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d91713cf-148b-468a-80e9-285c1bc5ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.152392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d91713cf-148b-468a-80e9-285c1bc5ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.226964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d91713cf-148b-468a-80e9-285c1bc5ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:55.235716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d91713cf-148b-468a-80e9-285c1bc5ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.097272 May 23 13:58:55.236288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1211/2499] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:55 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:55.281004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:55.281623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:55.288397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.288952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.289720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.290153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.358488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:55.371107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:55.387356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:55.387356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0fcbbb37-9c04-4431-b56c-3453b17f4194 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.097101 May 23 13:58:55.387356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1289/2500] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:55 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:55.559793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfd66d67-5d74-4f85-b6d1-ac036f4c9cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:55.560338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bfd66d67-5d74-4f85-b6d1-ac036f4c9cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:55.567562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfd66d67-5d74-4f85-b6d1-ac036f4c9cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.579806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfd66d67-5d74-4f85-b6d1-ac036f4c9cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.579806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfd66d67-5d74-4f85-b6d1-ac036f4c9cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.579806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfd66d67-5d74-4f85-b6d1-ac036f4c9cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.672149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-040a8e7f-d2e7-41b8-b9ce-2419e06a4919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:55.672804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-040a8e7f-d2e7-41b8-b9ce-2419e06a4919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:55.679688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-040a8e7f-d2e7-41b8-b9ce-2419e06a4919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.680138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-040a8e7f-d2e7-41b8-b9ce-2419e06a4919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.680992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-040a8e7f-d2e7-41b8-b9ce-2419e06a4919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.681413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-040a8e7f-d2e7-41b8-b9ce-2419e06a4919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.722349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfd66d67-5d74-4f85-b6d1-ac036f4c9cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:55.731093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bfd66d67-5d74-4f85-b6d1-ac036f4c9cc3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.175286 May 23 13:58:55.732120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1212/2501] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:55 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:55.779559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6a55a0dd-f96b-4783-8843-06bcf00fcc33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:55.780210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6a55a0dd-f96b-4783-8843-06bcf00fcc33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:55.786915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a55a0dd-f96b-4783-8843-06bcf00fcc33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.787374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a55a0dd-f96b-4783-8843-06bcf00fcc33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.788146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a55a0dd-f96b-4783-8843-06bcf00fcc33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:55.788603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a55a0dd-f96b-4783-8843-06bcf00fcc33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:55.819543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-040a8e7f-d2e7-41b8-b9ce-2419e06a4919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:55.828221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-040a8e7f-d2e7-41b8-b9ce-2419e06a4919 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160034 May 23 13:58:55.828705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1290/2502] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:55 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:55.926535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6a55a0dd-f96b-4783-8843-06bcf00fcc33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:55.934607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6a55a0dd-f96b-4783-8843-06bcf00fcc33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159122 May 23 13:58:55.935170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1213/2503] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:55 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:56.252244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-476f9afb-49e4-4b1d-9106-49b177bfcc74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:56.253994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-476f9afb-49e4-4b1d-9106-49b177bfcc74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:56.259674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-476f9afb-49e4-4b1d-9106-49b177bfcc74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.260215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-476f9afb-49e4-4b1d-9106-49b177bfcc74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:56.261021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-476f9afb-49e4-4b1d-9106-49b177bfcc74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.261458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-476f9afb-49e4-4b1d-9106-49b177bfcc74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:56.327442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-476f9afb-49e4-4b1d-9106-49b177bfcc74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:56.337313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-476f9afb-49e4-4b1d-9106-49b177bfcc74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088968 May 23 13:58:56.337877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1291/2504] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:56 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:56.403620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:56.404236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:56.411921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.412378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:56.413214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.413651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:56.483905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:56.493177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:56.494762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:56.495938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3add37aa-3627-4267-975f-7e26f048e7da tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.096305 May 23 13:58:56.496500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1214/2505] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:56 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:58:56.748964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7119e7cd-928a-44c0-a672-27b35dc927f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:56.749633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7119e7cd-928a-44c0-a672-27b35dc927f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:56.756741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7119e7cd-928a-44c0-a672-27b35dc927f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.761812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7119e7cd-928a-44c0-a672-27b35dc927f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:56.761812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7119e7cd-928a-44c0-a672-27b35dc927f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.761812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7119e7cd-928a-44c0-a672-27b35dc927f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:56.846746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-afa199f8-2207-46a7-9899-ac2f4ad89e9a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:56.847397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-afa199f8-2207-46a7-9899-ac2f4ad89e9a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:56.854415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afa199f8-2207-46a7-9899-ac2f4ad89e9a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.854869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afa199f8-2207-46a7-9899-ac2f4ad89e9a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:56.855662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afa199f8-2207-46a7-9899-ac2f4ad89e9a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.856105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-afa199f8-2207-46a7-9899-ac2f4ad89e9a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:56.876077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:56.902735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7119e7cd-928a-44c0-a672-27b35dc927f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:56.913003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7119e7cd-928a-44c0-a672-27b35dc927f1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.167960 May 23 13:58:56.913590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1292/2506] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:56 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:56.953244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-43e6533e-56b1-4151-ae0b-76f8d7b39766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:56.956920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-43e6533e-56b1-4151-ae0b-76f8d7b39766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:56.961301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43e6533e-56b1-4151-ae0b-76f8d7b39766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.961741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43e6533e-56b1-4151-ae0b-76f8d7b39766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:56.962536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43e6533e-56b1-4151-ae0b-76f8d7b39766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:56.962984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43e6533e-56b1-4151-ae0b-76f8d7b39766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:57.010659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-afa199f8-2207-46a7-9899-ac2f4ad89e9a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:57.026806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-afa199f8-2207-46a7-9899-ac2f4ad89e9a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.184402 May 23 13:58:57.027901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1215/2507] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:56 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:57.121353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-43e6533e-56b1-4151-ae0b-76f8d7b39766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:57.130173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-43e6533e-56b1-4151-ae0b-76f8d7b39766 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.180997 May 23 13:58:57.130739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1293/2508] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:56 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:57.355368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f0ac0b69-fc6b-499f-84dc-a05e27215318 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:57.356042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f0ac0b69-fc6b-499f-84dc-a05e27215318 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:57.363493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0ac0b69-fc6b-499f-84dc-a05e27215318 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:57.363954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0ac0b69-fc6b-499f-84dc-a05e27215318 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:57.364775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0ac0b69-fc6b-499f-84dc-a05e27215318 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:57.365217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0ac0b69-fc6b-499f-84dc-a05e27215318 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:57.432195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f0ac0b69-fc6b-499f-84dc-a05e27215318 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:57.441097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f0ac0b69-fc6b-499f-84dc-a05e27215318 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089565 May 23 13:58:57.441664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1216/2509] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:57 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:57.514613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:57.515275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:57.523089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:57.523544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:57.524362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:57.524845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:57.529658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:57.598155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:57.607301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:57.608929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:57.610134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-78667399-e639-40b5-aceb-876b34d03ef9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.099543 May 23 13:58:57.610699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1294/2510] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:57 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:57.931734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ecc981c4-1fbf-44d8-b17e-932645c78627 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:57.932433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ecc981c4-1fbf-44d8-b17e-932645c78627 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:57.934482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:58:57.939213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ecc981c4-1fbf-44d8-b17e-932645c78627 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:57.944914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ecc981c4-1fbf-44d8-b17e-932645c78627 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:57.944914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ecc981c4-1fbf-44d8-b17e-932645c78627 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:57.944914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ecc981c4-1fbf-44d8-b17e-932645c78627 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:58.043725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4310d852-fc6a-4fa1-a0db-f3d458f8923b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:58.044338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4310d852-fc6a-4fa1-a0db-f3d458f8923b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:58.050745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4310d852-fc6a-4fa1-a0db-f3d458f8923b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:58.051191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4310d852-fc6a-4fa1-a0db-f3d458f8923b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:58.051970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4310d852-fc6a-4fa1-a0db-f3d458f8923b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:58.052404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4310d852-fc6a-4fa1-a0db-f3d458f8923b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:58.076837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ecc981c4-1fbf-44d8-b17e-932645c78627 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:58.085903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ecc981c4-1fbf-44d8-b17e-932645c78627 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158847 May 23 13:58:58.086485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1217/2511] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:57 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:58.148353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bc7e26f6-4b2d-4a2e-b101-9f857d3b6051 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:58.149024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bc7e26f6-4b2d-4a2e-b101-9f857d3b6051 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:58.155393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc7e26f6-4b2d-4a2e-b101-9f857d3b6051 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:58.155864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc7e26f6-4b2d-4a2e-b101-9f857d3b6051 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:58.156634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc7e26f6-4b2d-4a2e-b101-9f857d3b6051 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:58.157070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc7e26f6-4b2d-4a2e-b101-9f857d3b6051 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:58.219097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4310d852-fc6a-4fa1-a0db-f3d458f8923b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:58.228030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4310d852-fc6a-4fa1-a0db-f3d458f8923b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.188061 May 23 13:58:58.228631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1295/2512] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:58 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:58.326955 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bc7e26f6-4b2d-4a2e-b101-9f857d3b6051 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:58.339217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bc7e26f6-4b2d-4a2e-b101-9f857d3b6051 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.194719 May 23 13:58:58.339808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1218/2513] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:58 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:58.459686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2ca8f4d-87dd-4065-86a0-411598427804 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:58.460195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2ca8f4d-87dd-4065-86a0-411598427804 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:58.468389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2ca8f4d-87dd-4065-86a0-411598427804 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:58.468881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2ca8f4d-87dd-4065-86a0-411598427804 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:58.469673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2ca8f4d-87dd-4065-86a0-411598427804 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:58.470117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2ca8f4d-87dd-4065-86a0-411598427804 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:58.542250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2ca8f4d-87dd-4065-86a0-411598427804 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:58.551755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2ca8f4d-87dd-4065-86a0-411598427804 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.097094 May 23 13:58:58.552354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1296/2514] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:58 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:58.629050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:58.629680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:58.636603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:58.637060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:58.637841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:58.638273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:58.714168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:58.724927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:58.726556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:58.727785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d51d3951-2fa2-411e-92d0-6f053e33abb7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.102713 May 23 13:58:58.728371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1219/2515] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:58:59.110804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c39b817-fdf4-4086-8334-427f1fe1366e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:59.111519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c39b817-fdf4-4086-8334-427f1fe1366e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:59.118302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c39b817-fdf4-4086-8334-427f1fe1366e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.118769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c39b817-fdf4-4086-8334-427f1fe1366e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.119560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c39b817-fdf4-4086-8334-427f1fe1366e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.120007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c39b817-fdf4-4086-8334-427f1fe1366e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.250982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b546ec42-bb0d-4d61-a07a-a3e3416f0239 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:59.253080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b546ec42-bb0d-4d61-a07a-a3e3416f0239 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:59.263400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b546ec42-bb0d-4d61-a07a-a3e3416f0239 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.264203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b546ec42-bb0d-4d61-a07a-a3e3416f0239 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.265351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b546ec42-bb0d-4d61-a07a-a3e3416f0239 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.265951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b546ec42-bb0d-4d61-a07a-a3e3416f0239 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.271288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3c39b817-fdf4-4086-8334-427f1fe1366e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:59.279830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c39b817-fdf4-4086-8334-427f1fe1366e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.172976 May 23 13:58:59.280414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1297/2516] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:59 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:59.356385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5bb515d2-9656-452e-8b3a-89573caa68a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:59.356904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5bb515d2-9656-452e-8b3a-89573caa68a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:59.363889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bb515d2-9656-452e-8b3a-89573caa68a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.364337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bb515d2-9656-452e-8b3a-89573caa68a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.365131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bb515d2-9656-452e-8b3a-89573caa68a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.365563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5bb515d2-9656-452e-8b3a-89573caa68a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.412662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b546ec42-bb0d-4d61-a07a-a3e3416f0239 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:59.421607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b546ec42-bb0d-4d61-a07a-a3e3416f0239 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.178108 May 23 13:58:59.422193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1220/2517] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:59 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:59.519366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5bb515d2-9656-452e-8b3a-89573caa68a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:59.534143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5bb515d2-9656-452e-8b3a-89573caa68a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.180335 May 23 13:58:59.535264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1298/2518] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:59 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:58:59.569957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f2a52e0-a75d-4024-9ef4-1bdb768a53dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:59.570565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f2a52e0-a75d-4024-9ef4-1bdb768a53dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:59.576736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f2a52e0-a75d-4024-9ef4-1bdb768a53dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.577184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f2a52e0-a75d-4024-9ef4-1bdb768a53dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.577940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f2a52e0-a75d-4024-9ef4-1bdb768a53dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.578369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f2a52e0-a75d-4024-9ef4-1bdb768a53dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.644516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f2a52e0-a75d-4024-9ef4-1bdb768a53dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:59.652782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f2a52e0-a75d-4024-9ef4-1bdb768a53dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086531 May 23 13:58:59.653365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1221/2519] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:58:59 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:58:59.747191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:58:59.747851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:58:59.755035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.755493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.756289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:58:59.756770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:58:59.824908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:59.834912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:59.836483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:58:59.837759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39870ea4-b491-4071-8689-81d359552605 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094711 May 23 13:58:59.838336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1299/2520] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:58:59 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:00.297519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e4fe3985-2b61-4cfe-9a18-c4f8b78c1a20 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:00.298136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e4fe3985-2b61-4cfe-9a18-c4f8b78c1a20 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:00.304561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4fe3985-2b61-4cfe-9a18-c4f8b78c1a20 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.305032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4fe3985-2b61-4cfe-9a18-c4f8b78c1a20 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.305790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4fe3985-2b61-4cfe-9a18-c4f8b78c1a20 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.306222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4fe3985-2b61-4cfe-9a18-c4f8b78c1a20 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.439732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cfef151b-f71f-4f32-84a8-38cedd201cad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:00.440284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cfef151b-f71f-4f32-84a8-38cedd201cad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:00.445214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e4fe3985-2b61-4cfe-9a18-c4f8b78c1a20 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:00.446866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfef151b-f71f-4f32-84a8-38cedd201cad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.447386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfef151b-f71f-4f32-84a8-38cedd201cad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.448227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfef151b-f71f-4f32-84a8-38cedd201cad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.448693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cfef151b-f71f-4f32-84a8-38cedd201cad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.453780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e4fe3985-2b61-4cfe-9a18-c4f8b78c1a20 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160052 May 23 13:59:00.454466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1222/2521] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:00 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:00.552839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-63b4f029-9622-4652-824c-7d25746ad19a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:00.553466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-63b4f029-9622-4652-824c-7d25746ad19a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:00.560400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63b4f029-9622-4652-824c-7d25746ad19a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.560894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63b4f029-9622-4652-824c-7d25746ad19a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.561697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63b4f029-9622-4652-824c-7d25746ad19a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.562122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63b4f029-9622-4652-824c-7d25746ad19a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.599286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cfef151b-f71f-4f32-84a8-38cedd201cad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:00.614908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cfef151b-f71f-4f32-84a8-38cedd201cad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.179166 May 23 13:59:00.615987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1300/2522] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:00 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:00.674838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0623ac59-b0d0-4f11-914b-c49cabb12292 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:00.675699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0623ac59-b0d0-4f11-914b-c49cabb12292 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:00.711153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0623ac59-b0d0-4f11-914b-c49cabb12292 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.711153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0623ac59-b0d0-4f11-914b-c49cabb12292 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.711153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0623ac59-b0d0-4f11-914b-c49cabb12292 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.711153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0623ac59-b0d0-4f11-914b-c49cabb12292 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.729743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-63b4f029-9622-4652-824c-7d25746ad19a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:00.739813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-63b4f029-9622-4652-824c-7d25746ad19a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.191521 May 23 13:59:00.740683 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1223/2523] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:00 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:00.776934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0623ac59-b0d0-4f11-914b-c49cabb12292 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:00.786198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0623ac59-b0d0-4f11-914b-c49cabb12292 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.116555 May 23 13:59:00.786801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1301/2524] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:00 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:00.857788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:00.858400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:00.866299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.866750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.867552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:00.868046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:00.937252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:00.946857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:00.948425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:00.949617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04c82ac6-5533-4f74-8786-ed8a1f81948c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.095982 May 23 13:59:00.950187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1224/2525] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:01.472077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-249a92d3-b00b-47b5-94cf-22b9e84cd76d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:01.472678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-249a92d3-b00b-47b5-94cf-22b9e84cd76d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:01.479351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-249a92d3-b00b-47b5-94cf-22b9e84cd76d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.479858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-249a92d3-b00b-47b5-94cf-22b9e84cd76d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:01.480711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-249a92d3-b00b-47b5-94cf-22b9e84cd76d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.481267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-249a92d3-b00b-47b5-94cf-22b9e84cd76d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:01.632635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-249a92d3-b00b-47b5-94cf-22b9e84cd76d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:01.635671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-08c78bcd-d204-4223-8c75-2780bd442bf1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:01.636385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-08c78bcd-d204-4223-8c75-2780bd442bf1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:01.641293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-249a92d3-b00b-47b5-94cf-22b9e84cd76d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.173323 May 23 13:59:01.641899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1302/2526] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:01 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:01.644154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c78bcd-d204-4223-8c75-2780bd442bf1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.644640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c78bcd-d204-4223-8c75-2780bd442bf1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:01.645427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c78bcd-d204-4223-8c75-2780bd442bf1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.645879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08c78bcd-d204-4223-8c75-2780bd442bf1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:01.764624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15353107-3da9-4776-8a24-87648850bcb9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:01.765253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15353107-3da9-4776-8a24-87648850bcb9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:01.767650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:01.773016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15353107-3da9-4776-8a24-87648850bcb9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.773599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15353107-3da9-4776-8a24-87648850bcb9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:01.774484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15353107-3da9-4776-8a24-87648850bcb9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.774863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15353107-3da9-4776-8a24-87648850bcb9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:01.791913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08c78bcd-d204-4223-8c75-2780bd442bf1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:01.805267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-08c78bcd-d204-4223-8c75-2780bd442bf1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.174149 May 23 13:59:01.816137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1225/2527] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:01 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:01.816137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5ecb676d-29d1-4a42-9346-f516bf398923 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:01.816137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5ecb676d-29d1-4a42-9346-f516bf398923 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:01.820133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ecb676d-29d1-4a42-9346-f516bf398923 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.820745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ecb676d-29d1-4a42-9346-f516bf398923 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:01.821608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ecb676d-29d1-4a42-9346-f516bf398923 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.822120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ecb676d-29d1-4a42-9346-f516bf398923 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:01.896145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5ecb676d-29d1-4a42-9346-f516bf398923 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:01.907341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5ecb676d-29d1-4a42-9346-f516bf398923 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.098805 May 23 13:59:01.908218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1226/2528] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:01 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:01.930355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15353107-3da9-4776-8a24-87648850bcb9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:01.938852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15353107-3da9-4776-8a24-87648850bcb9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.179323 May 23 13:59:01.940085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1303/2529] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:01 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:01.970853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:01.971358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:01.977695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.978143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:01.978951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:01.979387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:02.043221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:02.052531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:02.054091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:02.055247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-116d4764-a41d-477f-8928-8a7abd546a6f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088953 May 23 13:59:02.055803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1227/2530] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:01 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:02.659631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9b259782-668e-45eb-a82b-c0c1f18b71fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:02.660251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9b259782-668e-45eb-a82b-c0c1f18b71fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:02.667039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b259782-668e-45eb-a82b-c0c1f18b71fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:02.667489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b259782-668e-45eb-a82b-c0c1f18b71fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:02.668257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b259782-668e-45eb-a82b-c0c1f18b71fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:02.668722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b259782-668e-45eb-a82b-c0c1f18b71fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:02.809946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9b259782-668e-45eb-a82b-c0c1f18b71fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:02.818845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9b259782-668e-45eb-a82b-c0c1f18b71fc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164105 May 23 13:59:02.819474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1304/2531] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:02 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:02.823376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4d0453bc-5f92-4d9c-b9a2-6c5b62ced4b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:02.824025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4d0453bc-5f92-4d9c-b9a2-6c5b62ced4b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:02.830808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d0453bc-5f92-4d9c-b9a2-6c5b62ced4b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:02.831252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d0453bc-5f92-4d9c-b9a2-6c5b62ced4b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:02.832562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d0453bc-5f92-4d9c-b9a2-6c5b62ced4b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:02.833041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d0453bc-5f92-4d9c-b9a2-6c5b62ced4b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:02.925010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-296b29ea-9b49-4a6e-b4be-c32cb2bf803a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:02.925662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-296b29ea-9b49-4a6e-b4be-c32cb2bf803a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:02.931960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-296b29ea-9b49-4a6e-b4be-c32cb2bf803a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:02.932595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-296b29ea-9b49-4a6e-b4be-c32cb2bf803a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:02.933222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-296b29ea-9b49-4a6e-b4be-c32cb2bf803a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:02.933666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-296b29ea-9b49-4a6e-b4be-c32cb2bf803a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:02.980372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4d0453bc-5f92-4d9c-b9a2-6c5b62ced4b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:02.989262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4d0453bc-5f92-4d9c-b9a2-6c5b62ced4b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.169694 May 23 13:59:02.989933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1228/2532] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:02 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:02.994485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c921556-2983-42a0-9e44-09d024aaef82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:02.995155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c921556-2983-42a0-9e44-09d024aaef82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:03.001087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c921556-2983-42a0-9e44-09d024aaef82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:03.002231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c921556-2983-42a0-9e44-09d024aaef82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:03.003034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c921556-2983-42a0-9e44-09d024aaef82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:03.003614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c921556-2983-42a0-9e44-09d024aaef82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:03.005607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-296b29ea-9b49-4a6e-b4be-c32cb2bf803a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:03.013677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-296b29ea-9b49-4a6e-b4be-c32cb2bf803a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092595 May 23 13:59:03.014245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1305/2533] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:02 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:03.073471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:03.074085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:03.081432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:03.081891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:03.082663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:03.083179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:03.139935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c921556-2983-42a0-9e44-09d024aaef82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:03.150185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c921556-2983-42a0-9e44-09d024aaef82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159091 May 23 13:59:03.150984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1229/2534] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:02 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:03.161798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:03.172543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:03.174720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:03.175966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e7cc607-df7c-440f-8e79-6836e89b0b32 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.106375 May 23 13:59:03.176549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1306/2535] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:03 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:03.837127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e1e67070-bfe5-4ae0-a817-5b7ebf61df65 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:03.837753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e1e67070-bfe5-4ae0-a817-5b7ebf61df65 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:03.846020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1e67070-bfe5-4ae0-a817-5b7ebf61df65 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:03.846472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1e67070-bfe5-4ae0-a817-5b7ebf61df65 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:03.847263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1e67070-bfe5-4ae0-a817-5b7ebf61df65 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:03.847697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1e67070-bfe5-4ae0-a817-5b7ebf61df65 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:04.003754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e1e67070-bfe5-4ae0-a817-5b7ebf61df65 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:04.007835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-41bcb405-08e3-4dd1-893b-0d243851107c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:04.008461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-41bcb405-08e3-4dd1-893b-0d243851107c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:04.012949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e1e67070-bfe5-4ae0-a817-5b7ebf61df65 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.179649 May 23 13:59:04.013541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1230/2536] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:03 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:04.016277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41bcb405-08e3-4dd1-893b-0d243851107c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:04.016874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41bcb405-08e3-4dd1-893b-0d243851107c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:04.018252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41bcb405-08e3-4dd1-893b-0d243851107c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:04.018709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41bcb405-08e3-4dd1-893b-0d243851107c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:04.032270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc890fb3-daad-4dc6-9536-f0a41c1f1b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:04.033711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc890fb3-daad-4dc6-9536-f0a41c1f1b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:04.041918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc890fb3-daad-4dc6-9536-f0a41c1f1b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:04.042416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc890fb3-daad-4dc6-9536-f0a41c1f1b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:04.043152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc890fb3-daad-4dc6-9536-f0a41c1f1b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:04.043598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc890fb3-daad-4dc6-9536-f0a41c1f1b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:04.120991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dc890fb3-daad-4dc6-9536-f0a41c1f1b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:04.132817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc890fb3-daad-4dc6-9536-f0a41c1f1b46 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.104331 May 23 13:59:04.133463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1231/2537] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:04 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:04.167580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b72c3a5a-dfc7-42a0-91e6-2bdb5a109be3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:04.168227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b72c3a5a-dfc7-42a0-91e6-2bdb5a109be3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:04.175076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b72c3a5a-dfc7-42a0-91e6-2bdb5a109be3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:04.175522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b72c3a5a-dfc7-42a0-91e6-2bdb5a109be3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:04.176365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b72c3a5a-dfc7-42a0-91e6-2bdb5a109be3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:04.176852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b72c3a5a-dfc7-42a0-91e6-2bdb5a109be3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:04.181656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:04.201154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-41bcb405-08e3-4dd1-893b-0d243851107c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:04.211484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-41bcb405-08e3-4dd1-893b-0d243851107c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.208102 May 23 13:59:04.212088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1307/2538] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:04 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:04.216956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:04.217581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:04.225025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:04.225486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:04.226283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:04.226729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:04.303824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:04.313423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:04.315806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:04.317027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37d32087-2230-4f40-8a37-9fc12aca0de5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.103961 May 23 13:59:04.317821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1308/2539] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:04 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:04.330788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b72c3a5a-dfc7-42a0-91e6-2bdb5a109be3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:04.339268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b72c3a5a-dfc7-42a0-91e6-2bdb5a109be3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.175668 May 23 13:59:04.339853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1232/2540] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:04 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:05.039103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9c3055f3-48fa-4e83-8c77-a2fe265e7186 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:05.039718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9c3055f3-48fa-4e83-8c77-a2fe265e7186 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:05.046977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c3055f3-48fa-4e83-8c77-a2fe265e7186 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.047440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c3055f3-48fa-4e83-8c77-a2fe265e7186 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.048259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c3055f3-48fa-4e83-8c77-a2fe265e7186 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.048813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c3055f3-48fa-4e83-8c77-a2fe265e7186 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.154662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc3e244c-36e1-4a22-9c26-55759820f7f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:05.155631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc3e244c-36e1-4a22-9c26-55759820f7f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:05.166433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc3e244c-36e1-4a22-9c26-55759820f7f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.167036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc3e244c-36e1-4a22-9c26-55759820f7f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.173512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc3e244c-36e1-4a22-9c26-55759820f7f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.173512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc3e244c-36e1-4a22-9c26-55759820f7f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.222778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c3055f3-48fa-4e83-8c77-a2fe265e7186 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:05.233240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9c3055f3-48fa-4e83-8c77-a2fe265e7186 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.198146 May 23 13:59:05.234073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1309/2541] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:05 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:05.239859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-719f3633-97f7-44dd-8c96-490197771164 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:05.240721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-719f3633-97f7-44dd-8c96-490197771164 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:05.248324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-719f3633-97f7-44dd-8c96-490197771164 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.249050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-719f3633-97f7-44dd-8c96-490197771164 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.250188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-719f3633-97f7-44dd-8c96-490197771164 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.250730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-719f3633-97f7-44dd-8c96-490197771164 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.271148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dc3e244c-36e1-4a22-9c26-55759820f7f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:05.279358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc3e244c-36e1-4a22-9c26-55759820f7f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.130681 May 23 13:59:05.280035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1233/2542] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:05 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:05.335941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:05.336469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:05.342863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.343311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.344077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.344504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.417954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:05.428143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:05.429713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:05.430905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d29e5994-d4b3-4cbb-a36b-1feefd7e8af9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.099042 May 23 13:59:05.431470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1234/2543] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:05 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:05.436281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ac3efb50-799c-4079-b786-8f9c3870f62e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:05.436934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ac3efb50-799c-4079-b786-8f9c3870f62e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:05.456729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-719f3633-97f7-44dd-8c96-490197771164 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:05.459383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac3efb50-799c-4079-b786-8f9c3870f62e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.459383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac3efb50-799c-4079-b786-8f9c3870f62e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.459383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac3efb50-799c-4079-b786-8f9c3870f62e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:05.460016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac3efb50-799c-4079-b786-8f9c3870f62e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:05.460543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:05.465657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-719f3633-97f7-44dd-8c96-490197771164 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.230361 May 23 13:59:05.466257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1310/2544] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:05 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:05.631496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ac3efb50-799c-4079-b786-8f9c3870f62e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:05.640007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ac3efb50-799c-4079-b786-8f9c3870f62e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.207479 May 23 13:59:05.640627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1235/2545] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:05 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:06.253750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37a14419-5191-4e0e-8bae-2fc52e1f05cc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:06.254406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37a14419-5191-4e0e-8bae-2fc52e1f05cc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:06.261500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37a14419-5191-4e0e-8bae-2fc52e1f05cc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.261949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37a14419-5191-4e0e-8bae-2fc52e1f05cc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.262724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37a14419-5191-4e0e-8bae-2fc52e1f05cc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.263158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37a14419-5191-4e0e-8bae-2fc52e1f05cc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.296914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfaa0a5b-840e-4f39-a24f-ca43fb2461a3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:06.298028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bfaa0a5b-840e-4f39-a24f-ca43fb2461a3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:06.309852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfaa0a5b-840e-4f39-a24f-ca43fb2461a3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.310871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfaa0a5b-840e-4f39-a24f-ca43fb2461a3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.312110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfaa0a5b-840e-4f39-a24f-ca43fb2461a3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.312915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfaa0a5b-840e-4f39-a24f-ca43fb2461a3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.383158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfaa0a5b-840e-4f39-a24f-ca43fb2461a3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:06.391441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bfaa0a5b-840e-4f39-a24f-ca43fb2461a3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.098892 May 23 13:59:06.393527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1236/2546] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:06 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:06.421214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37a14419-5191-4e0e-8bae-2fc52e1f05cc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:06.430264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37a14419-5191-4e0e-8bae-2fc52e1f05cc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.182075 May 23 13:59:06.430859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1311/2547] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:06 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:06.449864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:06.450400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:06.458396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.458860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.459645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.460085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.483221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-256de32a-c998-47a3-bfcf-42124edfb38a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:06.483849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-256de32a-c998-47a3-bfcf-42124edfb38a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:06.490856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256de32a-c998-47a3-bfcf-42124edfb38a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.491302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256de32a-c998-47a3-bfcf-42124edfb38a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.492066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256de32a-c998-47a3-bfcf-42124edfb38a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.492495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256de32a-c998-47a3-bfcf-42124edfb38a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.550627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:06.559893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:06.561474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:06.562669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c55ad672-8447-42b4-9270-8df1bad2c0c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.116865 May 23 13:59:06.563501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1237/2548] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:06 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:06.643492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-256de32a-c998-47a3-bfcf-42124edfb38a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:06.651780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-256de32a-c998-47a3-bfcf-42124edfb38a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.172403 May 23 13:59:06.652373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1312/2549] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:06 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:06.657901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c0fcd763-f131-4157-b99d-c9c028c922c4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:06.664067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c0fcd763-f131-4157-b99d-c9c028c922c4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:06.665283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0fcd763-f131-4157-b99d-c9c028c922c4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.665729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0fcd763-f131-4157-b99d-c9c028c922c4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.666490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0fcd763-f131-4157-b99d-c9c028c922c4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:06.666922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0fcd763-f131-4157-b99d-c9c028c922c4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:06.812717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c0fcd763-f131-4157-b99d-c9c028c922c4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:06.829164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c0fcd763-f131-4157-b99d-c9c028c922c4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.175010 May 23 13:59:06.831423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1238/2550] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:06 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:07.412664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7fef66b4-1a78-4495-9555-da554ce3c6ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:07.413302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7fef66b4-1a78-4495-9555-da554ce3c6ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:07.420166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7fef66b4-1a78-4495-9555-da554ce3c6ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.420655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7fef66b4-1a78-4495-9555-da554ce3c6ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.421445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7fef66b4-1a78-4495-9555-da554ce3c6ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.421883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7fef66b4-1a78-4495-9555-da554ce3c6ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.452460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ff90451-36dd-47f1-9324-ca2b4b357774 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:07.453533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ff90451-36dd-47f1-9324-ca2b4b357774 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:07.462449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ff90451-36dd-47f1-9324-ca2b4b357774 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.462902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ff90451-36dd-47f1-9324-ca2b4b357774 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.463687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ff90451-36dd-47f1-9324-ca2b4b357774 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.464125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ff90451-36dd-47f1-9324-ca2b4b357774 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.499750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7fef66b4-1a78-4495-9555-da554ce3c6ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:07.513276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7fef66b4-1a78-4495-9555-da554ce3c6ea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.104342 May 23 13:59:07.514282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1313/2551] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:07 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:07.584392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:07.585050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:07.592690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.593463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.594276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.594722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.631748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ff90451-36dd-47f1-9324-ca2b4b357774 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:07.640081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ff90451-36dd-47f1-9324-ca2b4b357774 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.194449 May 23 13:59:07.640682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1239/2552] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:07 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:07.669447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a01a0d18-8483-44c6-aeed-104d60a345d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:07.669940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a01a0d18-8483-44c6-aeed-104d60a345d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:07.678127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a01a0d18-8483-44c6-aeed-104d60a345d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.678803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a01a0d18-8483-44c6-aeed-104d60a345d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.679279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a01a0d18-8483-44c6-aeed-104d60a345d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.679714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a01a0d18-8483-44c6-aeed-104d60a345d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.691787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:07.707342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:07.710575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:07.712759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-22ffb227-8bb5-4730-be2c-ab50f9053ba3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.133354 May 23 13:59:07.713815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1314/2553] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:07 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:07.822167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a01a0d18-8483-44c6-aeed-104d60a345d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:07.830584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a01a0d18-8483-44c6-aeed-104d60a345d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.165128 May 23 13:59:07.831149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1240/2554] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:07 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:07.848428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8cbb0187-aada-4708-ad5c-2046dc3e90f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:07.849094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8cbb0187-aada-4708-ad5c-2046dc3e90f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:07.855183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cbb0187-aada-4708-ad5c-2046dc3e90f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.855604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cbb0187-aada-4708-ad5c-2046dc3e90f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.856371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cbb0187-aada-4708-ad5c-2046dc3e90f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:07.856837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cbb0187-aada-4708-ad5c-2046dc3e90f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:07.995774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8cbb0187-aada-4708-ad5c-2046dc3e90f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:08.004653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8cbb0187-aada-4708-ad5c-2046dc3e90f4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160210 May 23 13:59:08.005236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1315/2555] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:07 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:08.534455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-778edfe2-b14b-45eb-a25d-44c75c29f4f6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:08.535103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-778edfe2-b14b-45eb-a25d-44c75c29f4f6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:08.541998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778edfe2-b14b-45eb-a25d-44c75c29f4f6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:08.542444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778edfe2-b14b-45eb-a25d-44c75c29f4f6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:08.543206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778edfe2-b14b-45eb-a25d-44c75c29f4f6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:08.543636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-778edfe2-b14b-45eb-a25d-44c75c29f4f6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:08.610621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-778edfe2-b14b-45eb-a25d-44c75c29f4f6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:08.619784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-778edfe2-b14b-45eb-a25d-44c75c29f4f6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089347 May 23 13:59:08.619904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1241/2556] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:08 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:08.666361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a54b0cc-60ed-41c0-8ff6-3af4ca8fc33a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:08.667039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a54b0cc-60ed-41c0-8ff6-3af4ca8fc33a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:08.674564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a54b0cc-60ed-41c0-8ff6-3af4ca8fc33a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:08.675022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a54b0cc-60ed-41c0-8ff6-3af4ca8fc33a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:08.675807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a54b0cc-60ed-41c0-8ff6-3af4ca8fc33a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:08.676246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a54b0cc-60ed-41c0-8ff6-3af4ca8fc33a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:08.732183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:08.732827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:08.740403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:08.740941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:08.741865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:08.742300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:08.816284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:08.833178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a54b0cc-60ed-41c0-8ff6-3af4ca8fc33a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:08.833511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:08.835813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:08.837780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19603ddf-549d-4553-8659-0d69c795a2ae tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.109476 May 23 13:59:08.838430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1242/2557] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:08 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:08.842358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a54b0cc-60ed-41c0-8ff6-3af4ca8fc33a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.179783 May 23 13:59:08.844613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1316/2558] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:08 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:08.854378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-48e4c7b5-4fa3-4bf3-ae5c-9ac221bac5df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:08.855007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-48e4c7b5-4fa3-4bf3-ae5c-9ac221bac5df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:08.861832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48e4c7b5-4fa3-4bf3-ae5c-9ac221bac5df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:08.862293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48e4c7b5-4fa3-4bf3-ae5c-9ac221bac5df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:08.863437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48e4c7b5-4fa3-4bf3-ae5c-9ac221bac5df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:08.863894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48e4c7b5-4fa3-4bf3-ae5c-9ac221bac5df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:09.022287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-48e4c7b5-4fa3-4bf3-ae5c-9ac221bac5df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:09.022948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aabf4155-47ae-4414-835a-be1e1ac30a82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:09.023572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aabf4155-47ae-4414-835a-be1e1ac30a82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:09.029748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aabf4155-47ae-4414-835a-be1e1ac30a82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:09.030202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aabf4155-47ae-4414-835a-be1e1ac30a82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:09.030655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-48e4c7b5-4fa3-4bf3-ae5c-9ac221bac5df tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.180373 May 23 13:59:09.031192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aabf4155-47ae-4414-835a-be1e1ac30a82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:09.031307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1243/2559] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:08 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:09.031664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aabf4155-47ae-4414-835a-be1e1ac30a82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:09.169147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aabf4155-47ae-4414-835a-be1e1ac30a82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:09.178529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aabf4155-47ae-4414-835a-be1e1ac30a82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159266 May 23 13:59:09.179095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1317/2560] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:09 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:09.637095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-657ed5a2-438f-42d7-8577-f53da11de2c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:09.637705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-657ed5a2-438f-42d7-8577-f53da11de2c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:09.645227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-657ed5a2-438f-42d7-8577-f53da11de2c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:09.645678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-657ed5a2-438f-42d7-8577-f53da11de2c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:09.646459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-657ed5a2-438f-42d7-8577-f53da11de2c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:09.646900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-657ed5a2-438f-42d7-8577-f53da11de2c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:09.714247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-657ed5a2-438f-42d7-8577-f53da11de2c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:09.723231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-657ed5a2-438f-42d7-8577-f53da11de2c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090056 May 23 13:59:09.723797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1244/2561] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:09 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:09.856923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:09.857590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:09.861658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d49f274-7b3b-442e-86ca-bc6dfe3d4d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:09.862449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d49f274-7b3b-442e-86ca-bc6dfe3d4d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:09.865600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:09.866058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:09.866864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:09.867302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:09.869148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d49f274-7b3b-442e-86ca-bc6dfe3d4d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:09.869596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d49f274-7b3b-442e-86ca-bc6dfe3d4d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:09.870415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d49f274-7b3b-442e-86ca-bc6dfe3d4d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:09.870849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d49f274-7b3b-442e-86ca-bc6dfe3d4d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:09.932338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:09.941739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:09.943363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:09.944443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-60f42362-3433-4eb4-a92c-4b149b25ca78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091535 May 23 13:59:09.945396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1318/2562] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:09 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:10.021826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d49f274-7b3b-442e-86ca-bc6dfe3d4d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:10.031076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d49f274-7b3b-442e-86ca-bc6dfe3d4d4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.173966 May 23 13:59:10.031654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1245/2563] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:09 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:10.048542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b9f887d-daa1-4835-a43a-0497758b248f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:10.049273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b9f887d-daa1-4835-a43a-0497758b248f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:10.055448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b9f887d-daa1-4835-a43a-0497758b248f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:10.055891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b9f887d-daa1-4835-a43a-0497758b248f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:10.056693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b9f887d-daa1-4835-a43a-0497758b248f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:10.057191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b9f887d-daa1-4835-a43a-0497758b248f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:10.191461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b9f887d-daa1-4835-a43a-0497758b248f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:10.195428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cf9ed45b-6d39-424c-b3e3-f814dba7da82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:10.196036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cf9ed45b-6d39-424c-b3e3-f814dba7da82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:10.200072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b9f887d-daa1-4835-a43a-0497758b248f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155381 May 23 13:59:10.200653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1319/2564] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:10 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:10.202798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf9ed45b-6d39-424c-b3e3-f814dba7da82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:10.203253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf9ed45b-6d39-424c-b3e3-f814dba7da82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:10.204013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf9ed45b-6d39-424c-b3e3-f814dba7da82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:10.205069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf9ed45b-6d39-424c-b3e3-f814dba7da82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:10.354758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf9ed45b-6d39-424c-b3e3-f814dba7da82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:10.363356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cf9ed45b-6d39-424c-b3e3-f814dba7da82 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.171744 May 23 13:59:10.363942 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1246/2565] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:10 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:10.741946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e3014ce-cd8d-44ac-afe2-02adf33fefb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:10.742598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e3014ce-cd8d-44ac-afe2-02adf33fefb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:10.749002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e3014ce-cd8d-44ac-afe2-02adf33fefb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:10.749462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e3014ce-cd8d-44ac-afe2-02adf33fefb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:10.750366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e3014ce-cd8d-44ac-afe2-02adf33fefb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:10.750859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e3014ce-cd8d-44ac-afe2-02adf33fefb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:10.824449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e3014ce-cd8d-44ac-afe2-02adf33fefb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:10.833419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e3014ce-cd8d-44ac-afe2-02adf33fefb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.095472 May 23 13:59:10.833998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1320/2566] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:10 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:10.964444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:10.965664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:10.978053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:10.978902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:10.980289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:10.981127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:11.049341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33f3a392-13d6-428c-9f55-319a48c20ef5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:11.049972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33f3a392-13d6-428c-9f55-319a48c20ef5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:11.050303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:11.057439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33f3a392-13d6-428c-9f55-319a48c20ef5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:11.057897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33f3a392-13d6-428c-9f55-319a48c20ef5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:11.058685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33f3a392-13d6-428c-9f55-319a48c20ef5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:11.059122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33f3a392-13d6-428c-9f55-319a48c20ef5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:11.059709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:11.060839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:11.061996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ea53fd6d-5884-4978-890b-29a576c9bdb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.102550 May 23 13:59:11.062555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1247/2567] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:10 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:11.201349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33f3a392-13d6-428c-9f55-319a48c20ef5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:11.210410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33f3a392-13d6-428c-9f55-319a48c20ef5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165077 May 23 13:59:11.210996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1321/2568] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:11 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:11.219470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0cd4d8f-39b7-4d52-89ff-25fd9ebf8f5a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:11.220429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0cd4d8f-39b7-4d52-89ff-25fd9ebf8f5a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:11.226901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0cd4d8f-39b7-4d52-89ff-25fd9ebf8f5a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:11.227354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0cd4d8f-39b7-4d52-89ff-25fd9ebf8f5a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:11.228131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0cd4d8f-39b7-4d52-89ff-25fd9ebf8f5a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:11.228593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0cd4d8f-39b7-4d52-89ff-25fd9ebf8f5a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:11.376813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d0cd4d8f-39b7-4d52-89ff-25fd9ebf8f5a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:11.380693 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:11.381761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a266211f-01a4-41d9-b28d-2947ddf6d7a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:11.382504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a266211f-01a4-41d9-b28d-2947ddf6d7a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:11.385546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0cd4d8f-39b7-4d52-89ff-25fd9ebf8f5a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.170226 May 23 13:59:11.386128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1248/2569] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:11 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:11.389395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a266211f-01a4-41d9-b28d-2947ddf6d7a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:11.389849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a266211f-01a4-41d9-b28d-2947ddf6d7a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:11.396188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a266211f-01a4-41d9-b28d-2947ddf6d7a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:11.396188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a266211f-01a4-41d9-b28d-2947ddf6d7a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:11.528663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a266211f-01a4-41d9-b28d-2947ddf6d7a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:11.536988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a266211f-01a4-41d9-b28d-2947ddf6d7a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159343 May 23 13:59:11.537564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1322/2570] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:11 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:11.850643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-87548972-0679-47cb-b5a6-7b05e3e94866 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:11.851158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-87548972-0679-47cb-b5a6-7b05e3e94866 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:11.857534 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87548972-0679-47cb-b5a6-7b05e3e94866 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:11.857984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87548972-0679-47cb-b5a6-7b05e3e94866 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:11.858740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87548972-0679-47cb-b5a6-7b05e3e94866 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:11.859172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87548972-0679-47cb-b5a6-7b05e3e94866 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:11.922574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-87548972-0679-47cb-b5a6-7b05e3e94866 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:11.930697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-87548972-0679-47cb-b5a6-7b05e3e94866 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084059 May 23 13:59:11.931243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1249/2571] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:11 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:12.081531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:12.082183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:12.089134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.089580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:12.090348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.090781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:12.159097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:12.168063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:12.169624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:12.170793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f9741d1-55f3-43bd-8594-16a4630ff227 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094236 May 23 13:59:12.171354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1323/2572] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:12.227548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-491184e7-0633-4f55-8ddf-dd8b5c64a877 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:12.228294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-491184e7-0633-4f55-8ddf-dd8b5c64a877 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:12.234723 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-491184e7-0633-4f55-8ddf-dd8b5c64a877 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.235171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-491184e7-0633-4f55-8ddf-dd8b5c64a877 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:12.236694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-491184e7-0633-4f55-8ddf-dd8b5c64a877 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.237074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-491184e7-0633-4f55-8ddf-dd8b5c64a877 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:12.373103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-491184e7-0633-4f55-8ddf-dd8b5c64a877 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:12.382010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-491184e7-0633-4f55-8ddf-dd8b5c64a877 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158334 May 23 13:59:12.382590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1250/2573] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:12 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:12.411557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-486a20c3-6de8-499b-a509-bae3e5fcf7a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:12.412091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-486a20c3-6de8-499b-a509-bae3e5fcf7a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:12.418214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-486a20c3-6de8-499b-a509-bae3e5fcf7a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.418667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-486a20c3-6de8-499b-a509-bae3e5fcf7a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:12.419432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-486a20c3-6de8-499b-a509-bae3e5fcf7a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.419871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-486a20c3-6de8-499b-a509-bae3e5fcf7a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:12.554351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-486a20c3-6de8-499b-a509-bae3e5fcf7a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:12.555440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a0019c1-8736-43f9-8bf5-022033ba1f5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:12.556140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a0019c1-8736-43f9-8bf5-022033ba1f5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:12.562215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a0019c1-8736-43f9-8bf5-022033ba1f5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.562469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-486a20c3-6de8-499b-a509-bae3e5fcf7a3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155008 May 23 13:59:12.562666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a0019c1-8736-43f9-8bf5-022033ba1f5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:12.563058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1324/2574] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:12 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:12.563484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a0019c1-8736-43f9-8bf5-022033ba1f5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.565907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a0019c1-8736-43f9-8bf5-022033ba1f5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:12.703879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a0019c1-8736-43f9-8bf5-022033ba1f5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:12.712297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a0019c1-8736-43f9-8bf5-022033ba1f5e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160809 May 23 13:59:12.712913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1251/2575] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:12 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:12.949015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a2ffb774-db00-4854-930d-69daadcdff56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:12.949630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a2ffb774-db00-4854-930d-69daadcdff56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:12.956720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2ffb774-db00-4854-930d-69daadcdff56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.957113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2ffb774-db00-4854-930d-69daadcdff56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:12.957883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2ffb774-db00-4854-930d-69daadcdff56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:12.958326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2ffb774-db00-4854-930d-69daadcdff56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:13.022425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a2ffb774-db00-4854-930d-69daadcdff56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:13.030860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a2ffb774-db00-4854-930d-69daadcdff56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085616 May 23 13:59:13.031447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1325/2576] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:12 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:13.190497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:13.191113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:13.197402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:13.197850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:13.198620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:13.199050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:13.262725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:13.272916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:13.274441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:13.275596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45ce1b3c-676e-4ef0-9a80-3e77b94cf0cf tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089646 May 23 13:59:13.276153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1252/2577] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:13 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:13.399060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1bc2a903-b071-491b-8e0d-485b73117c4d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:13.399671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1bc2a903-b071-491b-8e0d-485b73117c4d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:13.406188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bc2a903-b071-491b-8e0d-485b73117c4d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:13.406640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bc2a903-b071-491b-8e0d-485b73117c4d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:13.407518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bc2a903-b071-491b-8e0d-485b73117c4d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:13.408006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bc2a903-b071-491b-8e0d-485b73117c4d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:13.546611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bc2a903-b071-491b-8e0d-485b73117c4d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:13.554660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1bc2a903-b071-491b-8e0d-485b73117c4d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159502 May 23 13:59:13.555234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1326/2578] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:13 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:13.582235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ac7f3c40-3b63-4286-ac94-604c3b7494d5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:13.582837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ac7f3c40-3b63-4286-ac94-604c3b7494d5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:13.588877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac7f3c40-3b63-4286-ac94-604c3b7494d5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:13.589329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac7f3c40-3b63-4286-ac94-604c3b7494d5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:13.590103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac7f3c40-3b63-4286-ac94-604c3b7494d5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:13.590587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac7f3c40-3b63-4286-ac94-604c3b7494d5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:13.730599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f372b2f3-f575-46d7-b5d3-19908fcbe823 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:13.731364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f372b2f3-f575-46d7-b5d3-19908fcbe823 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:13.739002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f372b2f3-f575-46d7-b5d3-19908fcbe823 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:13.739458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f372b2f3-f575-46d7-b5d3-19908fcbe823 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:13.743161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f372b2f3-f575-46d7-b5d3-19908fcbe823 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:13.743161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f372b2f3-f575-46d7-b5d3-19908fcbe823 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:13.743491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ac7f3c40-3b63-4286-ac94-604c3b7494d5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:13.751303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ac7f3c40-3b63-4286-ac94-604c3b7494d5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.175235 May 23 13:59:13.751886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1253/2579] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:13 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:13.761759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:13.874057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f372b2f3-f575-46d7-b5d3-19908fcbe823 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:13.883145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f372b2f3-f575-46d7-b5d3-19908fcbe823 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156557 May 23 13:59:13.883713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1327/2580] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:13 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:14.048653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77b7bc46-aa4a-4cf5-9e91-8b453545aad4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:14.049401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-77b7bc46-aa4a-4cf5-9e91-8b453545aad4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:14.055514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77b7bc46-aa4a-4cf5-9e91-8b453545aad4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.055954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77b7bc46-aa4a-4cf5-9e91-8b453545aad4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.056739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77b7bc46-aa4a-4cf5-9e91-8b453545aad4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.057170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77b7bc46-aa4a-4cf5-9e91-8b453545aad4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.122110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-77b7bc46-aa4a-4cf5-9e91-8b453545aad4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:14.130650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-77b7bc46-aa4a-4cf5-9e91-8b453545aad4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085886 May 23 13:59:14.131217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1254/2581] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:14 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:14.293364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:14.293972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:14.300780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.301227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.301979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.302410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.366507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:14.375269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:14.376795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:14.377942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ebf9a11c-53c8-437f-922f-3aea773660a8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088494 May 23 13:59:14.378500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1328/2582] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:14 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:14.572620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a95efb57-ecae-4d2c-b773-88d0f77d2444 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:14.573231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a95efb57-ecae-4d2c-b773-88d0f77d2444 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:14.580272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a95efb57-ecae-4d2c-b773-88d0f77d2444 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.580743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a95efb57-ecae-4d2c-b773-88d0f77d2444 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.581496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a95efb57-ecae-4d2c-b773-88d0f77d2444 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.581925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a95efb57-ecae-4d2c-b773-88d0f77d2444 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.716587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a95efb57-ecae-4d2c-b773-88d0f77d2444 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:14.725746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a95efb57-ecae-4d2c-b773-88d0f77d2444 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156747 May 23 13:59:14.726132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1255/2583] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:14 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:14.770768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d1286900-67b2-43cf-b216-ef343d83f401 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:14.771384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d1286900-67b2-43cf-b216-ef343d83f401 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:14.778119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1286900-67b2-43cf-b216-ef343d83f401 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.778578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1286900-67b2-43cf-b216-ef343d83f401 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.779381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1286900-67b2-43cf-b216-ef343d83f401 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.779826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1286900-67b2-43cf-b216-ef343d83f401 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.905454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90dbd863-f1e2-415e-b0d5-cc84cddc7b93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:14.906589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90dbd863-f1e2-415e-b0d5-cc84cddc7b93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:14.918707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90dbd863-f1e2-415e-b0d5-cc84cddc7b93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.919429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90dbd863-f1e2-415e-b0d5-cc84cddc7b93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.920993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90dbd863-f1e2-415e-b0d5-cc84cddc7b93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:14.921786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90dbd863-f1e2-415e-b0d5-cc84cddc7b93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:14.927052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d1286900-67b2-43cf-b216-ef343d83f401 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:14.935862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d1286900-67b2-43cf-b216-ef343d83f401 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.169549 May 23 13:59:14.937375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1329/2584] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:14 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:15.069860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90dbd863-f1e2-415e-b0d5-cc84cddc7b93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:15.085375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90dbd863-f1e2-415e-b0d5-cc84cddc7b93 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.186625 May 23 13:59:15.086228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1256/2585] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:14 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:15.147804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f88325fd-f59e-4011-9f44-9164d35753ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:15.148414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f88325fd-f59e-4011-9f44-9164d35753ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:15.154721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f88325fd-f59e-4011-9f44-9164d35753ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:15.155170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f88325fd-f59e-4011-9f44-9164d35753ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:15.155939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f88325fd-f59e-4011-9f44-9164d35753ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:15.156375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f88325fd-f59e-4011-9f44-9164d35753ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:15.218661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f88325fd-f59e-4011-9f44-9164d35753ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:15.227077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f88325fd-f59e-4011-9f44-9164d35753ed tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083130 May 23 13:59:15.227680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1330/2586] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:15 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:15.395519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:15.396238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:15.402711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:15.403153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:15.403914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:15.404340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:15.475544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:15.486259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:15.487938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:15.489143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8eb2852-d2be-4004-951f-87984fea432a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.097717 May 23 13:59:15.489716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1257/2587] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:15 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:15.742850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-651d23cd-4e39-4b04-8665-230ee5dfebac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:15.743406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-651d23cd-4e39-4b04-8665-230ee5dfebac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:15.749499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651d23cd-4e39-4b04-8665-230ee5dfebac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:15.749944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651d23cd-4e39-4b04-8665-230ee5dfebac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:15.750702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651d23cd-4e39-4b04-8665-230ee5dfebac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:15.751149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651d23cd-4e39-4b04-8665-230ee5dfebac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:15.881453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-651d23cd-4e39-4b04-8665-230ee5dfebac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:15.889849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-651d23cd-4e39-4b04-8665-230ee5dfebac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.150842 May 23 13:59:15.890439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1331/2588] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:15 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:15.954412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1f05ea7d-0b91-4e60-a211-d4cbc7dd3355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:15.955085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1f05ea7d-0b91-4e60-a211-d4cbc7dd3355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:15.961809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f05ea7d-0b91-4e60-a211-d4cbc7dd3355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:15.962255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f05ea7d-0b91-4e60-a211-d4cbc7dd3355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:15.963023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f05ea7d-0b91-4e60-a211-d4cbc7dd3355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:15.963452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f05ea7d-0b91-4e60-a211-d4cbc7dd3355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:16.101995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1f05ea7d-0b91-4e60-a211-d4cbc7dd3355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:16.103675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-69ebe6de-a5e8-4551-8020-da8d9b0b1801 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:16.104383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-69ebe6de-a5e8-4551-8020-da8d9b0b1801 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:16.110820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1f05ea7d-0b91-4e60-a211-d4cbc7dd3355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160598 May 23 13:59:16.111017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69ebe6de-a5e8-4551-8020-da8d9b0b1801 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:16.111228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1258/2589] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:15 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:16.111388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69ebe6de-a5e8-4551-8020-da8d9b0b1801 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:16.112179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69ebe6de-a5e8-4551-8020-da8d9b0b1801 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:16.112645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69ebe6de-a5e8-4551-8020-da8d9b0b1801 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:16.244802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-291d282d-2378-492f-a684-122d0dba900b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:16.245418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-291d282d-2378-492f-a684-122d0dba900b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:16.249286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-69ebe6de-a5e8-4551-8020-da8d9b0b1801 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:16.252147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-291d282d-2378-492f-a684-122d0dba900b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:16.252626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-291d282d-2378-492f-a684-122d0dba900b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:16.253419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-291d282d-2378-492f-a684-122d0dba900b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:16.253886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-291d282d-2378-492f-a684-122d0dba900b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:16.258027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-69ebe6de-a5e8-4551-8020-da8d9b0b1801 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158347 May 23 13:59:16.258623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1332/2590] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:16 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:16.319697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-291d282d-2378-492f-a684-122d0dba900b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:16.328057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-291d282d-2378-492f-a684-122d0dba900b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087178 May 23 13:59:16.329427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1259/2591] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:16 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:16.508013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:16.508684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:16.515306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:16.515754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:16.517136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:16.517582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:16.583122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:16.592011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:16.593545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:16.594802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7efcd12f-6c11-4721-8f52-0f52831e27f7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090755 May 23 13:59:16.595327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1333/2592] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:16.907813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-85e658c7-a51e-404c-94c3-c0bab2d081f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:16.908431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-85e658c7-a51e-404c-94c3-c0bab2d081f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:16.914794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85e658c7-a51e-404c-94c3-c0bab2d081f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:16.915257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85e658c7-a51e-404c-94c3-c0bab2d081f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:16.916014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85e658c7-a51e-404c-94c3-c0bab2d081f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:16.916457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85e658c7-a51e-404c-94c3-c0bab2d081f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:17.080026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85e658c7-a51e-404c-94c3-c0bab2d081f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:17.088656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-85e658c7-a51e-404c-94c3-c0bab2d081f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.184975 May 23 13:59:17.089492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1260/2593] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:16 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:17.127574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ebfce261-c5a9-406c-94be-7a2e6a1e82bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:17.128467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ebfce261-c5a9-406c-94be-7a2e6a1e82bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:17.135337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ebfce261-c5a9-406c-94be-7a2e6a1e82bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:17.135786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ebfce261-c5a9-406c-94be-7a2e6a1e82bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:17.136597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ebfce261-c5a9-406c-94be-7a2e6a1e82bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:17.137075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ebfce261-c5a9-406c-94be-7a2e6a1e82bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:17.277531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57b42eb5-caed-46ca-8473-943b8d773d47 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:17.278275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57b42eb5-caed-46ca-8473-943b8d773d47 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:17.285932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57b42eb5-caed-46ca-8473-943b8d773d47 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:17.286377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57b42eb5-caed-46ca-8473-943b8d773d47 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:17.287156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57b42eb5-caed-46ca-8473-943b8d773d47 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:17.287700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57b42eb5-caed-46ca-8473-943b8d773d47 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:17.292969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ebfce261-c5a9-406c-94be-7a2e6a1e82bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:17.302130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ebfce261-c5a9-406c-94be-7a2e6a1e82bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.178587 May 23 13:59:17.302721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1334/2594] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:17 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:17.354641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-90704f91-2b4c-41e7-8e37-bb8aa7c7f4bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:17.355451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-90704f91-2b4c-41e7-8e37-bb8aa7c7f4bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:17.362927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90704f91-2b4c-41e7-8e37-bb8aa7c7f4bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:17.363378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90704f91-2b4c-41e7-8e37-bb8aa7c7f4bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:17.364174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90704f91-2b4c-41e7-8e37-bb8aa7c7f4bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:17.364642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90704f91-2b4c-41e7-8e37-bb8aa7c7f4bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:17.430442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-90704f91-2b4c-41e7-8e37-bb8aa7c7f4bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:17.439102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-90704f91-2b4c-41e7-8e37-bb8aa7c7f4bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.096186 May 23 13:59:17.439597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1335/2595] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:17 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:17.458954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57b42eb5-caed-46ca-8473-943b8d773d47 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:17.467061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57b42eb5-caed-46ca-8473-943b8d773d47 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.193753 May 23 13:59:17.467638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1261/2596] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:17 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:17.614076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:17.614697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:17.621135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:17.621595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:17.622371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:17.622814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:17.707296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:17.716260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:17.717831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:17.718999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cbe3141e-0156-4b68-9842-c0a405e73896 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.109092 May 23 13:59:17.720146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1336/2597] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:18.105522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c34c91cf-a33c-4d0a-bf29-8807ad810821 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:18.106165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c34c91cf-a33c-4d0a-bf29-8807ad810821 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:18.114338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c34c91cf-a33c-4d0a-bf29-8807ad810821 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.114797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c34c91cf-a33c-4d0a-bf29-8807ad810821 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.115573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c34c91cf-a33c-4d0a-bf29-8807ad810821 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.116016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c34c91cf-a33c-4d0a-bf29-8807ad810821 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.253707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c34c91cf-a33c-4d0a-bf29-8807ad810821 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:18.262147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c34c91cf-a33c-4d0a-bf29-8807ad810821 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160424 May 23 13:59:18.262739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1262/2598] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:18 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:18.324381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a170ac1-54a1-4875-b86d-7df8833084ce tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:18.325551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a170ac1-54a1-4875-b86d-7df8833084ce tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:18.333586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a170ac1-54a1-4875-b86d-7df8833084ce tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.334070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a170ac1-54a1-4875-b86d-7df8833084ce tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.334852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a170ac1-54a1-4875-b86d-7df8833084ce tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.335285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a170ac1-54a1-4875-b86d-7df8833084ce tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.458178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-edd18190-5437-4f5b-927b-328932783355 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:18.458950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-edd18190-5437-4f5b-927b-328932783355 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:18.471460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-edd18190-5437-4f5b-927b-328932783355 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.471836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-edd18190-5437-4f5b-927b-328932783355 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.472649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-edd18190-5437-4f5b-927b-328932783355 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.473094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-edd18190-5437-4f5b-927b-328932783355 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.478760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a170ac1-54a1-4875-b86d-7df8833084ce tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:18.489670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a170ac1-54a1-4875-b86d-7df8833084ce tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.172053 May 23 13:59:18.490397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1337/2599] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:18 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:18.495612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-abc8437a-8d47-4b06-a78f-4d76e5e6d52e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:18.496324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-abc8437a-8d47-4b06-a78f-4d76e5e6d52e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:18.503624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abc8437a-8d47-4b06-a78f-4d76e5e6d52e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.504281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abc8437a-8d47-4b06-a78f-4d76e5e6d52e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.505177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abc8437a-8d47-4b06-a78f-4d76e5e6d52e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.505834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abc8437a-8d47-4b06-a78f-4d76e5e6d52e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.545953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-edd18190-5437-4f5b-927b-328932783355 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:18.555810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-edd18190-5437-4f5b-927b-328932783355 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.102381 May 23 13:59:18.556610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1263/2600] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:18 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:18.645298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-abc8437a-8d47-4b06-a78f-4d76e5e6d52e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:18.653827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-abc8437a-8d47-4b06-a78f-4d76e5e6d52e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162291 May 23 13:59:18.654421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1338/2601] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:18 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:18.739386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:18.739905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:18.746210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.746625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.747415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:18.747876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:18.809298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:18.818621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:18.820133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:18.821325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3f072fba-0103-492e-b988-11bac8011574 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.086721 May 23 13:59:18.821884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1264/2602] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:18 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:19.280083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-871ef288-acee-4b12-b662-39f4a9302d2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:19.280761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-871ef288-acee-4b12-b662-39f4a9302d2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:19.286875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871ef288-acee-4b12-b662-39f4a9302d2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.289202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871ef288-acee-4b12-b662-39f4a9302d2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.289202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871ef288-acee-4b12-b662-39f4a9302d2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.289202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871ef288-acee-4b12-b662-39f4a9302d2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.421209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-871ef288-acee-4b12-b662-39f4a9302d2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:19.429669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-871ef288-acee-4b12-b662-39f4a9302d2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.153583 May 23 13:59:19.430242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1339/2603] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:19 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:19.508711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1bd90a8c-7d77-4841-a001-f1c6b62137fa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:19.509299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1bd90a8c-7d77-4841-a001-f1c6b62137fa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:19.516672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bd90a8c-7d77-4841-a001-f1c6b62137fa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.517830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bd90a8c-7d77-4841-a001-f1c6b62137fa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.518636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bd90a8c-7d77-4841-a001-f1c6b62137fa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.519076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bd90a8c-7d77-4841-a001-f1c6b62137fa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.538914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:19.574385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6e0ba4ed-d000-4b54-acdc-155b3301c637 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:19.575014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6e0ba4ed-d000-4b54-acdc-155b3301c637 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:19.582804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e0ba4ed-d000-4b54-acdc-155b3301c637 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.583317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e0ba4ed-d000-4b54-acdc-155b3301c637 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.584156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e0ba4ed-d000-4b54-acdc-155b3301c637 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.584644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e0ba4ed-d000-4b54-acdc-155b3301c637 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.652811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e0ba4ed-d000-4b54-acdc-155b3301c637 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:19.658969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1bd90a8c-7d77-4841-a001-f1c6b62137fa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:19.660974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6e0ba4ed-d000-4b54-acdc-155b3301c637 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090531 May 23 13:59:19.661656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1340/2604] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:19 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:19.667285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1bd90a8c-7d77-4841-a001-f1c6b62137fa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162625 May 23 13:59:19.667999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1265/2605] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:19 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:19.671688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-327fc6ca-f531-4791-8ba8-774e7e9dac58 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:19.672874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-327fc6ca-f531-4791-8ba8-774e7e9dac58 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:19.679689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-327fc6ca-f531-4791-8ba8-774e7e9dac58 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.680139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-327fc6ca-f531-4791-8ba8-774e7e9dac58 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.681548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-327fc6ca-f531-4791-8ba8-774e7e9dac58 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.681548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-327fc6ca-f531-4791-8ba8-774e7e9dac58 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.820635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-327fc6ca-f531-4791-8ba8-774e7e9dac58 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:19.829362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-327fc6ca-f531-4791-8ba8-774e7e9dac58 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160837 May 23 13:59:19.829957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1341/2606] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:19 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:19.839272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:19.839881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:19.846014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.846458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.847216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:19.847642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:19.913504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:19.923151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:19.925577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:19.926750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59bba005-bfc5-4c6f-9a18-633e93e835f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091463 May 23 13:59:19.927284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1266/2607] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:19 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:20.447785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-493f38cd-2030-43ea-88b9-a2d221ec7da1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:20.448345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-493f38cd-2030-43ea-88b9-a2d221ec7da1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:20.455446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-493f38cd-2030-43ea-88b9-a2d221ec7da1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.455892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-493f38cd-2030-43ea-88b9-a2d221ec7da1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.456683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-493f38cd-2030-43ea-88b9-a2d221ec7da1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.457120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-493f38cd-2030-43ea-88b9-a2d221ec7da1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.588175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-493f38cd-2030-43ea-88b9-a2d221ec7da1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:20.597923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-493f38cd-2030-43ea-88b9-a2d221ec7da1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.153996 May 23 13:59:20.608340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1342/2608] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:20 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:20.679314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fb459f71-00a3-47bd-802a-88dc869e1536 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:20.679936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fb459f71-00a3-47bd-802a-88dc869e1536 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:20.682316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:20.687191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb459f71-00a3-47bd-802a-88dc869e1536 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.687646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb459f71-00a3-47bd-802a-88dc869e1536 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.689367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb459f71-00a3-47bd-802a-88dc869e1536 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.689805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb459f71-00a3-47bd-802a-88dc869e1536 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.740431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39e428d8-3455-44d4-b772-e512e34926e2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:20.741289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39e428d8-3455-44d4-b772-e512e34926e2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:20.747718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39e428d8-3455-44d4-b772-e512e34926e2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.748264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39e428d8-3455-44d4-b772-e512e34926e2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.749156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39e428d8-3455-44d4-b772-e512e34926e2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.749597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39e428d8-3455-44d4-b772-e512e34926e2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.761286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb459f71-00a3-47bd-802a-88dc869e1536 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:20.770542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fb459f71-00a3-47bd-802a-88dc869e1536 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.095089 May 23 13:59:20.771120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1267/2609] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:20 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:20.846617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2c58ae64-bfc8-4485-9c1a-c2b836fd97fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:20.847239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2c58ae64-bfc8-4485-9c1a-c2b836fd97fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:20.853493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c58ae64-bfc8-4485-9c1a-c2b836fd97fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.853944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c58ae64-bfc8-4485-9c1a-c2b836fd97fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.854719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c58ae64-bfc8-4485-9c1a-c2b836fd97fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.855161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c58ae64-bfc8-4485-9c1a-c2b836fd97fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.921366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39e428d8-3455-44d4-b772-e512e34926e2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:20.930462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39e428d8-3455-44d4-b772-e512e34926e2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.193823 May 23 13:59:20.931052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1343/2610] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:20 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:20.945330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:20.945937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:20.951944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.952386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.953170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:20.954292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:20.959406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:21.001220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2c58ae64-bfc8-4485-9c1a-c2b836fd97fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:21.009484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2c58ae64-bfc8-4485-9c1a-c2b836fd97fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.166829 May 23 13:59:21.010057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1268/2611] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:20 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:21.019331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:21.027983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:21.029516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:21.030674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b64522a5-d1e1-45a0-aa1f-6150b57dec14 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089238 May 23 13:59:21.031228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1344/2612] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:21.624278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-755043cc-7f02-4567-8efc-83118956351c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:21.624916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-755043cc-7f02-4567-8efc-83118956351c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:21.631296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-755043cc-7f02-4567-8efc-83118956351c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:21.631738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-755043cc-7f02-4567-8efc-83118956351c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:21.632501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-755043cc-7f02-4567-8efc-83118956351c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:21.632959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-755043cc-7f02-4567-8efc-83118956351c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:21.773643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-755043cc-7f02-4567-8efc-83118956351c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:21.782417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-755043cc-7f02-4567-8efc-83118956351c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161440 May 23 13:59:21.783081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1269/2613] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:21 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:21.787943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-22ac36e7-b9e2-4de1-9172-194156620d50 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:21.788560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-22ac36e7-b9e2-4de1-9172-194156620d50 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:21.795469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22ac36e7-b9e2-4de1-9172-194156620d50 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:21.795918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22ac36e7-b9e2-4de1-9172-194156620d50 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:21.796798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22ac36e7-b9e2-4de1-9172-194156620d50 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:21.797888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22ac36e7-b9e2-4de1-9172-194156620d50 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:21.861277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-22ac36e7-b9e2-4de1-9172-194156620d50 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:21.869332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-22ac36e7-b9e2-4de1-9172-194156620d50 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085333 May 23 13:59:21.869912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1345/2614] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:21 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:21.949170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7456c736-95f3-4c3c-85ec-c1087c58ffd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:21.949792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7456c736-95f3-4c3c-85ec-c1087c58ffd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:21.957450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7456c736-95f3-4c3c-85ec-c1087c58ffd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:21.957939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7456c736-95f3-4c3c-85ec-c1087c58ffd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:21.958724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7456c736-95f3-4c3c-85ec-c1087c58ffd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:21.959164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7456c736-95f3-4c3c-85ec-c1087c58ffd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:22.029164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aee9246e-f6de-47df-bbf6-c4ee831c3a17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:22.029930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aee9246e-f6de-47df-bbf6-c4ee831c3a17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:22.036759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee9246e-f6de-47df-bbf6-c4ee831c3a17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:22.037217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee9246e-f6de-47df-bbf6-c4ee831c3a17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:22.037992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee9246e-f6de-47df-bbf6-c4ee831c3a17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:22.038437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee9246e-f6de-47df-bbf6-c4ee831c3a17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:22.101040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7456c736-95f3-4c3c-85ec-c1087c58ffd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:22.109037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7456c736-95f3-4c3c-85ec-c1087c58ffd6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.163704 May 23 13:59:22.109642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1270/2615] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:21 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:22.114368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:22.114981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:22.121397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:22.121911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:22.122739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:22.123237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:22.185010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aee9246e-f6de-47df-bbf6-c4ee831c3a17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:22.198876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:22.199973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aee9246e-f6de-47df-bbf6-c4ee831c3a17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.175341 May 23 13:59:22.200928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1346/2616] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:22 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:22.215598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:22.218725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:22.221252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c749a41-13d7-4345-848d-2b5cee01afa6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.110465 May 23 13:59:22.221911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1271/2617] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:22 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:22.803131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fed50968-5fa2-435c-8daf-a2778aefcf2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:22.804114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fed50968-5fa2-435c-8daf-a2778aefcf2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:22.815162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed50968-5fa2-435c-8daf-a2778aefcf2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:22.815730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed50968-5fa2-435c-8daf-a2778aefcf2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:22.816892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed50968-5fa2-435c-8daf-a2778aefcf2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:22.817352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fed50968-5fa2-435c-8daf-a2778aefcf2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:22.890164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0382ecab-5508-4e81-96b8-50f6fdf27663 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:22.891639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0382ecab-5508-4e81-96b8-50f6fdf27663 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:22.903054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0382ecab-5508-4e81-96b8-50f6fdf27663 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:22.903605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0382ecab-5508-4e81-96b8-50f6fdf27663 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:22.904560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0382ecab-5508-4e81-96b8-50f6fdf27663 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:22.905033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0382ecab-5508-4e81-96b8-50f6fdf27663 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:22.986603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fed50968-5fa2-435c-8daf-a2778aefcf2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:22.999153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0382ecab-5508-4e81-96b8-50f6fdf27663 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:22.999900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fed50968-5fa2-435c-8daf-a2778aefcf2c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.203778 May 23 13:59:23.001809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1347/2618] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:22 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:23.008975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0382ecab-5508-4e81-96b8-50f6fdf27663 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.125071 May 23 13:59:23.009572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1272/2619] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:22 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:23.127152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce5568ee-a9bf-43a3-a93c-6905b9ef6772 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:23.127792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ce5568ee-a9bf-43a3-a93c-6905b9ef6772 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:23.134265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce5568ee-a9bf-43a3-a93c-6905b9ef6772 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:23.134718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce5568ee-a9bf-43a3-a93c-6905b9ef6772 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:23.135514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce5568ee-a9bf-43a3-a93c-6905b9ef6772 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:23.135962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce5568ee-a9bf-43a3-a93c-6905b9ef6772 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:23.228297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3d942f5-066c-4a48-ad39-e1b732d34fbc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:23.228959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3d942f5-066c-4a48-ad39-e1b732d34fbc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:23.236556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3d942f5-066c-4a48-ad39-e1b732d34fbc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:23.237049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3d942f5-066c-4a48-ad39-e1b732d34fbc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:23.237843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3d942f5-066c-4a48-ad39-e1b732d34fbc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:23.238286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3d942f5-066c-4a48-ad39-e1b732d34fbc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:23.303455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ce5568ee-a9bf-43a3-a93c-6905b9ef6772 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:23.312346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce5568ee-a9bf-43a3-a93c-6905b9ef6772 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.190367 May 23 13:59:23.314421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1348/2620] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:23 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:23.319374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:23.319999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:23.326897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:23.327353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:23.328151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:23.329853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:23.404964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:23.406778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3d942f5-066c-4a48-ad39-e1b732d34fbc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:23.410198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:23.411742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:23.412951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b5ea0c0-9dcc-4994-b01e-7e994264f2e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.097502 May 23 13:59:23.413561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1349/2621] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:23.415465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3d942f5-066c-4a48-ad39-e1b732d34fbc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.192667 May 23 13:59:23.416056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1273/2622] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:23 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:24.019670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7a3f3d05-75b8-4bf5-a331-a38a96d80fdb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:24.020246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7a3f3d05-75b8-4bf5-a331-a38a96d80fdb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:24.029277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bbf7d7b2-fb65-4b44-bd5d-1bd07eced8cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:24.029896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a3f3d05-75b8-4bf5-a331-a38a96d80fdb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.030362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a3f3d05-75b8-4bf5-a331-a38a96d80fdb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.030481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bbf7d7b2-fb65-4b44-bd5d-1bd07eced8cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:24.032898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a3f3d05-75b8-4bf5-a331-a38a96d80fdb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.033639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a3f3d05-75b8-4bf5-a331-a38a96d80fdb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.041827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbf7d7b2-fb65-4b44-bd5d-1bd07eced8cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.042563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbf7d7b2-fb65-4b44-bd5d-1bd07eced8cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.043831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbf7d7b2-fb65-4b44-bd5d-1bd07eced8cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.044556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbf7d7b2-fb65-4b44-bd5d-1bd07eced8cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.152149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbf7d7b2-fb65-4b44-bd5d-1bd07eced8cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:24.161881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bbf7d7b2-fb65-4b44-bd5d-1bd07eced8cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.138972 May 23 13:59:24.162651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1274/2623] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:24 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:24.207897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7a3f3d05-75b8-4bf5-a331-a38a96d80fdb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:24.216465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7a3f3d05-75b8-4bf5-a331-a38a96d80fdb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.200816 May 23 13:59:24.217101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1350/2624] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:24 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:24.332225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc6cabf3-4dd5-4002-ad70-0fb2bb7bf065 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:24.333390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc6cabf3-4dd5-4002-ad70-0fb2bb7bf065 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:24.340091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc6cabf3-4dd5-4002-ad70-0fb2bb7bf065 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.340538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc6cabf3-4dd5-4002-ad70-0fb2bb7bf065 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.341385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc6cabf3-4dd5-4002-ad70-0fb2bb7bf065 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.341828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc6cabf3-4dd5-4002-ad70-0fb2bb7bf065 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.433675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:24.434430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:24.445662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.446140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.446916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.447484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.502182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dc6cabf3-4dd5-4002-ad70-0fb2bb7bf065 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:24.514460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc6cabf3-4dd5-4002-ad70-0fb2bb7bf065 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.186514 May 23 13:59:24.515315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1275/2625] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:24 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:24.516487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:24.524796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7cd56ffe-5c12-4eb9-a2f6-a4af60ef1369 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:24.525928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7cd56ffe-5c12-4eb9-a2f6-a4af60ef1369 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:24.527967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:24.529546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:24.530743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39802655-963a-406e-90d7-e7ad0d15ab0e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.102805 May 23 13:59:24.531347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1351/2626] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:24 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:24.537025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cd56ffe-5c12-4eb9-a2f6-a4af60ef1369 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.537868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cd56ffe-5c12-4eb9-a2f6-a4af60ef1369 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.539269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cd56ffe-5c12-4eb9-a2f6-a4af60ef1369 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:24.540066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cd56ffe-5c12-4eb9-a2f6-a4af60ef1369 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:24.712168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7cd56ffe-5c12-4eb9-a2f6-a4af60ef1369 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:24.721556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7cd56ffe-5c12-4eb9-a2f6-a4af60ef1369 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.204093 May 23 13:59:24.722148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1276/2627] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:24 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:25.179812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-94faad5e-8d5b-4ef6-b748-9a8d1af3dec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:25.180558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-94faad5e-8d5b-4ef6-b748-9a8d1af3dec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:25.188819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94faad5e-8d5b-4ef6-b748-9a8d1af3dec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.189572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94faad5e-8d5b-4ef6-b748-9a8d1af3dec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.190386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94faad5e-8d5b-4ef6-b748-9a8d1af3dec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.190832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94faad5e-8d5b-4ef6-b748-9a8d1af3dec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.235130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-83464eb2-17f2-4f8d-a483-eec07d3f8045 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:25.236249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-83464eb2-17f2-4f8d-a483-eec07d3f8045 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:25.243392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83464eb2-17f2-4f8d-a483-eec07d3f8045 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.243853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83464eb2-17f2-4f8d-a483-eec07d3f8045 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.244679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83464eb2-17f2-4f8d-a483-eec07d3f8045 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.245156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83464eb2-17f2-4f8d-a483-eec07d3f8045 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.272064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94faad5e-8d5b-4ef6-b748-9a8d1af3dec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:25.280515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-94faad5e-8d5b-4ef6-b748-9a8d1af3dec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.104617 May 23 13:59:25.281139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1352/2628] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:25 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:25.409100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-83464eb2-17f2-4f8d-a483-eec07d3f8045 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:25.420468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-83464eb2-17f2-4f8d-a483-eec07d3f8045 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.189204 May 23 13:59:25.420468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1277/2629] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:25 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:25.536164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6676b907-6981-435d-ac85-7300ef2d48d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:25.536817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6676b907-6981-435d-ac85-7300ef2d48d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:25.538729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:25.544273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6676b907-6981-435d-ac85-7300ef2d48d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.553567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6676b907-6981-435d-ac85-7300ef2d48d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.553567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6676b907-6981-435d-ac85-7300ef2d48d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.553567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6676b907-6981-435d-ac85-7300ef2d48d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.554105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:25.554105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:25.558082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.558537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.559321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.559761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.646937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:25.658361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:25.660465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:25.669842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-30190477-97bd-45b5-a03e-dcbfd3e84bb8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.116724 May 23 13:59:25.669842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1278/2630] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:25.713872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6676b907-6981-435d-ac85-7300ef2d48d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:25.717692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6676b907-6981-435d-ac85-7300ef2d48d3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.188133 May 23 13:59:25.718281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1353/2631] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:25 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:25.740158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d868c0d-9e9d-40aa-9432-33f6204cf540 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:25.740822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d868c0d-9e9d-40aa-9432-33f6204cf540 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:25.747176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d868c0d-9e9d-40aa-9432-33f6204cf540 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.759707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d868c0d-9e9d-40aa-9432-33f6204cf540 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.759707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d868c0d-9e9d-40aa-9432-33f6204cf540 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:25.759707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d868c0d-9e9d-40aa-9432-33f6204cf540 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:25.888281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d868c0d-9e9d-40aa-9432-33f6204cf540 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:25.896829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d868c0d-9e9d-40aa-9432-33f6204cf540 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160550 May 23 13:59:25.897414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1279/2632] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:25 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:26.299639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a730d80-022b-46f3-b0e8-8e363faa99ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:26.300282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a730d80-022b-46f3-b0e8-8e363faa99ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:26.307595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a730d80-022b-46f3-b0e8-8e363faa99ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.310482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a730d80-022b-46f3-b0e8-8e363faa99ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:26.310482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a730d80-022b-46f3-b0e8-8e363faa99ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.310482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a730d80-022b-46f3-b0e8-8e363faa99ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:26.378575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a730d80-022b-46f3-b0e8-8e363faa99ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:26.386924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a730d80-022b-46f3-b0e8-8e363faa99ce tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092065 May 23 13:59:26.387511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1354/2633] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:26 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:26.438048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a1e41e48-4873-400c-9743-d40c8315f679 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:26.439039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a1e41e48-4873-400c-9743-d40c8315f679 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:26.445850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1e41e48-4873-400c-9743-d40c8315f679 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.446308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1e41e48-4873-400c-9743-d40c8315f679 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:26.447083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1e41e48-4873-400c-9743-d40c8315f679 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.447559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1e41e48-4873-400c-9743-d40c8315f679 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:26.582046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a1e41e48-4873-400c-9743-d40c8315f679 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:26.590498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a1e41e48-4873-400c-9743-d40c8315f679 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156368 May 23 13:59:26.591086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1280/2634] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:26 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:26.690181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:26.690727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:26.697326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.697799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:26.698684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.699131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:26.735370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06ed3900-20dd-4a50-8d98-0bbf1fed9197 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:26.736019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06ed3900-20dd-4a50-8d98-0bbf1fed9197 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:26.746119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06ed3900-20dd-4a50-8d98-0bbf1fed9197 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.746768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06ed3900-20dd-4a50-8d98-0bbf1fed9197 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:26.747845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06ed3900-20dd-4a50-8d98-0bbf1fed9197 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.748395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06ed3900-20dd-4a50-8d98-0bbf1fed9197 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:26.772419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:26.780061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:26.781714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:26.782910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-16e2dea2-da89-4998-a34c-8ab4be659669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098141 May 23 13:59:26.783478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1355/2635] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:26.906895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06ed3900-20dd-4a50-8d98-0bbf1fed9197 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:26.914206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-959af3c5-b0a8-44e5-babf-b519d209ffd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:26.914834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-959af3c5-b0a8-44e5-babf-b519d209ffd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:26.920973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-959af3c5-b0a8-44e5-babf-b519d209ffd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.921409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06ed3900-20dd-4a50-8d98-0bbf1fed9197 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.189600 May 23 13:59:26.921532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-959af3c5-b0a8-44e5-babf-b519d209ffd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:26.922593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-959af3c5-b0a8-44e5-babf-b519d209ffd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:26.922790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1281/2636] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:26 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:26.922911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-959af3c5-b0a8-44e5-babf-b519d209ffd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:27.097436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-959af3c5-b0a8-44e5-babf-b519d209ffd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:27.106130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-959af3c5-b0a8-44e5-babf-b519d209ffd3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.195785 May 23 13:59:27.106702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1356/2637] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:26 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:27.404733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56a553e5-de72-4cf2-a77e-96d978b641c9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:27.405352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56a553e5-de72-4cf2-a77e-96d978b641c9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:27.412048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56a553e5-de72-4cf2-a77e-96d978b641c9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:27.412500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56a553e5-de72-4cf2-a77e-96d978b641c9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:27.413344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56a553e5-de72-4cf2-a77e-96d978b641c9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:27.413782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56a553e5-de72-4cf2-a77e-96d978b641c9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:27.418272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:27.491277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56a553e5-de72-4cf2-a77e-96d978b641c9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:27.499555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56a553e5-de72-4cf2-a77e-96d978b641c9 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.098615 May 23 13:59:27.500417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1282/2638] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:27 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:27.613581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-22b6c391-1d38-4c2a-bbda-87de8da321f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:27.614692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-22b6c391-1d38-4c2a-bbda-87de8da321f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:27.626177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22b6c391-1d38-4c2a-bbda-87de8da321f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:27.631602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22b6c391-1d38-4c2a-bbda-87de8da321f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:27.631602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22b6c391-1d38-4c2a-bbda-87de8da321f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:27.631602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22b6c391-1d38-4c2a-bbda-87de8da321f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:27.776796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-22b6c391-1d38-4c2a-bbda-87de8da321f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:27.786115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-22b6c391-1d38-4c2a-bbda-87de8da321f0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.179742 May 23 13:59:27.786698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1357/2639] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:27 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:27.801897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:27.802515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:27.808843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:27.809295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:27.810067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:27.810505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:27.878847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:27.888101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:27.889674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:27.891642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65f10701-1945-44d3-9459-4b988b5f7b67 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094543 May 23 13:59:27.892376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1283/2640] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:27.942801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-81963ac0-24a4-43dc-8f28-da59a5993651 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:27.943429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-81963ac0-24a4-43dc-8f28-da59a5993651 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:27.949987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81963ac0-24a4-43dc-8f28-da59a5993651 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:27.950443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81963ac0-24a4-43dc-8f28-da59a5993651 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:27.951222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81963ac0-24a4-43dc-8f28-da59a5993651 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:27.951662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81963ac0-24a4-43dc-8f28-da59a5993651 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:28.102458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-81963ac0-24a4-43dc-8f28-da59a5993651 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:28.111452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-81963ac0-24a4-43dc-8f28-da59a5993651 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.172960 May 23 13:59:28.112034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1358/2641] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:27 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:28.132760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-66798573-c0e5-4b20-bbf6-510e94899574 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:28.133378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-66798573-c0e5-4b20-bbf6-510e94899574 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:28.139682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66798573-c0e5-4b20-bbf6-510e94899574 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:28.140135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66798573-c0e5-4b20-bbf6-510e94899574 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:28.141134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66798573-c0e5-4b20-bbf6-510e94899574 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:28.141572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66798573-c0e5-4b20-bbf6-510e94899574 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:28.290579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-66798573-c0e5-4b20-bbf6-510e94899574 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:28.299600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-66798573-c0e5-4b20-bbf6-510e94899574 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.170652 May 23 13:59:28.300131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1284/2642] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:28 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:28.522611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-315b1eec-c341-4a93-b57b-9c15c64e75b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:28.523223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-315b1eec-c341-4a93-b57b-9c15c64e75b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:28.529323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-315b1eec-c341-4a93-b57b-9c15c64e75b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:28.529844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-315b1eec-c341-4a93-b57b-9c15c64e75b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:28.530526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-315b1eec-c341-4a93-b57b-9c15c64e75b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:28.531466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-315b1eec-c341-4a93-b57b-9c15c64e75b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:28.595424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-315b1eec-c341-4a93-b57b-9c15c64e75b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:28.604335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-315b1eec-c341-4a93-b57b-9c15c64e75b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085546 May 23 13:59:28.604955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1359/2643] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:28 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:28.807869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fb2030e8-f97f-4c0a-8ce6-6d8575a57974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:28.808505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fb2030e8-f97f-4c0a-8ce6-6d8575a57974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:28.816843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb2030e8-f97f-4c0a-8ce6-6d8575a57974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:28.817299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb2030e8-f97f-4c0a-8ce6-6d8575a57974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:28.818084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb2030e8-f97f-4c0a-8ce6-6d8575a57974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:28.818518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb2030e8-f97f-4c0a-8ce6-6d8575a57974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:28.910598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:28.911269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:28.917800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:28.918254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:28.919072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:28.919512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:28.953791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb2030e8-f97f-4c0a-8ce6-6d8575a57974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:28.962560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fb2030e8-f97f-4c0a-8ce6-6d8575a57974 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.162549 May 23 13:59:28.963153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1285/2644] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:28 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:28.989454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:28.992463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:28.997886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:29.005912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:29.005912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-84f485eb-4644-47ab-a5f8-a7aee134e37b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094532 May 23 13:59:29.005912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1360/2645] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:28 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:29.128635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e517c6d3-0a3f-4d8a-aea9-cd1bc49572d0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:29.129594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e517c6d3-0a3f-4d8a-aea9-cd1bc49572d0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:29.136430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e517c6d3-0a3f-4d8a-aea9-cd1bc49572d0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:29.143215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e517c6d3-0a3f-4d8a-aea9-cd1bc49572d0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:29.143215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e517c6d3-0a3f-4d8a-aea9-cd1bc49572d0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:29.143215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e517c6d3-0a3f-4d8a-aea9-cd1bc49572d0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:29.296152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e517c6d3-0a3f-4d8a-aea9-cd1bc49572d0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:29.304938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e517c6d3-0a3f-4d8a-aea9-cd1bc49572d0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.180735 May 23 13:59:29.305495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1286/2646] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:29 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:29.316908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f934d87b-b4d6-4a44-83b7-719dc17e0c33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:29.317493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f934d87b-b4d6-4a44-83b7-719dc17e0c33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:29.323970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f934d87b-b4d6-4a44-83b7-719dc17e0c33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:29.324416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f934d87b-b4d6-4a44-83b7-719dc17e0c33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:29.325204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f934d87b-b4d6-4a44-83b7-719dc17e0c33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:29.325641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f934d87b-b4d6-4a44-83b7-719dc17e0c33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:29.457642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f934d87b-b4d6-4a44-83b7-719dc17e0c33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:29.465768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f934d87b-b4d6-4a44-83b7-719dc17e0c33 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.152949 May 23 13:59:29.466329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1361/2647] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:29 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:29.622061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ed480205-8269-4c42-8816-60100ec566f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:29.622677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ed480205-8269-4c42-8816-60100ec566f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:29.629812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed480205-8269-4c42-8816-60100ec566f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:29.630266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed480205-8269-4c42-8816-60100ec566f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:29.631046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed480205-8269-4c42-8816-60100ec566f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:29.631481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ed480205-8269-4c42-8816-60100ec566f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:29.694952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ed480205-8269-4c42-8816-60100ec566f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:29.703462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ed480205-8269-4c42-8816-60100ec566f0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084952 May 23 13:59:29.704203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1287/2648] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:29 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:29.980082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-617c709c-7710-4e30-b8b7-9bd3ae829015 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:29.980736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-617c709c-7710-4e30-b8b7-9bd3ae829015 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:29.988003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-617c709c-7710-4e30-b8b7-9bd3ae829015 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:29.988459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-617c709c-7710-4e30-b8b7-9bd3ae829015 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:29.989270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-617c709c-7710-4e30-b8b7-9bd3ae829015 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:29.989859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-617c709c-7710-4e30-b8b7-9bd3ae829015 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:30.022999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:30.023609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:30.029937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:30.030383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:30.031180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:30.031614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:30.096000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:30.105108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:30.106626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:30.107780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d6c905e5-3aa9-4c58-b58b-adf2cd13e1df tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088698 May 23 13:59:30.108345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1288/2649] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:30.128512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-617c709c-7710-4e30-b8b7-9bd3ae829015 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:30.136542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-617c709c-7710-4e30-b8b7-9bd3ae829015 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160422 May 23 13:59:30.137133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1362/2650] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:29 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:30.322787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0792ee61-5dec-47a2-9d4d-30624d114caa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:30.323536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0792ee61-5dec-47a2-9d4d-30624d114caa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:30.329613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0792ee61-5dec-47a2-9d4d-30624d114caa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:30.330054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0792ee61-5dec-47a2-9d4d-30624d114caa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:30.330801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0792ee61-5dec-47a2-9d4d-30624d114caa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:30.331237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0792ee61-5dec-47a2-9d4d-30624d114caa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:30.461378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0792ee61-5dec-47a2-9d4d-30624d114caa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:30.469854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0792ee61-5dec-47a2-9d4d-30624d114caa tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.150925 May 23 13:59:30.470427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1289/2651] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:30 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:30.483064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3725691b-0628-45a0-a755-d859006a7148 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:30.483674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3725691b-0628-45a0-a755-d859006a7148 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:30.490521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3725691b-0628-45a0-a755-d859006a7148 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:30.490961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3725691b-0628-45a0-a755-d859006a7148 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:30.491713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3725691b-0628-45a0-a755-d859006a7148 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:30.492146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3725691b-0628-45a0-a755-d859006a7148 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:30.626694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3725691b-0628-45a0-a755-d859006a7148 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:30.634936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3725691b-0628-45a0-a755-d859006a7148 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.155650 May 23 13:59:30.635518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1363/2652] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:30 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:30.721146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cf3468b9-fed5-401e-9add-a34121698e17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:30.721763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cf3468b9-fed5-401e-9add-a34121698e17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:30.728399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf3468b9-fed5-401e-9add-a34121698e17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:30.728863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf3468b9-fed5-401e-9add-a34121698e17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:30.729631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf3468b9-fed5-401e-9add-a34121698e17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:30.730065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf3468b9-fed5-401e-9add-a34121698e17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:30.798140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf3468b9-fed5-401e-9add-a34121698e17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:30.806423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cf3468b9-fed5-401e-9add-a34121698e17 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089448 May 23 13:59:30.807006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1290/2653] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:30 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:31.127968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:31.128794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:31.139344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.140152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.142603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.143408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.153712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c96cb1d-e0c0-424c-a4fb-a81ef9e0f947 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:31.154324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c96cb1d-e0c0-424c-a4fb-a81ef9e0f947 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:31.161356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c96cb1d-e0c0-424c-a4fb-a81ef9e0f947 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.161805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c96cb1d-e0c0-424c-a4fb-a81ef9e0f947 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.162595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c96cb1d-e0c0-424c-a4fb-a81ef9e0f947 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.163024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c96cb1d-e0c0-424c-a4fb-a81ef9e0f947 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.222254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:31.231167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:31.232812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:31.234139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf99d27e-4286-4b18-b472-8bc942e86cd6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.111564 May 23 13:59:31.235558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1364/2654] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:31 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:31.306849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c96cb1d-e0c0-424c-a4fb-a81ef9e0f947 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:31.316158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c96cb1d-e0c0-424c-a4fb-a81ef9e0f947 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166416 May 23 13:59:31.316769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1291/2655] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:31 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:31.488197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6c091201-a86c-4a28-85bb-20ba9ef7628e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:31.488775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6c091201-a86c-4a28-85bb-20ba9ef7628e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:31.495005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c091201-a86c-4a28-85bb-20ba9ef7628e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.495459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c091201-a86c-4a28-85bb-20ba9ef7628e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.496246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c091201-a86c-4a28-85bb-20ba9ef7628e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.496712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c091201-a86c-4a28-85bb-20ba9ef7628e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.637713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c091201-a86c-4a28-85bb-20ba9ef7628e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:31.647917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6c091201-a86c-4a28-85bb-20ba9ef7628e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164367 May 23 13:59:31.648545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1365/2656] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:31 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:31.656769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-005f6109-eeb5-4ea5-9aa7-143abf46d8a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:31.657831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-005f6109-eeb5-4ea5-9aa7-143abf46d8a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:31.665532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-005f6109-eeb5-4ea5-9aa7-143abf46d8a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.665985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-005f6109-eeb5-4ea5-9aa7-143abf46d8a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.666759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-005f6109-eeb5-4ea5-9aa7-143abf46d8a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.667198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-005f6109-eeb5-4ea5-9aa7-143abf46d8a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.804697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-005f6109-eeb5-4ea5-9aa7-143abf46d8a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:31.813828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-005f6109-eeb5-4ea5-9aa7-143abf46d8a3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163569 May 23 13:59:31.814394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1292/2657] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:31 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:31.823210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef4718b8-3f8d-41b0-bc20-f90d8a965f68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:31.823831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef4718b8-3f8d-41b0-bc20-f90d8a965f68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:31.830197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef4718b8-3f8d-41b0-bc20-f90d8a965f68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.830650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef4718b8-3f8d-41b0-bc20-f90d8a965f68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.831458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef4718b8-3f8d-41b0-bc20-f90d8a965f68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:31.831894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef4718b8-3f8d-41b0-bc20-f90d8a965f68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:31.894820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef4718b8-3f8d-41b0-bc20-f90d8a965f68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:31.902991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef4718b8-3f8d-41b0-bc20-f90d8a965f68 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083607 May 23 13:59:31.903570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1366/2658] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:31 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:32.252725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:32.253385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:32.260018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.260470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.261357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.261800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.334601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37e9905c-0b19-4fdf-a445-00af664b48a2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:32.335587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37e9905c-0b19-4fdf-a445-00af664b48a2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:32.336964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:32.346556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37e9905c-0b19-4fdf-a445-00af664b48a2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.347273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37e9905c-0b19-4fdf-a445-00af664b48a2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.348514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37e9905c-0b19-4fdf-a445-00af664b48a2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.349279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37e9905c-0b19-4fdf-a445-00af664b48a2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.354594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:32.357217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:32.359789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f732bbdb-ac09-495d-89c2-9a02ae9db62a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.110318 May 23 13:59:32.360887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1293/2659] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:32 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:32.494347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37e9905c-0b19-4fdf-a445-00af664b48a2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:32.502514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37e9905c-0b19-4fdf-a445-00af664b48a2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.172956 May 23 13:59:32.503093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1367/2660] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:32 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:32.665364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65c4eaba-1783-471f-b39e-3cf1528951b0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:32.665992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65c4eaba-1783-471f-b39e-3cf1528951b0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:32.673740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65c4eaba-1783-471f-b39e-3cf1528951b0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.674195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65c4eaba-1783-471f-b39e-3cf1528951b0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.675001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65c4eaba-1783-471f-b39e-3cf1528951b0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.675447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65c4eaba-1783-471f-b39e-3cf1528951b0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.819135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65c4eaba-1783-471f-b39e-3cf1528951b0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:32.829246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65c4eaba-1783-471f-b39e-3cf1528951b0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.167612 May 23 13:59:32.829892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1294/2661] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:32 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:32.831792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0382b2f6-e990-461b-a8d7-6dd235b5457b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:32.832411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0382b2f6-e990-461b-a8d7-6dd235b5457b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:32.838685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0382b2f6-e990-461b-a8d7-6dd235b5457b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.839134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0382b2f6-e990-461b-a8d7-6dd235b5457b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.839903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0382b2f6-e990-461b-a8d7-6dd235b5457b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.840337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0382b2f6-e990-461b-a8d7-6dd235b5457b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.920812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fe42ba70-c9bd-4d92-b5bd-d9adfffa9031 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:32.921432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fe42ba70-c9bd-4d92-b5bd-d9adfffa9031 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:32.927733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe42ba70-c9bd-4d92-b5bd-d9adfffa9031 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.928180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe42ba70-c9bd-4d92-b5bd-d9adfffa9031 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.928983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe42ba70-c9bd-4d92-b5bd-d9adfffa9031 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:32.929420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe42ba70-c9bd-4d92-b5bd-d9adfffa9031 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:32.979349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0382b2f6-e990-461b-a8d7-6dd235b5457b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:32.990248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0382b2f6-e990-461b-a8d7-6dd235b5457b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162764 May 23 13:59:32.990843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1368/2662] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:32 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:33.001160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fe42ba70-c9bd-4d92-b5bd-d9adfffa9031 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:33.009357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fe42ba70-c9bd-4d92-b5bd-d9adfffa9031 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092421 May 23 13:59:33.009923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1295/2663] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:32 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:33.379963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:33.380652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:33.387274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:33.387724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:33.388491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:33.388956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:33.456010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:33.464884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:33.466394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:33.467552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-07c62649-34cd-4bd9-a1fc-7bc39227a8f0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091524 May 23 13:59:33.468113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1369/2664] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:33.519002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9937f779-73fd-4eab-95db-44f8abbda05e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:33.519616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9937f779-73fd-4eab-95db-44f8abbda05e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:33.525828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9937f779-73fd-4eab-95db-44f8abbda05e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:33.526278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9937f779-73fd-4eab-95db-44f8abbda05e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:33.527039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9937f779-73fd-4eab-95db-44f8abbda05e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:33.527473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9937f779-73fd-4eab-95db-44f8abbda05e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:33.663502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9937f779-73fd-4eab-95db-44f8abbda05e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:33.672204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9937f779-73fd-4eab-95db-44f8abbda05e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156472 May 23 13:59:33.672815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1296/2665] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:33 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:33.846098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5c120a6f-b3e6-4215-bf4c-af45245e2512 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:33.846645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5c120a6f-b3e6-4215-bf4c-af45245e2512 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:33.852785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c120a6f-b3e6-4215-bf4c-af45245e2512 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:33.865547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c120a6f-b3e6-4215-bf4c-af45245e2512 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:33.865547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c120a6f-b3e6-4215-bf4c-af45245e2512 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:33.865547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c120a6f-b3e6-4215-bf4c-af45245e2512 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:33.986426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5c120a6f-b3e6-4215-bf4c-af45245e2512 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:33.994303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5c120a6f-b3e6-4215-bf4c-af45245e2512 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152655 May 23 13:59:33.994865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1370/2666] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:33 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:34.008341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46ee3b21-f0ce-4afd-a051-ba8d0aba9d09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:34.008990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46ee3b21-f0ce-4afd-a051-ba8d0aba9d09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:34.016198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46ee3b21-f0ce-4afd-a051-ba8d0aba9d09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:34.016368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46ee3b21-f0ce-4afd-a051-ba8d0aba9d09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:34.017137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46ee3b21-f0ce-4afd-a051-ba8d0aba9d09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:34.017576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46ee3b21-f0ce-4afd-a051-ba8d0aba9d09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:34.026944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-962fe69c-91cf-4f2c-98cc-a7b534f3ce12 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:34.027563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-962fe69c-91cf-4f2c-98cc-a7b534f3ce12 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:34.034448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962fe69c-91cf-4f2c-98cc-a7b534f3ce12 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:34.034895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962fe69c-91cf-4f2c-98cc-a7b534f3ce12 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:34.035649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962fe69c-91cf-4f2c-98cc-a7b534f3ce12 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:34.036087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962fe69c-91cf-4f2c-98cc-a7b534f3ce12 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:34.097918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-962fe69c-91cf-4f2c-98cc-a7b534f3ce12 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:34.106181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-962fe69c-91cf-4f2c-98cc-a7b534f3ce12 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.082966 May 23 13:59:34.106758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1371/2667] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:34 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:34.147467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46ee3b21-f0ce-4afd-a051-ba8d0aba9d09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:34.155467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46ee3b21-f0ce-4afd-a051-ba8d0aba9d09 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.150931 May 23 13:59:34.156627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1297/2668] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:34 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:34.486215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:34.486830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:34.493434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:34.493885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:34.494647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:34.495092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:34.575049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:34.584360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:34.585919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:34.587037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aa61cf15-e0dc-470f-8db8-4c601df7aac4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.104793 May 23 13:59:34.587594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1372/2669] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:34 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:34.689384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-847f794c-e1bb-46ac-bd92-12c6ab566799 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:34.690002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-847f794c-e1bb-46ac-bd92-12c6ab566799 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:34.696157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-847f794c-e1bb-46ac-bd92-12c6ab566799 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:34.696647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-847f794c-e1bb-46ac-bd92-12c6ab566799 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:34.697415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-847f794c-e1bb-46ac-bd92-12c6ab566799 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:34.697854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-847f794c-e1bb-46ac-bd92-12c6ab566799 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:34.833916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-847f794c-e1bb-46ac-bd92-12c6ab566799 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:34.837391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:34.842266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-847f794c-e1bb-46ac-bd92-12c6ab566799 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.157682 May 23 13:59:34.842835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1298/2670] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:34 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:35.011438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dbbe9460-8c0c-4ad1-b071-3fd94f879152 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:35.012076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dbbe9460-8c0c-4ad1-b071-3fd94f879152 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:35.018697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbbe9460-8c0c-4ad1-b071-3fd94f879152 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.025933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbbe9460-8c0c-4ad1-b071-3fd94f879152 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:35.025933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbbe9460-8c0c-4ad1-b071-3fd94f879152 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.025933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbbe9460-8c0c-4ad1-b071-3fd94f879152 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:35.123733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-78bfefc8-df55-4555-b5ab-c89d38bc5b41 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:35.124410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-78bfefc8-df55-4555-b5ab-c89d38bc5b41 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:35.132198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78bfefc8-df55-4555-b5ab-c89d38bc5b41 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.132716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78bfefc8-df55-4555-b5ab-c89d38bc5b41 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:35.133482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78bfefc8-df55-4555-b5ab-c89d38bc5b41 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.133912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78bfefc8-df55-4555-b5ab-c89d38bc5b41 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:35.176549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dbbe9460-8c0c-4ad1-b071-3fd94f879152 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:35.185804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dbbe9460-8c0c-4ad1-b071-3fd94f879152 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.178214 May 23 13:59:35.195949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1373/2671] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:35 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:35.195949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5ae6485b-4376-4667-b932-14a1b7aee7ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:35.195949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5ae6485b-4376-4667-b932-14a1b7aee7ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:35.199445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ae6485b-4376-4667-b932-14a1b7aee7ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.199893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ae6485b-4376-4667-b932-14a1b7aee7ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:35.200698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ae6485b-4376-4667-b932-14a1b7aee7ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.201352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ae6485b-4376-4667-b932-14a1b7aee7ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:35.208337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78bfefc8-df55-4555-b5ab-c89d38bc5b41 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:35.211619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-78bfefc8-df55-4555-b5ab-c89d38bc5b41 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092186 May 23 13:59:35.212235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1299/2672] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:35 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:35.342548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5ae6485b-4376-4667-b932-14a1b7aee7ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:35.351424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5ae6485b-4376-4667-b932-14a1b7aee7ef tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163972 May 23 13:59:35.352003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1374/2673] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:35 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:35.610532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:35.611143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:35.617452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.617903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:35.618678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.619108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:35.685656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:35.695382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:35.696941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:35.698085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-60115999-0765-40de-ad70-e681eec50fb4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092447 May 23 13:59:35.698646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1300/2674] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:35 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:35.863861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-74023ce5-2cc8-4890-8759-9a0bf8a45b79 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:35.864479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-74023ce5-2cc8-4890-8759-9a0bf8a45b79 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:35.871039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74023ce5-2cc8-4890-8759-9a0bf8a45b79 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.871493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74023ce5-2cc8-4890-8759-9a0bf8a45b79 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:35.872260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74023ce5-2cc8-4890-8759-9a0bf8a45b79 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:35.872729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74023ce5-2cc8-4890-8759-9a0bf8a45b79 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:36.004129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-74023ce5-2cc8-4890-8759-9a0bf8a45b79 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:36.012004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-74023ce5-2cc8-4890-8759-9a0bf8a45b79 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.152030 May 23 13:59:36.012589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1375/2675] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:35 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:36.203994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-50a4b2c3-5cbd-4c0a-9684-6eb39579bab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:36.204639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-50a4b2c3-5cbd-4c0a-9684-6eb39579bab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:36.211189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50a4b2c3-5cbd-4c0a-9684-6eb39579bab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:36.211644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50a4b2c3-5cbd-4c0a-9684-6eb39579bab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:36.212404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50a4b2c3-5cbd-4c0a-9684-6eb39579bab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:36.212866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50a4b2c3-5cbd-4c0a-9684-6eb39579bab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:36.229976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b3d141b-17dc-4b2d-8014-ddfc1345a082 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:36.230609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b3d141b-17dc-4b2d-8014-ddfc1345a082 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:36.237621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b3d141b-17dc-4b2d-8014-ddfc1345a082 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:36.238080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b3d141b-17dc-4b2d-8014-ddfc1345a082 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:36.238851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b3d141b-17dc-4b2d-8014-ddfc1345a082 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:36.239302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b3d141b-17dc-4b2d-8014-ddfc1345a082 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:36.301579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b3d141b-17dc-4b2d-8014-ddfc1345a082 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:36.309862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b3d141b-17dc-4b2d-8014-ddfc1345a082 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083734 May 23 13:59:36.310432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1376/2676] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:36 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:36.344951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-50a4b2c3-5cbd-4c0a-9684-6eb39579bab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:36.353085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-50a4b2c3-5cbd-4c0a-9684-6eb39579bab0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153579 May 23 13:59:36.353862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1301/2677] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:36 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:36.371052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50fce791-744e-496e-bc23-6d44a864c7b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:36.371778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50fce791-744e-496e-bc23-6d44a864c7b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:36.378028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50fce791-744e-496e-bc23-6d44a864c7b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:36.378468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50fce791-744e-496e-bc23-6d44a864c7b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:36.379226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50fce791-744e-496e-bc23-6d44a864c7b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:36.379657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50fce791-744e-496e-bc23-6d44a864c7b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:36.398023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:36.508022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-50fce791-744e-496e-bc23-6d44a864c7b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:36.516591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50fce791-744e-496e-bc23-6d44a864c7b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.149259 May 23 13:59:36.517153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1377/2678] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:36 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:36.716486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:36.717034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:36.723475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:36.723921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:36.724718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:36.725154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:36.792098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:36.801194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:36.802711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:36.803886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57687d53-0be0-4cd9-a4b8-98be8db03843 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091375 May 23 13:59:36.804447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1302/2679] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:36 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:37.029381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-674816d3-ce7f-4cd5-bfdd-f261e11d29f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:37.029908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-674816d3-ce7f-4cd5-bfdd-f261e11d29f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:37.036810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-674816d3-ce7f-4cd5-bfdd-f261e11d29f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.037270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-674816d3-ce7f-4cd5-bfdd-f261e11d29f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.038041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-674816d3-ce7f-4cd5-bfdd-f261e11d29f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.038519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-674816d3-ce7f-4cd5-bfdd-f261e11d29f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.183564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-674816d3-ce7f-4cd5-bfdd-f261e11d29f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:37.194222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-674816d3-ce7f-4cd5-bfdd-f261e11d29f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.168725 May 23 13:59:37.194825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1378/2680] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:37 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:37.328106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6016b08-4919-4a1c-a00e-7d1526c68347 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:37.328856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6016b08-4919-4a1c-a00e-7d1526c68347 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:37.335696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6016b08-4919-4a1c-a00e-7d1526c68347 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.336150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6016b08-4919-4a1c-a00e-7d1526c68347 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.336951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6016b08-4919-4a1c-a00e-7d1526c68347 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.337413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6016b08-4919-4a1c-a00e-7d1526c68347 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.370392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2334b31-d5c7-4879-a5fc-9893cba070d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:37.371104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2334b31-d5c7-4879-a5fc-9893cba070d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:37.377848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2334b31-d5c7-4879-a5fc-9893cba070d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.378420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2334b31-d5c7-4879-a5fc-9893cba070d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.379267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2334b31-d5c7-4879-a5fc-9893cba070d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.379777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2334b31-d5c7-4879-a5fc-9893cba070d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.408712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6016b08-4919-4a1c-a00e-7d1526c68347 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:37.417327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6016b08-4919-4a1c-a00e-7d1526c68347 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.093680 May 23 13:59:37.417928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1303/2681] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:37 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:37.513791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2334b31-d5c7-4879-a5fc-9893cba070d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:37.521929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2334b31-d5c7-4879-a5fc-9893cba070d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155408 May 23 13:59:37.522505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1379/2682] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:37 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:37.535198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-518be283-4ddc-4963-9b19-f1542e420189 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:37.537448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-518be283-4ddc-4963-9b19-f1542e420189 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:37.542026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-518be283-4ddc-4963-9b19-f1542e420189 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.542482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-518be283-4ddc-4963-9b19-f1542e420189 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.543250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-518be283-4ddc-4963-9b19-f1542e420189 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.543691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-518be283-4ddc-4963-9b19-f1542e420189 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.679874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-518be283-4ddc-4963-9b19-f1542e420189 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:37.688267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-518be283-4ddc-4963-9b19-f1542e420189 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157421 May 23 13:59:37.688885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1304/2683] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:37 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:37.823731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:37.824351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:37.831321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.831776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.832549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:37.833016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:37.898781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:37.908312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:37.909881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:37.911064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e36ae1b-55e4-4c72-b2ff-e6e315a52bc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091643 May 23 13:59:37.911630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1380/2684] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:37 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:38.212650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2b1af1b8-3040-4218-b368-b0f317cf153b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:38.213303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2b1af1b8-3040-4218-b368-b0f317cf153b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:38.220324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b1af1b8-3040-4218-b368-b0f317cf153b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.220814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b1af1b8-3040-4218-b368-b0f317cf153b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:38.221594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b1af1b8-3040-4218-b368-b0f317cf153b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.222034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b1af1b8-3040-4218-b368-b0f317cf153b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:38.378098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2b1af1b8-3040-4218-b368-b0f317cf153b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:38.386235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2b1af1b8-3040-4218-b368-b0f317cf153b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.177455 May 23 13:59:38.386792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1305/2685] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:38 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:38.435252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aaf19843-1ac3-494b-b06b-500d4586506e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:38.435827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aaf19843-1ac3-494b-b06b-500d4586506e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:38.443730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaf19843-1ac3-494b-b06b-500d4586506e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.444264 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaf19843-1ac3-494b-b06b-500d4586506e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:38.445290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaf19843-1ac3-494b-b06b-500d4586506e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.445726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aaf19843-1ac3-494b-b06b-500d4586506e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:38.511666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aaf19843-1ac3-494b-b06b-500d4586506e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:38.519648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aaf19843-1ac3-494b-b06b-500d4586506e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088313 May 23 13:59:38.520211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1381/2686] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:38 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:38.539157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1a548613-ffa1-45dc-befb-eaccb78bb037 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:38.539766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1a548613-ffa1-45dc-befb-eaccb78bb037 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:38.548158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a548613-ffa1-45dc-befb-eaccb78bb037 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.548964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a548613-ffa1-45dc-befb-eaccb78bb037 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:38.550263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a548613-ffa1-45dc-befb-eaccb78bb037 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.551094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a548613-ffa1-45dc-befb-eaccb78bb037 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:38.682250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1a548613-ffa1-45dc-befb-eaccb78bb037 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:38.691400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1a548613-ffa1-45dc-befb-eaccb78bb037 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155948 May 23 13:59:38.691879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1306/2687] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:38 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:38.705977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca4d4d90-5d5a-4d0a-87c6-79d6adc28916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:38.706592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ca4d4d90-5d5a-4d0a-87c6-79d6adc28916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:38.712591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca4d4d90-5d5a-4d0a-87c6-79d6adc28916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.713041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca4d4d90-5d5a-4d0a-87c6-79d6adc28916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:38.713795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca4d4d90-5d5a-4d0a-87c6-79d6adc28916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.714265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca4d4d90-5d5a-4d0a-87c6-79d6adc28916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:38.841815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ca4d4d90-5d5a-4d0a-87c6-79d6adc28916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:38.850373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ca4d4d90-5d5a-4d0a-87c6-79d6adc28916 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.148700 May 23 13:59:38.850940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1382/2688] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:38 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:38.931778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:38.932380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:38.938879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.939319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:38.940076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:38.940506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:39.005380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:39.013968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:39.015577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:39.016762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5989640b-1b88-42b6-9a74-af18e019fe10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088857 May 23 13:59:39.017320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1307/2689] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:38 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:39.403643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4db0cfa2-285e-4403-92d9-2c6a3d699ee9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:39.404272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4db0cfa2-285e-4403-92d9-2c6a3d699ee9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:39.411827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db0cfa2-285e-4403-92d9-2c6a3d699ee9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:39.412277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db0cfa2-285e-4403-92d9-2c6a3d699ee9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:39.413102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db0cfa2-285e-4403-92d9-2c6a3d699ee9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:39.413543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db0cfa2-285e-4403-92d9-2c6a3d699ee9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:39.537397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd859a8d-2ffc-4d83-9467-5593426e2d40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:39.538024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd859a8d-2ffc-4d83-9467-5593426e2d40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:39.544560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd859a8d-2ffc-4d83-9467-5593426e2d40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:39.545051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd859a8d-2ffc-4d83-9467-5593426e2d40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:39.545804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd859a8d-2ffc-4d83-9467-5593426e2d40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:39.546415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd859a8d-2ffc-4d83-9467-5593426e2d40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:39.556299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4db0cfa2-285e-4403-92d9-2c6a3d699ee9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:39.566252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4db0cfa2-285e-4403-92d9-2c6a3d699ee9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166619 May 23 13:59:39.566848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1383/2690] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:39 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:39.613281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd859a8d-2ffc-4d83-9467-5593426e2d40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:39.621268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd859a8d-2ffc-4d83-9467-5593426e2d40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088324 May 23 13:59:39.621830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1308/2691] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:39 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:39.709644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-526637c6-dcbf-49af-b3d5-ce502ddce740 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:39.710188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-526637c6-dcbf-49af-b3d5-ce502ddce740 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:39.716241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-526637c6-dcbf-49af-b3d5-ce502ddce740 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:39.716725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-526637c6-dcbf-49af-b3d5-ce502ddce740 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:39.717485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-526637c6-dcbf-49af-b3d5-ce502ddce740 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:39.718233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-526637c6-dcbf-49af-b3d5-ce502ddce740 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:39.850048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-526637c6-dcbf-49af-b3d5-ce502ddce740 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:39.858037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-526637c6-dcbf-49af-b3d5-ce502ddce740 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152564 May 23 13:59:39.859139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1384/2692] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:39 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:39.868281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a28f51c9-1a45-42fb-a2ad-9fcb7531daae tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:39.868925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a28f51c9-1a45-42fb-a2ad-9fcb7531daae tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:39.875757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a28f51c9-1a45-42fb-a2ad-9fcb7531daae tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:39.876209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a28f51c9-1a45-42fb-a2ad-9fcb7531daae tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:39.877004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a28f51c9-1a45-42fb-a2ad-9fcb7531daae tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:39.877442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a28f51c9-1a45-42fb-a2ad-9fcb7531daae tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:40.017301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a28f51c9-1a45-42fb-a2ad-9fcb7531daae tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:40.025229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a28f51c9-1a45-42fb-a2ad-9fcb7531daae tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160801 May 23 13:59:40.025790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1309/2693] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:39 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:40.034782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:40.035405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:40.041735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:40.042189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:40.042957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:40.043397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:40.110027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:40.118926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:40.120447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:40.121619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-de1c5d09-d11e-4a0b-b8ba-400c5964d473 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090922 May 23 13:59:40.122176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1385/2694] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:40.584136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fc8175c9-a31a-4655-bd72-5aff725b3d97 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:40.584780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fc8175c9-a31a-4655-bd72-5aff725b3d97 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:40.591032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc8175c9-a31a-4655-bd72-5aff725b3d97 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:40.597207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc8175c9-a31a-4655-bd72-5aff725b3d97 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:40.597207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc8175c9-a31a-4655-bd72-5aff725b3d97 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:40.597207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc8175c9-a31a-4655-bd72-5aff725b3d97 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:40.639301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e60b81ad-62ae-4ac4-b12f-c1c31d5e61b2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:40.640621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e60b81ad-62ae-4ac4-b12f-c1c31d5e61b2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:40.646913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e60b81ad-62ae-4ac4-b12f-c1c31d5e61b2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:40.647452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e60b81ad-62ae-4ac4-b12f-c1c31d5e61b2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:40.648292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e60b81ad-62ae-4ac4-b12f-c1c31d5e61b2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:40.648829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e60b81ad-62ae-4ac4-b12f-c1c31d5e61b2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:40.714433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e60b81ad-62ae-4ac4-b12f-c1c31d5e61b2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:40.723352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e60b81ad-62ae-4ac4-b12f-c1c31d5e61b2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087845 May 23 13:59:40.724059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1386/2695] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:40 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:40.731869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc8175c9-a31a-4655-bd72-5aff725b3d97 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:40.741135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fc8175c9-a31a-4655-bd72-5aff725b3d97 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160826 May 23 13:59:40.741712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1310/2696] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:40 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:40.877504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b0b38968-1b86-41fe-abc1-80aa366de76f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:40.878139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b0b38968-1b86-41fe-abc1-80aa366de76f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:40.884404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0b38968-1b86-41fe-abc1-80aa366de76f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:40.884885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0b38968-1b86-41fe-abc1-80aa366de76f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:40.885650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0b38968-1b86-41fe-abc1-80aa366de76f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:40.886086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0b38968-1b86-41fe-abc1-80aa366de76f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:41.037858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b0b38968-1b86-41fe-abc1-80aa366de76f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:41.043725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5bdf2bb8-0241-4e70-af15-20ef6c8cd301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:41.044337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5bdf2bb8-0241-4e70-af15-20ef6c8cd301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:41.047133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b0b38968-1b86-41fe-abc1-80aa366de76f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.173890 May 23 13:59:41.047853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1387/2697] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:40 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:41.051096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bdf2bb8-0241-4e70-af15-20ef6c8cd301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:41.051538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bdf2bb8-0241-4e70-af15-20ef6c8cd301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:41.052296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bdf2bb8-0241-4e70-af15-20ef6c8cd301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:41.052754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bdf2bb8-0241-4e70-af15-20ef6c8cd301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:41.142074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:41.142745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:41.149296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:41.149754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:41.150539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:41.150999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:41.195874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5bdf2bb8-0241-4e70-af15-20ef6c8cd301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:41.205254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5bdf2bb8-0241-4e70-af15-20ef6c8cd301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165252 May 23 13:59:41.205850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1311/2698] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:41 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:41.220440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:41.229406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:41.230906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:41.232077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf6c0a88-fe2b-4642-b746-f58323c70661 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.095074 May 23 13:59:41.232646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1388/2699] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:41 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:41.739770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d27dc16b-fa40-4201-950e-36420d05709d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:41.740360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d27dc16b-fa40-4201-950e-36420d05709d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:41.747124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d27dc16b-fa40-4201-950e-36420d05709d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:41.747581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d27dc16b-fa40-4201-950e-36420d05709d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:41.748353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d27dc16b-fa40-4201-950e-36420d05709d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:41.748828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d27dc16b-fa40-4201-950e-36420d05709d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:41.759770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f454b31b-7fa9-4a1d-a98c-a38c360e5597 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:41.760426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f454b31b-7fa9-4a1d-a98c-a38c360e5597 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:41.767541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f454b31b-7fa9-4a1d-a98c-a38c360e5597 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:41.767993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f454b31b-7fa9-4a1d-a98c-a38c360e5597 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:41.768809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f454b31b-7fa9-4a1d-a98c-a38c360e5597 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:41.769252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f454b31b-7fa9-4a1d-a98c-a38c360e5597 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:41.818078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d27dc16b-fa40-4201-950e-36420d05709d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:41.826283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d27dc16b-fa40-4201-950e-36420d05709d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090327 May 23 13:59:41.826847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1312/2700] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:41 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:41.911734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f454b31b-7fa9-4a1d-a98c-a38c360e5597 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:41.919785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f454b31b-7fa9-4a1d-a98c-a38c360e5597 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164636 May 23 13:59:41.920353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1389/2701] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:41 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:42.064728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64a91270-b855-469b-8c38-f392576f5567 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:42.065272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64a91270-b855-469b-8c38-f392576f5567 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:42.071427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a91270-b855-469b-8c38-f392576f5567 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.071876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a91270-b855-469b-8c38-f392576f5567 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:42.072676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a91270-b855-469b-8c38-f392576f5567 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.073121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64a91270-b855-469b-8c38-f392576f5567 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:42.208138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64a91270-b855-469b-8c38-f392576f5567 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:42.216374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64a91270-b855-469b-8c38-f392576f5567 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156943 May 23 13:59:42.216993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1313/2702] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:42 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:42.223658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f3429529-cf66-4582-a540-468753f23a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:42.224363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f3429529-cf66-4582-a540-468753f23a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:42.232018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3429529-cf66-4582-a540-468753f23a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.232468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3429529-cf66-4582-a540-468753f23a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:42.233769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3429529-cf66-4582-a540-468753f23a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.234209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3429529-cf66-4582-a540-468753f23a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:42.254702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:42.256888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:42.267418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.267875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:42.268690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.269167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:42.338623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:42.348319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:42.349874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:42.351039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c67b9576-1edc-4e66-85b1-893ff6185771 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.103298 May 23 13:59:42.351611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1314/2703] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:42 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:42.381815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f3429529-cf66-4582-a540-468753f23a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:42.391537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f3429529-cf66-4582-a540-468753f23a7f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.171552 May 23 13:59:42.392196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1390/2704] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:42 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:42.844913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-16001a20-3b4b-4dc9-9f7b-4c611eec8f0d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:42.845537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-16001a20-3b4b-4dc9-9f7b-4c611eec8f0d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:42.852281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16001a20-3b4b-4dc9-9f7b-4c611eec8f0d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.852795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16001a20-3b4b-4dc9-9f7b-4c611eec8f0d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:42.853576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16001a20-3b4b-4dc9-9f7b-4c611eec8f0d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.854017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16001a20-3b4b-4dc9-9f7b-4c611eec8f0d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:42.875333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:42.921149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-16001a20-3b4b-4dc9-9f7b-4c611eec8f0d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:42.930338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-16001a20-3b4b-4dc9-9f7b-4c611eec8f0d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090047 May 23 13:59:42.930952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1315/2705] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:42 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:42.938288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-db7cc95c-56ac-4534-9d2c-54827772c251 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:42.939019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-db7cc95c-56ac-4534-9d2c-54827772c251 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:42.945993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db7cc95c-56ac-4534-9d2c-54827772c251 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.946455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db7cc95c-56ac-4534-9d2c-54827772c251 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:42.947236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db7cc95c-56ac-4534-9d2c-54827772c251 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:42.948026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db7cc95c-56ac-4534-9d2c-54827772c251 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:43.085683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-db7cc95c-56ac-4534-9d2c-54827772c251 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:43.095325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-db7cc95c-56ac-4534-9d2c-54827772c251 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161602 May 23 13:59:43.095829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1391/2706] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:42 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:43.234345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d407746d-218a-4692-9e40-63b283b570e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:43.234998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d407746d-218a-4692-9e40-63b283b570e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:43.241721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d407746d-218a-4692-9e40-63b283b570e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:43.242173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d407746d-218a-4692-9e40-63b283b570e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:43.242969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d407746d-218a-4692-9e40-63b283b570e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:43.243389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d407746d-218a-4692-9e40-63b283b570e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:43.369625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:43.370275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:43.377249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:43.377740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:43.378488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:43.378930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:43.397988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d407746d-218a-4692-9e40-63b283b570e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:43.407752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d407746d-218a-4692-9e40-63b283b570e5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.177160 May 23 13:59:43.415865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1316/2707] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:43 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:43.421876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d508330f-d6a9-41d0-b90a-6f9f7839098f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:43.422812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d508330f-d6a9-41d0-b90a-6f9f7839098f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:43.425017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:43.430154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d508330f-d6a9-41d0-b90a-6f9f7839098f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:43.430608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d508330f-d6a9-41d0-b90a-6f9f7839098f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:43.431377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d508330f-d6a9-41d0-b90a-6f9f7839098f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:43.431962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d508330f-d6a9-41d0-b90a-6f9f7839098f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:43.451116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:43.461862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:43.463496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:43.464694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52c62636-33f5-497c-ad4f-a9f9f24d4830 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098991 May 23 13:59:43.465257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1392/2708] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:43 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:43.920187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d508330f-d6a9-41d0-b90a-6f9f7839098f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:43.930054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d508330f-d6a9-41d0-b90a-6f9f7839098f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.512958 May 23 13:59:43.930886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1317/2709] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:43 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:43.947761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-192ee8d5-ebc9-4a56-afe2-06b86f21a77d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:43.948370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-192ee8d5-ebc9-4a56-afe2-06b86f21a77d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:43.956142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-192ee8d5-ebc9-4a56-afe2-06b86f21a77d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:43.956706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-192ee8d5-ebc9-4a56-afe2-06b86f21a77d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:43.957937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-192ee8d5-ebc9-4a56-afe2-06b86f21a77d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:43.958080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-192ee8d5-ebc9-4a56-afe2-06b86f21a77d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:44.026799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-192ee8d5-ebc9-4a56-afe2-06b86f21a77d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:44.037872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-192ee8d5-ebc9-4a56-afe2-06b86f21a77d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.093859 May 23 13:59:44.038446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1393/2710] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:43 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:44.112165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90d773a0-3836-432b-8e98-268768c06df5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:44.112832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90d773a0-3836-432b-8e98-268768c06df5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:44.119175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90d773a0-3836-432b-8e98-268768c06df5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:44.119622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90d773a0-3836-432b-8e98-268768c06df5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:44.120396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90d773a0-3836-432b-8e98-268768c06df5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:44.120872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90d773a0-3836-432b-8e98-268768c06df5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:44.263331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90d773a0-3836-432b-8e98-268768c06df5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:44.272626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90d773a0-3836-432b-8e98-268768c06df5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165090 May 23 13:59:44.273247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1318/2711] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:44 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:44.424332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-db57d790-613a-4052-8b7c-3acaa4632445 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:44.424991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-db57d790-613a-4052-8b7c-3acaa4632445 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:44.431010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db57d790-613a-4052-8b7c-3acaa4632445 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:44.431456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db57d790-613a-4052-8b7c-3acaa4632445 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:44.432215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db57d790-613a-4052-8b7c-3acaa4632445 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:44.432675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db57d790-613a-4052-8b7c-3acaa4632445 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:44.436961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:44.483657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:44.484459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:44.491019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:44.491460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:44.492236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:44.492698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:44.557545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:44.566546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:44.568087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:44.569272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-abfdcb50-42ee-40a4-a154-c616d111a4d6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089886 May 23 13:59:44.569830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1319/2712] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:44 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 13:59:44.573895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-db57d790-613a-4052-8b7c-3acaa4632445 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:44.582657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-db57d790-613a-4052-8b7c-3acaa4632445 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162282 May 23 13:59:44.583300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1394/2713] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:44 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:44.947443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-565df3cb-117b-482d-beb1-fe71e90e2c13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:44.956912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-565df3cb-117b-482d-beb1-fe71e90e2c13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:44.956912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-565df3cb-117b-482d-beb1-fe71e90e2c13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:44.956912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-565df3cb-117b-482d-beb1-fe71e90e2c13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:44.956912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-565df3cb-117b-482d-beb1-fe71e90e2c13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:44.957335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-565df3cb-117b-482d-beb1-fe71e90e2c13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:45.059769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-780d15d2-af68-45cb-bf57-9df69e909546 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:45.060376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-780d15d2-af68-45cb-bf57-9df69e909546 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:45.067491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-780d15d2-af68-45cb-bf57-9df69e909546 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:45.067942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-780d15d2-af68-45cb-bf57-9df69e909546 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:45.068733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-780d15d2-af68-45cb-bf57-9df69e909546 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:45.069172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-780d15d2-af68-45cb-bf57-9df69e909546 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:45.105728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-565df3cb-117b-482d-beb1-fe71e90e2c13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:45.114444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-565df3cb-117b-482d-beb1-fe71e90e2c13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.170835 May 23 13:59:45.115008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1320/2714] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:44 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:45.133026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-780d15d2-af68-45cb-bf57-9df69e909546 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:45.142312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-780d15d2-af68-45cb-bf57-9df69e909546 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088480 May 23 13:59:45.142911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1395/2715] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:45 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:45.290265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-484b437e-3dd5-43e3-87dc-93e2e7f1a9b2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:45.290796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-484b437e-3dd5-43e3-87dc-93e2e7f1a9b2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:45.297587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484b437e-3dd5-43e3-87dc-93e2e7f1a9b2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:45.298034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484b437e-3dd5-43e3-87dc-93e2e7f1a9b2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:45.298785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484b437e-3dd5-43e3-87dc-93e2e7f1a9b2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:45.299223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-484b437e-3dd5-43e3-87dc-93e2e7f1a9b2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:45.436078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-484b437e-3dd5-43e3-87dc-93e2e7f1a9b2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:45.444877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-484b437e-3dd5-43e3-87dc-93e2e7f1a9b2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158577 May 23 13:59:45.445453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1321/2716] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:45 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:45.587375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:45.587911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:45.595214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:45.595673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:45.596452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:45.596922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:45.600087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-501073fb-3c67-4c16-bd64-7a8ecf0a42cf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:45.600753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-501073fb-3c67-4c16-bd64-7a8ecf0a42cf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:45.606693 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-501073fb-3c67-4c16-bd64-7a8ecf0a42cf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:45.607236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-501073fb-3c67-4c16-bd64-7a8ecf0a42cf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:45.608782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-501073fb-3c67-4c16-bd64-7a8ecf0a42cf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:45.609347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-501073fb-3c67-4c16-bd64-7a8ecf0a42cf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:45.665630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:45.675665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:45.677195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:45.678345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f18eff62-2933-4b7a-a3a1-227223acd3fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094968 May 23 13:59:45.678896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1396/2717] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:45.752220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-501073fb-3c67-4c16-bd64-7a8ecf0a42cf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:45.760431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-501073fb-3c67-4c16-bd64-7a8ecf0a42cf tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164289 May 23 13:59:45.761048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1322/2718] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:45 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:46.132767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d767db6-250c-422e-9dce-b6c1744a492a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:46.133389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d767db6-250c-422e-9dce-b6c1744a492a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:46.140524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d767db6-250c-422e-9dce-b6c1744a492a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.141014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d767db6-250c-422e-9dce-b6c1744a492a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.141780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d767db6-250c-422e-9dce-b6c1744a492a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.142226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d767db6-250c-422e-9dce-b6c1744a492a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.159793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97ffbee7-3fa4-4c16-8c69-af3bb5dda943 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:46.160336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97ffbee7-3fa4-4c16-8c69-af3bb5dda943 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:46.166769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97ffbee7-3fa4-4c16-8c69-af3bb5dda943 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.167219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97ffbee7-3fa4-4c16-8c69-af3bb5dda943 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.167982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97ffbee7-3fa4-4c16-8c69-af3bb5dda943 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.168414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97ffbee7-3fa4-4c16-8c69-af3bb5dda943 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.233538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97ffbee7-3fa4-4c16-8c69-af3bb5dda943 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:46.241721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97ffbee7-3fa4-4c16-8c69-af3bb5dda943 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086390 May 23 13:59:46.242414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1323/2719] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:46 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:46.279615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d767db6-250c-422e-9dce-b6c1744a492a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:46.287922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d767db6-250c-422e-9dce-b6c1744a492a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159032 May 23 13:59:46.288491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1397/2720] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:46 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:46.462461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5ccec410-f6da-4ddf-af60-5db88bfe3a72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:46.462984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5ccec410-f6da-4ddf-af60-5db88bfe3a72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:46.469209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ccec410-f6da-4ddf-af60-5db88bfe3a72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.469676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ccec410-f6da-4ddf-af60-5db88bfe3a72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.470417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ccec410-f6da-4ddf-af60-5db88bfe3a72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.470849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ccec410-f6da-4ddf-af60-5db88bfe3a72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.598132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5ccec410-f6da-4ddf-af60-5db88bfe3a72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:46.606140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5ccec410-f6da-4ddf-af60-5db88bfe3a72 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.147648 May 23 13:59:46.606706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1324/2721] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:46 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:46.696759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:46.697408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:46.703989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.704452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.705257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.705700 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.768255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:46.777386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:46.779421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2a7387c-6581-4be8-a0a6-603c2172b1a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:46.779421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2a7387c-6581-4be8-a0a6-603c2172b1a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:46.779645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:46.780584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4c706918-2531-4630-8dea-eed900ba62d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.087605 May 23 13:59:46.781516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1398/2722] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:46.785479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2a7387c-6581-4be8-a0a6-603c2172b1a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.785932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2a7387c-6581-4be8-a0a6-603c2172b1a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.786740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2a7387c-6581-4be8-a0a6-603c2172b1a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:46.787179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2a7387c-6581-4be8-a0a6-603c2172b1a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:46.919172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2a7387c-6581-4be8-a0a6-603c2172b1a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:46.927678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2a7387c-6581-4be8-a0a6-603c2172b1a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153996 May 23 13:59:46.928246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1325/2723] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:46 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:47.260197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d11faaa1-c6db-4db3-ae88-76d6655aa815 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:47.260838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d11faaa1-c6db-4db3-ae88-76d6655aa815 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:47.267353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d11faaa1-c6db-4db3-ae88-76d6655aa815 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.267804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d11faaa1-c6db-4db3-ae88-76d6655aa815 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:47.268588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d11faaa1-c6db-4db3-ae88-76d6655aa815 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.269096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d11faaa1-c6db-4db3-ae88-76d6655aa815 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:47.305936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c22f0b89-5b32-45c9-a8b1-7716b2e959f3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:47.306617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c22f0b89-5b32-45c9-a8b1-7716b2e959f3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:47.314144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c22f0b89-5b32-45c9-a8b1-7716b2e959f3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.314601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c22f0b89-5b32-45c9-a8b1-7716b2e959f3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:47.315382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c22f0b89-5b32-45c9-a8b1-7716b2e959f3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.315821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c22f0b89-5b32-45c9-a8b1-7716b2e959f3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:47.331769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d11faaa1-c6db-4db3-ae88-76d6655aa815 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:47.339912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d11faaa1-c6db-4db3-ae88-76d6655aa815 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083557 May 23 13:59:47.340489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1399/2724] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:47 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:47.451399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c22f0b89-5b32-45c9-a8b1-7716b2e959f3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:47.459823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c22f0b89-5b32-45c9-a8b1-7716b2e959f3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157744 May 23 13:59:47.460386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1326/2725] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:47 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:47.623530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a2ee278a-5be3-46d4-9128-a1c98a1c5bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:47.624407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a2ee278a-5be3-46d4-9128-a1c98a1c5bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:47.630638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2ee278a-5be3-46d4-9128-a1c98a1c5bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.631095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2ee278a-5be3-46d4-9128-a1c98a1c5bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:47.631857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2ee278a-5be3-46d4-9128-a1c98a1c5bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.632297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2ee278a-5be3-46d4-9128-a1c98a1c5bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:47.770158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a2ee278a-5be3-46d4-9128-a1c98a1c5bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:47.778083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a2ee278a-5be3-46d4-9128-a1c98a1c5bb3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158484 May 23 13:59:47.778644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1400/2726] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:47 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:47.798250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:47.798861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:47.805220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.805683 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:47.806487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.806923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:47.870224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:47.879698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:47.881241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:47.882377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d65b4674-4273-4f0f-bd52-b8cbc75f5720 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088225 May 23 13:59:47.882934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1327/2727] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:47 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:47.945617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-087748c4-9b0e-483c-b2ca-5bec5abb2e5d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:47.946235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-087748c4-9b0e-483c-b2ca-5bec5abb2e5d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:47.952803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-087748c4-9b0e-483c-b2ca-5bec5abb2e5d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.953252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-087748c4-9b0e-483c-b2ca-5bec5abb2e5d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:47.954008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-087748c4-9b0e-483c-b2ca-5bec5abb2e5d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:47.954446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-087748c4-9b0e-483c-b2ca-5bec5abb2e5d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:48.095606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-087748c4-9b0e-483c-b2ca-5bec5abb2e5d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:48.103561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-087748c4-9b0e-483c-b2ca-5bec5abb2e5d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161817 May 23 13:59:48.104150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1401/2728] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:47 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:48.357268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-51f9b00b-a2fa-45a2-9462-4b0dc4c78265 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:48.358402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-51f9b00b-a2fa-45a2-9462-4b0dc4c78265 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:48.365129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51f9b00b-a2fa-45a2-9462-4b0dc4c78265 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:48.365570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51f9b00b-a2fa-45a2-9462-4b0dc4c78265 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:48.366371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51f9b00b-a2fa-45a2-9462-4b0dc4c78265 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:48.366810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51f9b00b-a2fa-45a2-9462-4b0dc4c78265 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:48.432019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-51f9b00b-a2fa-45a2-9462-4b0dc4c78265 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:48.440828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-51f9b00b-a2fa-45a2-9462-4b0dc4c78265 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087397 May 23 13:59:48.441400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1328/2729] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:48.477689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-faa488f3-83ee-43c6-a56d-851a28c1d695 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:48.478310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-faa488f3-83ee-43c6-a56d-851a28c1d695 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:48.485442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faa488f3-83ee-43c6-a56d-851a28c1d695 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:48.485897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faa488f3-83ee-43c6-a56d-851a28c1d695 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:48.486666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faa488f3-83ee-43c6-a56d-851a28c1d695 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:48.487109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-faa488f3-83ee-43c6-a56d-851a28c1d695 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:48.795216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ab742635-e554-4e57-947d-e5f23d245381 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:48.796661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ab742635-e554-4e57-947d-e5f23d245381 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:48.802750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab742635-e554-4e57-947d-e5f23d245381 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:48.803202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab742635-e554-4e57-947d-e5f23d245381 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:48.803963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab742635-e554-4e57-947d-e5f23d245381 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:48.804397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab742635-e554-4e57-947d-e5f23d245381 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:48.866519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-faa488f3-83ee-43c6-a56d-851a28c1d695 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:48.875077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-faa488f3-83ee-43c6-a56d-851a28c1d695 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.401146 May 23 13:59:48.875885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1402/2730] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:48 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:48.901086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:48.901817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:48.903700 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:48.909256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:48.909793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:48.910644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:48.911158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:48.939293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ab742635-e554-4e57-947d-e5f23d245381 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:48.948046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ab742635-e554-4e57-947d-e5f23d245381 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156168 May 23 13:59:48.948844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1329/2731] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:48 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:48.974980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:48.983896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:48.985436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:48.986590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-de4361fa-54a6-4fab-90e2-cd75cda28011 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089351 May 23 13:59:48.987183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1403/2732] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:49.120462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f11c03f9-166a-4230-9367-0571e4c7d378 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:49.121099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f11c03f9-166a-4230-9367-0571e4c7d378 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:49.127841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11c03f9-166a-4230-9367-0571e4c7d378 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:49.128770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11c03f9-166a-4230-9367-0571e4c7d378 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:49.129562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11c03f9-166a-4230-9367-0571e4c7d378 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:49.129985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11c03f9-166a-4230-9367-0571e4c7d378 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:49.273241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f11c03f9-166a-4230-9367-0571e4c7d378 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:49.281861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f11c03f9-166a-4230-9367-0571e4c7d378 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.165205 May 23 13:59:49.282445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1330/2733] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:49 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:49.458436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77ac7049-7d84-4067-beb4-a5356520e341 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:49.458988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-77ac7049-7d84-4067-beb4-a5356520e341 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:49.465030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77ac7049-7d84-4067-beb4-a5356520e341 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:49.465480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77ac7049-7d84-4067-beb4-a5356520e341 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:49.466239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77ac7049-7d84-4067-beb4-a5356520e341 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:49.466786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77ac7049-7d84-4067-beb4-a5356520e341 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:49.529541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77ac7049-7d84-4067-beb4-a5356520e341 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:49.538174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77ac7049-7d84-4067-beb4-a5356520e341 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083702 May 23 13:59:49.538738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1404/2734] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:49 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:49.893792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64cc6ded-4001-4090-9ed2-79019d5d3ccc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:49.894397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64cc6ded-4001-4090-9ed2-79019d5d3ccc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:49.901099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64cc6ded-4001-4090-9ed2-79019d5d3ccc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:49.901550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64cc6ded-4001-4090-9ed2-79019d5d3ccc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:49.902311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64cc6ded-4001-4090-9ed2-79019d5d3ccc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:49.902752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64cc6ded-4001-4090-9ed2-79019d5d3ccc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:49.968180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-794fd6bd-40be-4901-a2b3-25b4caad3fbe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:49.969327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-794fd6bd-40be-4901-a2b3-25b4caad3fbe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:49.977984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-794fd6bd-40be-4901-a2b3-25b4caad3fbe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:49.978434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-794fd6bd-40be-4901-a2b3-25b4caad3fbe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:49.979269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-794fd6bd-40be-4901-a2b3-25b4caad3fbe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:49.979683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-794fd6bd-40be-4901-a2b3-25b4caad3fbe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:50.059572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64cc6ded-4001-4090-9ed2-79019d5d3ccc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:50.068594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64cc6ded-4001-4090-9ed2-79019d5d3ccc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.181090 May 23 13:59:50.074707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1331/2735] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:49 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:50.074707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:50.074707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:50.081043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:50.081497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:50.082260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:50.082688 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:50.087774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:50.118269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-794fd6bd-40be-4901-a2b3-25b4caad3fbe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:50.127363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-794fd6bd-40be-4901-a2b3-25b4caad3fbe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165214 May 23 13:59:50.127952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1405/2736] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:49 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:50.147180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:50.155856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:50.157393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:50.158523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5218f284-f86d-46d9-80c6-3bb14868685f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088458 May 23 13:59:50.159075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1332/2737] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:50 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:50.299597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9b54112-2899-4a39-a97c-4f85f473027a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:50.300224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9b54112-2899-4a39-a97c-4f85f473027a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:50.306287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9b54112-2899-4a39-a97c-4f85f473027a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:50.306745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9b54112-2899-4a39-a97c-4f85f473027a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:50.307512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9b54112-2899-4a39-a97c-4f85f473027a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:50.307953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9b54112-2899-4a39-a97c-4f85f473027a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:50.437589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9b54112-2899-4a39-a97c-4f85f473027a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:50.446105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9b54112-2899-4a39-a97c-4f85f473027a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.150597 May 23 13:59:50.446667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1406/2738] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:50 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:50.555128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f98b385c-c4f8-478b-8d3c-8dab689b1f7e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:50.555752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f98b385c-c4f8-478b-8d3c-8dab689b1f7e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:50.562750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f98b385c-c4f8-478b-8d3c-8dab689b1f7e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:50.563193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f98b385c-c4f8-478b-8d3c-8dab689b1f7e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:50.563940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f98b385c-c4f8-478b-8d3c-8dab689b1f7e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:50.564369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f98b385c-c4f8-478b-8d3c-8dab689b1f7e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:50.626201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f98b385c-c4f8-478b-8d3c-8dab689b1f7e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:50.634114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f98b385c-c4f8-478b-8d3c-8dab689b1f7e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.082835 May 23 13:59:50.634680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1333/2739] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:51.087420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-71168deb-c2e7-482d-bd4c-cbd99f21499e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:51.088160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-71168deb-c2e7-482d-bd4c-cbd99f21499e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:51.094994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71168deb-c2e7-482d-bd4c-cbd99f21499e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.095445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71168deb-c2e7-482d-bd4c-cbd99f21499e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.096208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71168deb-c2e7-482d-bd4c-cbd99f21499e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.096698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71168deb-c2e7-482d-bd4c-cbd99f21499e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.145014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6a47d488-f467-4bf2-b540-5f32c77cb4bd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:51.145692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6a47d488-f467-4bf2-b540-5f32c77cb4bd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:51.152396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a47d488-f467-4bf2-b540-5f32c77cb4bd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.152885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a47d488-f467-4bf2-b540-5f32c77cb4bd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.153646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a47d488-f467-4bf2-b540-5f32c77cb4bd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.154128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a47d488-f467-4bf2-b540-5f32c77cb4bd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.230905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-71168deb-c2e7-482d-bd4c-cbd99f21499e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:51.240272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-71168deb-c2e7-482d-bd4c-cbd99f21499e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156487 May 23 13:59:51.246520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1407/2740] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:51 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:51.246520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:51.246520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:51.256980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.257544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.258378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.258820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.304843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6a47d488-f467-4bf2-b540-5f32c77cb4bd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:51.314196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6a47d488-f467-4bf2-b540-5f32c77cb4bd tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.173082 May 23 13:59:51.314779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1334/2741] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:51 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:51.328800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:51.337582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:51.339140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:51.340301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9095f688-3c7c-44af-a252-3f6bd0e4b664 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098451 May 23 13:59:51.340913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1408/2742] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:51 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:51.464273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23d448b1-c5ac-4c17-9b73-bff6a94bcc5c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:51.464907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-23d448b1-c5ac-4c17-9b73-bff6a94bcc5c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:51.471570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23d448b1-c5ac-4c17-9b73-bff6a94bcc5c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.472015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23d448b1-c5ac-4c17-9b73-bff6a94bcc5c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.472794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23d448b1-c5ac-4c17-9b73-bff6a94bcc5c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.473232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23d448b1-c5ac-4c17-9b73-bff6a94bcc5c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.604855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-23d448b1-c5ac-4c17-9b73-bff6a94bcc5c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:51.612970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23d448b1-c5ac-4c17-9b73-bff6a94bcc5c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152692 May 23 13:59:51.613553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1335/2743] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:51 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:51.651087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-58f80374-9980-4450-875d-6185fca21089 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:51.651736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-58f80374-9980-4450-875d-6185fca21089 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:51.658562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58f80374-9980-4450-875d-6185fca21089 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.659015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58f80374-9980-4450-875d-6185fca21089 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.659783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58f80374-9980-4450-875d-6185fca21089 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:51.660225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-58f80374-9980-4450-875d-6185fca21089 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:51.723814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-58f80374-9980-4450-875d-6185fca21089 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:51.731869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-58f80374-9980-4450-875d-6185fca21089 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084659 May 23 13:59:51.732434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1409/2744] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:51 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:52.258966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf1969cd-22f5-4219-8dc8-3a33f0d4428c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:52.259606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf1969cd-22f5-4219-8dc8-3a33f0d4428c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:52.266367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf1969cd-22f5-4219-8dc8-3a33f0d4428c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.266850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf1969cd-22f5-4219-8dc8-3a33f0d4428c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.267615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf1969cd-22f5-4219-8dc8-3a33f0d4428c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.268054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf1969cd-22f5-4219-8dc8-3a33f0d4428c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.331511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-afd1bc8c-1732-48cf-b936-7eea5775f87f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:52.332948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-afd1bc8c-1732-48cf-b936-7eea5775f87f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:52.338939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afd1bc8c-1732-48cf-b936-7eea5775f87f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.339383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afd1bc8c-1732-48cf-b936-7eea5775f87f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.340351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afd1bc8c-1732-48cf-b936-7eea5775f87f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.342475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afd1bc8c-1732-48cf-b936-7eea5775f87f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.408517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bf1969cd-22f5-4219-8dc8-3a33f0d4428c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:52.416541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf1969cd-22f5-4219-8dc8-3a33f0d4428c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161450 May 23 13:59:52.417143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1336/2745] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:52 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:52.422383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:52.422999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:52.429130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.429585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.430351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.430786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.473897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-afd1bc8c-1732-48cf-b936-7eea5775f87f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:52.477302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:52.482149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-afd1bc8c-1732-48cf-b936-7eea5775f87f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.154481 May 23 13:59:52.483573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1410/2746] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:52 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:52.496228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:52.503125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:52.504757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:52.505915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-11f3d9c9-ea54-4afd-9f5c-f58f21a072ce tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.087705 May 23 13:59:52.506478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1337/2747] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:52 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:52.632011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3402fdb7-3297-40a7-907b-478d1818396a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:52.632925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3402fdb7-3297-40a7-907b-478d1818396a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:52.640201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3402fdb7-3297-40a7-907b-478d1818396a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.640676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3402fdb7-3297-40a7-907b-478d1818396a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.641455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3402fdb7-3297-40a7-907b-478d1818396a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.641894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3402fdb7-3297-40a7-907b-478d1818396a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.749588 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b80f963-93cc-486d-9aa6-f04f187cccdd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:52.750219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b80f963-93cc-486d-9aa6-f04f187cccdd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:52.756335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b80f963-93cc-486d-9aa6-f04f187cccdd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.756820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b80f963-93cc-486d-9aa6-f04f187cccdd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.757591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b80f963-93cc-486d-9aa6-f04f187cccdd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:52.758034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b80f963-93cc-486d-9aa6-f04f187cccdd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:52.776364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3402fdb7-3297-40a7-907b-478d1818396a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:52.785170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3402fdb7-3297-40a7-907b-478d1818396a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158796 May 23 13:59:52.785745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1411/2748] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:52 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:52.822617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b80f963-93cc-486d-9aa6-f04f187cccdd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:52.831652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b80f963-93cc-486d-9aa6-f04f187cccdd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086538 May 23 13:59:52.832224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1338/2749] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:52 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:53.434649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-47c2155b-8e81-4cad-9cd1-d534cbb1ad79 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:53.435207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-47c2155b-8e81-4cad-9cd1-d534cbb1ad79 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:53.442593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47c2155b-8e81-4cad-9cd1-d534cbb1ad79 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.443042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47c2155b-8e81-4cad-9cd1-d534cbb1ad79 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.443802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47c2155b-8e81-4cad-9cd1-d534cbb1ad79 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.444235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47c2155b-8e81-4cad-9cd1-d534cbb1ad79 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.499822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f10a8a33-6e88-41e0-a85b-50564fb3b807 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:53.500558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f10a8a33-6e88-41e0-a85b-50564fb3b807 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:53.507167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f10a8a33-6e88-41e0-a85b-50564fb3b807 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.507614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f10a8a33-6e88-41e0-a85b-50564fb3b807 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.508380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f10a8a33-6e88-41e0-a85b-50564fb3b807 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.508902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f10a8a33-6e88-41e0-a85b-50564fb3b807 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.577644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-47c2155b-8e81-4cad-9cd1-d534cbb1ad79 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:53.585660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-47c2155b-8e81-4cad-9cd1-d534cbb1ad79 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.154931 May 23 13:59:53.586259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1412/2750] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:53 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:53.590772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:53.591381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:53.597532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.597985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.598752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.599193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.643378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f10a8a33-6e88-41e0-a85b-50564fb3b807 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:53.655198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f10a8a33-6e88-41e0-a85b-50564fb3b807 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159690 May 23 13:59:53.656214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1339/2751] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:53 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:53.662752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:53.675319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:53.677852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:53.679569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f4c91b84-73e8-43d2-a982-1549745ea7e6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092195 May 23 13:59:53.680419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1413/2752] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:53 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:53.802273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fa2535e4-6651-4c41-a2f6-66d790235d0f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:53.802878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fa2535e4-6651-4c41-a2f6-66d790235d0f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:53.808937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa2535e4-6651-4c41-a2f6-66d790235d0f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.809401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa2535e4-6651-4c41-a2f6-66d790235d0f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.810146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa2535e4-6651-4c41-a2f6-66d790235d0f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.810633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa2535e4-6651-4c41-a2f6-66d790235d0f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.848511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-25d82413-5f66-4e40-984d-63cb2fe6cb6a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:53.849163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-25d82413-5f66-4e40-984d-63cb2fe6cb6a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:53.855310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25d82413-5f66-4e40-984d-63cb2fe6cb6a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.855755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25d82413-5f66-4e40-984d-63cb2fe6cb6a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.856514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25d82413-5f66-4e40-984d-63cb2fe6cb6a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:53.856991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25d82413-5f66-4e40-984d-63cb2fe6cb6a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:53.926303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-25d82413-5f66-4e40-984d-63cb2fe6cb6a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:53.934365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-25d82413-5f66-4e40-984d-63cb2fe6cb6a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089744 May 23 13:59:53.935317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1414/2753] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:53 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:53.951022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fa2535e4-6651-4c41-a2f6-66d790235d0f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:53.960310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fa2535e4-6651-4c41-a2f6-66d790235d0f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161973 May 23 13:59:53.960863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1340/2754] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:53 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:54.603225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-761d2baa-4800-4764-aadb-69433cfebf05 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:54.603850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-761d2baa-4800-4764-aadb-69433cfebf05 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:54.610912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-761d2baa-4800-4764-aadb-69433cfebf05 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.611366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-761d2baa-4800-4764-aadb-69433cfebf05 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:54.612135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-761d2baa-4800-4764-aadb-69433cfebf05 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.612584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-761d2baa-4800-4764-aadb-69433cfebf05 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:54.673202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4f48c5c7-e1ee-45d8-bb9c-7b48945230e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:54.679582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4f48c5c7-e1ee-45d8-bb9c-7b48945230e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:54.680800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f48c5c7-e1ee-45d8-bb9c-7b48945230e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.681262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f48c5c7-e1ee-45d8-bb9c-7b48945230e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:54.682085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f48c5c7-e1ee-45d8-bb9c-7b48945230e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.682504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f48c5c7-e1ee-45d8-bb9c-7b48945230e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:54.745442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-761d2baa-4800-4764-aadb-69433cfebf05 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:54.755712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-761d2baa-4800-4764-aadb-69433cfebf05 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156040 May 23 13:59:54.756032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1415/2755] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:54 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:54.760687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:54.761301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:54.768199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.768682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:54.769458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.769899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:54.823536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4f48c5c7-e1ee-45d8-bb9c-7b48945230e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:54.832478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4f48c5c7-e1ee-45d8-bb9c-7b48945230e4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.163145 May 23 13:59:54.833105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1341/2756] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:54 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:54.834438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:54.843246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:54.844795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:54.845955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-16a0aa9f-a846-4c41-94f7-897ff0a1b847 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089006 May 23 13:59:54.846513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1416/2757] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:54 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:54.951381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1ade9333-b509-4635-bd88-87813a5c25e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:54.951998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1ade9333-b509-4635-bd88-87813a5c25e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:54.958075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ade9333-b509-4635-bd88-87813a5c25e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.958518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ade9333-b509-4635-bd88-87813a5c25e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:54.959280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ade9333-b509-4635-bd88-87813a5c25e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.959770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ade9333-b509-4635-bd88-87813a5c25e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:54.978241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-86bcdf7a-2d41-489f-b23b-3836904dad74 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:54.978869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-86bcdf7a-2d41-489f-b23b-3836904dad74 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:54.986341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bcdf7a-2d41-489f-b23b-3836904dad74 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.990489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bcdf7a-2d41-489f-b23b-3836904dad74 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:54.990489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bcdf7a-2d41-489f-b23b-3836904dad74 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:54.990489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86bcdf7a-2d41-489f-b23b-3836904dad74 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:55.029732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ade9333-b509-4635-bd88-87813a5c25e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:55.038297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1ade9333-b509-4635-bd88-87813a5c25e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090691 May 23 13:59:55.038877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1342/2758] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:54 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:55.124453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-86bcdf7a-2d41-489f-b23b-3836904dad74 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:55.132528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-86bcdf7a-2d41-489f-b23b-3836904dad74 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158215 May 23 13:59:55.133123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1417/2759] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:54 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:55.773642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d9c4620-8618-4213-bfec-075f3421e096 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:55.774186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d9c4620-8618-4213-bfec-075f3421e096 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:55.780981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9c4620-8618-4213-bfec-075f3421e096 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:55.781438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9c4620-8618-4213-bfec-075f3421e096 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:55.782193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9c4620-8618-4213-bfec-075f3421e096 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:55.782627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d9c4620-8618-4213-bfec-075f3421e096 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:55.849597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2d784fd2-4366-4ec8-9a65-d93f168093c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:55.850301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2d784fd2-4366-4ec8-9a65-d93f168093c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:55.857819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d784fd2-4366-4ec8-9a65-d93f168093c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:55.858553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d784fd2-4366-4ec8-9a65-d93f168093c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:55.859117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d784fd2-4366-4ec8-9a65-d93f168093c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:55.859561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d784fd2-4366-4ec8-9a65-d93f168093c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:55.922469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d9c4620-8618-4213-bfec-075f3421e096 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:55.930816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d9c4620-8618-4213-bfec-075f3421e096 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161143 May 23 13:59:55.931401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1343/2760] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:55 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:55.937476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:55.938093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:55.944208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:55.944891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:55.945447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:55.945903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:55.998893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d784fd2-4366-4ec8-9a65-d93f168093c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:56.007311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2d784fd2-4366-4ec8-9a65-d93f168093c4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161587 May 23 13:59:56.007884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1418/2761] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:55 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:56.011560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:56.020147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:56.021690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:56.022833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-35da600e-240f-45ee-b765-7bad6b3780bd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090479 May 23 13:59:56.023389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1344/2762] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:55 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:56.056332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fa53a10a-f722-4abb-8929-2dfcd4a4bdd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:56.056980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fa53a10a-f722-4abb-8929-2dfcd4a4bdd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:56.064244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa53a10a-f722-4abb-8929-2dfcd4a4bdd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:56.064746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa53a10a-f722-4abb-8929-2dfcd4a4bdd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:56.065526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa53a10a-f722-4abb-8929-2dfcd4a4bdd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:56.065968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa53a10a-f722-4abb-8929-2dfcd4a4bdd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:56.128246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fa53a10a-f722-4abb-8929-2dfcd4a4bdd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:56.136199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fa53a10a-f722-4abb-8929-2dfcd4a4bdd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083779 May 23 13:59:56.136811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1419/2763] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:56 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:56.150399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3da2455-fbba-40c8-b333-52c1b9ada268 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:56.151040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3da2455-fbba-40c8-b333-52c1b9ada268 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:56.157861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3da2455-fbba-40c8-b333-52c1b9ada268 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:56.158305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3da2455-fbba-40c8-b333-52c1b9ada268 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:56.159059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3da2455-fbba-40c8-b333-52c1b9ada268 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:56.159484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3da2455-fbba-40c8-b333-52c1b9ada268 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:56.294642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3da2455-fbba-40c8-b333-52c1b9ada268 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:56.303273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3da2455-fbba-40c8-b333-52c1b9ada268 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156724 May 23 13:59:56.303834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1345/2764] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:56 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:56.949509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-30d72445-0c7a-45da-974f-e0454e14fda3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:56.950044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-30d72445-0c7a-45da-974f-e0454e14fda3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:56.957361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30d72445-0c7a-45da-974f-e0454e14fda3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:56.957822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30d72445-0c7a-45da-974f-e0454e14fda3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:56.958600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30d72445-0c7a-45da-974f-e0454e14fda3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:56.959041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30d72445-0c7a-45da-974f-e0454e14fda3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:57.024418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a514eb14-fb11-4699-b835-cf3a02df10d7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:57.025070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a514eb14-fb11-4699-b835-cf3a02df10d7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:57.031796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a514eb14-fb11-4699-b835-cf3a02df10d7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:57.032251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a514eb14-fb11-4699-b835-cf3a02df10d7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:57.033052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a514eb14-fb11-4699-b835-cf3a02df10d7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:57.033487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a514eb14-fb11-4699-b835-cf3a02df10d7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:57.101146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-30d72445-0c7a-45da-974f-e0454e14fda3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:57.109879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-30d72445-0c7a-45da-974f-e0454e14fda3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.164144 May 23 13:59:57.110471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1420/2765] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:56 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:57.115138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:57.115751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:57.121943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:57.122392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:57.123158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:57.123597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:57.164471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a514eb14-fb11-4699-b835-cf3a02df10d7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:57.173580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a514eb14-fb11-4699-b835-cf3a02df10d7 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.153008 May 23 13:59:57.174173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1346/2766] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:57 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:57.184703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a076e53a-6c84-4ce1-8528-a194ffb93b8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:57.185335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a076e53a-6c84-4ce1-8528-a194ffb93b8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:57.188505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:57.192903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a076e53a-6c84-4ce1-8528-a194ffb93b8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:57.193367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a076e53a-6c84-4ce1-8528-a194ffb93b8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:57.194141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a076e53a-6c84-4ce1-8528-a194ffb93b8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:57.194749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a076e53a-6c84-4ce1-8528-a194ffb93b8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:57.198847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:57.201984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:57.201984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7ced75ba-0b14-43fd-bb03-f76b2f03ae8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090347 May 23 13:59:57.203028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1421/2767] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:57 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:57.261779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a076e53a-6c84-4ce1-8528-a194ffb93b8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:57.270429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a076e53a-6c84-4ce1-8528-a194ffb93b8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094526 May 23 13:59:57.271004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1347/2768] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:57 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:57.320476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d5654d4a-9b3c-4bc5-86f2-927812c82ae0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:57.321123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d5654d4a-9b3c-4bc5-86f2-927812c82ae0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:57.327843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5654d4a-9b3c-4bc5-86f2-927812c82ae0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:57.328301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5654d4a-9b3c-4bc5-86f2-927812c82ae0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:57.329101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5654d4a-9b3c-4bc5-86f2-927812c82ae0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:57.329549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5654d4a-9b3c-4bc5-86f2-927812c82ae0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:57.463370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d5654d4a-9b3c-4bc5-86f2-927812c82ae0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:57.472226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d5654d4a-9b3c-4bc5-86f2-927812c82ae0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155685 May 23 13:59:57.472832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1422/2769] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:57 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:58.127964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fbbe6441-700a-4140-89d5-8dc75760271e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:58.128608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fbbe6441-700a-4140-89d5-8dc75760271e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:58.135143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbbe6441-700a-4140-89d5-8dc75760271e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.135587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbbe6441-700a-4140-89d5-8dc75760271e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.136333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbbe6441-700a-4140-89d5-8dc75760271e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.136799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fbbe6441-700a-4140-89d5-8dc75760271e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.191710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fc268c2-3b10-43f3-90a9-f51a78317226 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:58.192432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fc268c2-3b10-43f3-90a9-f51a78317226 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:58.199220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fc268c2-3b10-43f3-90a9-f51a78317226 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.199747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fc268c2-3b10-43f3-90a9-f51a78317226 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.200603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fc268c2-3b10-43f3-90a9-f51a78317226 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.201051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fc268c2-3b10-43f3-90a9-f51a78317226 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.273976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fbbe6441-700a-4140-89d5-8dc75760271e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:58.277543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:58.283124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fbbe6441-700a-4140-89d5-8dc75760271e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159680 May 23 13:59:58.292997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1348/2770] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:58 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:58.292997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:58.292997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:58.297359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.297887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.298723 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.299237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.339278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fc268c2-3b10-43f3-90a9-f51a78317226 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:58.348603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fc268c2-3b10-43f3-90a9-f51a78317226 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160644 May 23 13:59:58.349417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1423/2771] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:58 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:58.353625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12cea27b-2f79-440f-9387-920b5c333309 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:58.354241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12cea27b-2f79-440f-9387-920b5c333309 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:58.360784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12cea27b-2f79-440f-9387-920b5c333309 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.361245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12cea27b-2f79-440f-9387-920b5c333309 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.362220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12cea27b-2f79-440f-9387-920b5c333309 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.362662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12cea27b-2f79-440f-9387-920b5c333309 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.364693 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:58.374616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:58.376238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:58.377503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c8038afd-a307-451e-b4d4-dd927a8a0e43 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092524 May 23 13:59:58.378172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1349/2772] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:58.427118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12cea27b-2f79-440f-9387-920b5c333309 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:58.435117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12cea27b-2f79-440f-9387-920b5c333309 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084989 May 23 13:59:58.435676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1424/2773] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:58 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:58.490004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-707ab543-24f8-445d-9f12-4b8e71e2764d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:58.490620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-707ab543-24f8-445d-9f12-4b8e71e2764d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:58.496804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-707ab543-24f8-445d-9f12-4b8e71e2764d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.497258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-707ab543-24f8-445d-9f12-4b8e71e2764d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.498015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-707ab543-24f8-445d-9f12-4b8e71e2764d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:58.498451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-707ab543-24f8-445d-9f12-4b8e71e2764d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:58.628433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-707ab543-24f8-445d-9f12-4b8e71e2764d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:58.636387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-707ab543-24f8-445d-9f12-4b8e71e2764d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.150228 May 23 13:59:58.636983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1350/2774] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:58 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:59.301062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50b21d77-1ba1-472c-8afc-fbdcfbe487d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:59.301697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50b21d77-1ba1-472c-8afc-fbdcfbe487d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:59.308802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50b21d77-1ba1-472c-8afc-fbdcfbe487d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.309191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50b21d77-1ba1-472c-8afc-fbdcfbe487d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.309946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50b21d77-1ba1-472c-8afc-fbdcfbe487d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.310380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50b21d77-1ba1-472c-8afc-fbdcfbe487d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.364849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc52b9cc-f4d6-4bc5-8fe2-d8ba538ce44f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:59.365591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dc52b9cc-f4d6-4bc5-8fe2-d8ba538ce44f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:59.372422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc52b9cc-f4d6-4bc5-8fe2-d8ba538ce44f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.372992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc52b9cc-f4d6-4bc5-8fe2-d8ba538ce44f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.373920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc52b9cc-f4d6-4bc5-8fe2-d8ba538ce44f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.374893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dc52b9cc-f4d6-4bc5-8fe2-d8ba538ce44f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.444586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-50b21d77-1ba1-472c-8afc-fbdcfbe487d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:59.454297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50b21d77-1ba1-472c-8afc-fbdcfbe487d8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157079 May 23 13:59:59.454881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1425/2775] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:59 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:59.459388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:59.459999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:59.466450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.466905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.468966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.469423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.510314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dc52b9cc-f4d6-4bc5-8fe2-d8ba538ce44f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:59.519861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc52b9cc-f4d6-4bc5-8fe2-d8ba538ce44f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158878 May 23 13:59:59.520454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1351/2776] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:59 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 13:59:59.525319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b23f9551-3118-441f-abee-d2443980ff44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:59.526169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b23f9551-3118-441f-abee-d2443980ff44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:59.533259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b23f9551-3118-441f-abee-d2443980ff44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.533712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b23f9551-3118-441f-abee-d2443980ff44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.534431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:59.534584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b23f9551-3118-441f-abee-d2443980ff44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.534889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b23f9551-3118-441f-abee-d2443980ff44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.543378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:59.544957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:59.546773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-04f210b2-571e-47f1-9f50-54c911419280 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090945 May 23 13:59:59.547331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1426/2777] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 13:59:59 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 13:59:59.598272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b23f9551-3118-441f-abee-d2443980ff44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:59.606303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b23f9551-3118-441f-abee-d2443980ff44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084876 May 23 13:59:59.606871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1352/2778] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:59 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 13:59:59.654104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d60b2d1-cf9e-4fd2-bd40-39e7068d8f68 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 13:59:59.655451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d60b2d1-cf9e-4fd2-bd40-39e7068d8f68 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 13:59:59.661886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d60b2d1-cf9e-4fd2-bd40-39e7068d8f68 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.662340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d60b2d1-cf9e-4fd2-bd40-39e7068d8f68 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.663108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d60b2d1-cf9e-4fd2-bd40-39e7068d8f68 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 13:59:59.663547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d60b2d1-cf9e-4fd2-bd40-39e7068d8f68 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 13:59:59.681617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:59:59.798624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d60b2d1-cf9e-4fd2-bd40-39e7068d8f68 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 13:59:59.806670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d60b2d1-cf9e-4fd2-bd40-39e7068d8f68 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156540 May 23 13:59:59.807236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1427/2779] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 13:59:59 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:00.471994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c86c1a3-5a59-4975-9393-3e3fa613ac70 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:00.472549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7c86c1a3-5a59-4975-9393-3e3fa613ac70 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:00.478823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c86c1a3-5a59-4975-9393-3e3fa613ac70 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.479276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c86c1a3-5a59-4975-9393-3e3fa613ac70 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.480037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c86c1a3-5a59-4975-9393-3e3fa613ac70 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.480478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c86c1a3-5a59-4975-9393-3e3fa613ac70 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.536606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3abf10a3-7476-4b4a-9513-228ede985f43 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:00.537521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3abf10a3-7476-4b4a-9513-228ede985f43 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:00.544267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3abf10a3-7476-4b4a-9513-228ede985f43 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.544836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3abf10a3-7476-4b4a-9513-228ede985f43 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.546316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3abf10a3-7476-4b4a-9513-228ede985f43 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.546829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3abf10a3-7476-4b4a-9513-228ede985f43 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.613662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c86c1a3-5a59-4975-9393-3e3fa613ac70 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:00.621902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c86c1a3-5a59-4975-9393-3e3fa613ac70 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.154344 May 23 14:00:00.622483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1353/2780] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:00 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:00.628118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:00.628744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:00.635446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.635900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.636697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.637135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.685366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3abf10a3-7476-4b4a-9513-228ede985f43 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:00.694355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3abf10a3-7476-4b4a-9513-228ede985f43 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161584 May 23 14:00:00.695295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1428/2781] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:00 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:00.699457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8eb2f582-a521-4723-9e8e-d5d7e18050c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:00.700083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8eb2f582-a521-4723-9e8e-d5d7e18050c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:00.706207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8eb2f582-a521-4723-9e8e-d5d7e18050c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.706666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8eb2f582-a521-4723-9e8e-d5d7e18050c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.707170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:00.707441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8eb2f582-a521-4723-9e8e-d5d7e18050c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.707884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8eb2f582-a521-4723-9e8e-d5d7e18050c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.715995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:00.718108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:00.719426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e344fed-bcc5-4eef-86ff-02bb636e75fb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.095970 May 23 14:00:00.719997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1354/2782] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:00.773179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8eb2f582-a521-4723-9e8e-d5d7e18050c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:00.782284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8eb2f582-a521-4723-9e8e-d5d7e18050c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086317 May 23 14:00:00.782845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1429/2783] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:00 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:00.824742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ab8a5ed1-8ccb-4c8c-9277-e4e67c769bf8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:00.825381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ab8a5ed1-8ccb-4c8c-9277-e4e67c769bf8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:00.832275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab8a5ed1-8ccb-4c8c-9277-e4e67c769bf8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.832765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab8a5ed1-8ccb-4c8c-9277-e4e67c769bf8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.833529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab8a5ed1-8ccb-4c8c-9277-e4e67c769bf8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:00.833967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab8a5ed1-8ccb-4c8c-9277-e4e67c769bf8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:00.961584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ab8a5ed1-8ccb-4c8c-9277-e4e67c769bf8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:00.970287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ab8a5ed1-8ccb-4c8c-9277-e4e67c769bf8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.149435 May 23 14:00:00.970867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1355/2784] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:00 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:01.641137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b545e2f-4ba4-4ccc-aafc-bb8e6cf23a10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:01.641764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b545e2f-4ba4-4ccc-aafc-bb8e6cf23a10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:01.648331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b545e2f-4ba4-4ccc-aafc-bb8e6cf23a10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.648819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b545e2f-4ba4-4ccc-aafc-bb8e6cf23a10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:01.649591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b545e2f-4ba4-4ccc-aafc-bb8e6cf23a10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.650036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b545e2f-4ba4-4ccc-aafc-bb8e6cf23a10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:01.713259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4cc1ec04-2cbf-4066-bb43-2ae0a894e912 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:01.713877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4cc1ec04-2cbf-4066-bb43-2ae0a894e912 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:01.720467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cc1ec04-2cbf-4066-bb43-2ae0a894e912 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.720953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cc1ec04-2cbf-4066-bb43-2ae0a894e912 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:01.721728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cc1ec04-2cbf-4066-bb43-2ae0a894e912 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.722167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cc1ec04-2cbf-4066-bb43-2ae0a894e912 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:01.781977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b545e2f-4ba4-4ccc-aafc-bb8e6cf23a10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:01.789875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b545e2f-4ba4-4ccc-aafc-bb8e6cf23a10 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.153089 May 23 14:00:01.790444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1430/2785] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:01 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:01.794923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:01.796207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:01.803343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.803880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:01.804668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.805531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:01.859495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4cc1ec04-2cbf-4066-bb43-2ae0a894e912 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:01.867645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4cc1ec04-2cbf-4066-bb43-2ae0a894e912 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158341 May 23 14:00:01.868218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1356/2786] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:01 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:01.870710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:01.872829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9abfce1-a813-47a3-afdf-3944213b90b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:01.873472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9abfce1-a813-47a3-afdf-3944213b90b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:01.879907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:01.880583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9abfce1-a813-47a3-afdf-3944213b90b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.881033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9abfce1-a813-47a3-afdf-3944213b90b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:01.881457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:01.881787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9abfce1-a813-47a3-afdf-3944213b90b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.882218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9abfce1-a813-47a3-afdf-3944213b90b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:01.882580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39e0099e-9038-4a09-8338-6a7a0ee4b9fc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091233 May 23 14:00:01.883136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1431/2787] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:01 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:01.949225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9abfce1-a813-47a3-afdf-3944213b90b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:01.957308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9abfce1-a813-47a3-afdf-3944213b90b4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088082 May 23 14:00:01.957887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1357/2788] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:01 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:01.988371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4c9fb58d-9d95-4ca2-9eae-4072accbc7d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:01.989006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4c9fb58d-9d95-4ca2-9eae-4072accbc7d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:01.995050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c9fb58d-9d95-4ca2-9eae-4072accbc7d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.995493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c9fb58d-9d95-4ca2-9eae-4072accbc7d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:01.996242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c9fb58d-9d95-4ca2-9eae-4072accbc7d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:01.996704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c9fb58d-9d95-4ca2-9eae-4072accbc7d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:02.128165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4c9fb58d-9d95-4ca2-9eae-4072accbc7d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:02.136186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4c9fb58d-9d95-4ca2-9eae-4072accbc7d1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152482 May 23 14:00:02.136789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1432/2789] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:01 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:02.808298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34d973ac-4690-41db-9a87-c2e524a04de7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:02.808960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-34d973ac-4690-41db-9a87-c2e524a04de7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:02.816748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34d973ac-4690-41db-9a87-c2e524a04de7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:02.817202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34d973ac-4690-41db-9a87-c2e524a04de7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:02.817971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34d973ac-4690-41db-9a87-c2e524a04de7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:02.818415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34d973ac-4690-41db-9a87-c2e524a04de7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:02.885277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d6133f9-50b9-4996-b21f-d681641bc68d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:02.885959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d6133f9-50b9-4996-b21f-d681641bc68d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:02.894205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d6133f9-50b9-4996-b21f-d681641bc68d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:02.895182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d6133f9-50b9-4996-b21f-d681641bc68d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:02.896360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d6133f9-50b9-4996-b21f-d681641bc68d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:02.896901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d6133f9-50b9-4996-b21f-d681641bc68d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:02.963540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34d973ac-4690-41db-9a87-c2e524a04de7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:02.972787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34d973ac-4690-41db-9a87-c2e524a04de7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.168243 May 23 14:00:02.973372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1358/2790] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:02 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:02.977971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:02.978588 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:02.985773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:02.986228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:02.986999 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:02.987436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:03.033415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d6133f9-50b9-4996-b21f-d681641bc68d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:03.041668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d6133f9-50b9-4996-b21f-d681641bc68d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160316 May 23 14:00:03.042230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1433/2791] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:02 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:03.046987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b04cc406-548d-446b-ab51-4e5d74602a07 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:03.047749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b04cc406-548d-446b-ab51-4e5d74602a07 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:03.053402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:03.055035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b04cc406-548d-446b-ab51-4e5d74602a07 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:03.055499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b04cc406-548d-446b-ab51-4e5d74602a07 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:03.056278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b04cc406-548d-446b-ab51-4e5d74602a07 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:03.056741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b04cc406-548d-446b-ab51-4e5d74602a07 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:03.070935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:03.072645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:03.079739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95041732-9ce5-4878-8132-1f4b202063de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.105351 May 23 14:00:03.080337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1359/2792] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:02 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:03.126661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b04cc406-548d-446b-ab51-4e5d74602a07 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:03.134662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b04cc406-548d-446b-ab51-4e5d74602a07 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091414 May 23 14:00:03.135228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1434/2793] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:03 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:03.154118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3954d4ca-2065-4737-8e85-8da2b4506169 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:03.154781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3954d4ca-2065-4737-8e85-8da2b4506169 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:03.160874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3954d4ca-2065-4737-8e85-8da2b4506169 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:03.161324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3954d4ca-2065-4737-8e85-8da2b4506169 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:03.162081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3954d4ca-2065-4737-8e85-8da2b4506169 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:03.162515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3954d4ca-2065-4737-8e85-8da2b4506169 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:03.302651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3954d4ca-2065-4737-8e85-8da2b4506169 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:03.313078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3954d4ca-2065-4737-8e85-8da2b4506169 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162601 May 23 14:00:03.313731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1360/2794] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:03 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:03.990192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c4b5a9d0-c577-4f57-92bb-dfcf71d36f3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:03.990809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c4b5a9d0-c577-4f57-92bb-dfcf71d36f3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:03.997501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4b5a9d0-c577-4f57-92bb-dfcf71d36f3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:03.997955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4b5a9d0-c577-4f57-92bb-dfcf71d36f3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:03.998975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4b5a9d0-c577-4f57-92bb-dfcf71d36f3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:03.999161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4b5a9d0-c577-4f57-92bb-dfcf71d36f3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:04.063613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0765d0a9-d14d-4250-93f6-67f492505fc4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:04.064322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0765d0a9-d14d-4250-93f6-67f492505fc4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:04.070982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0765d0a9-d14d-4250-93f6-67f492505fc4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:04.071432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0765d0a9-d14d-4250-93f6-67f492505fc4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:04.072196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0765d0a9-d14d-4250-93f6-67f492505fc4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:04.072658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0765d0a9-d14d-4250-93f6-67f492505fc4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:04.132755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4b5a9d0-c577-4f57-92bb-dfcf71d36f3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:04.141276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c4b5a9d0-c577-4f57-92bb-dfcf71d36f3a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.154946 May 23 14:00:04.141947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1435/2795] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:03 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:04.146569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:04.147257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:04.153545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:04.153994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:04.155396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:04.155829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:04.209823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0765d0a9-d14d-4250-93f6-67f492505fc4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:04.218032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0765d0a9-d14d-4250-93f6-67f492505fc4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158464 May 23 14:00:04.218480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1361/2796] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:04 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:04.219841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:04.223038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6886e556-fa1e-4578-965d-45ca7815a393 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:04.223617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6886e556-fa1e-4578-965d-45ca7815a393 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:04.228587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:04.229630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6886e556-fa1e-4578-965d-45ca7815a393 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:04.230134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:04.230265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6886e556-fa1e-4578-965d-45ca7815a393 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:04.230925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6886e556-fa1e-4578-965d-45ca7815a393 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:04.231274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d53af00-51f3-4742-bc2b-5f812a8c2f6e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088338 May 23 14:00:04.231399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6886e556-fa1e-4578-965d-45ca7815a393 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:04.231821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1436/2797] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:04 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:04.294724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6886e556-fa1e-4578-965d-45ca7815a393 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:04.302659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6886e556-fa1e-4578-965d-45ca7815a393 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083205 May 23 14:00:04.303227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1362/2798] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:04 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:04.330752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2c8c8ab-dcbc-4da7-9e99-84c5dd5a418f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:04.331370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2c8c8ab-dcbc-4da7-9e99-84c5dd5a418f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:04.337424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2c8c8ab-dcbc-4da7-9e99-84c5dd5a418f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:04.337875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2c8c8ab-dcbc-4da7-9e99-84c5dd5a418f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:04.338635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2c8c8ab-dcbc-4da7-9e99-84c5dd5a418f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:04.339073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2c8c8ab-dcbc-4da7-9e99-84c5dd5a418f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:04.474178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2c8c8ab-dcbc-4da7-9e99-84c5dd5a418f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:04.482028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2c8c8ab-dcbc-4da7-9e99-84c5dd5a418f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155695 May 23 14:00:04.482599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1437/2799] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:04 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:05.160941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-17b78b0b-2089-4930-a1c9-716e46367283 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:05.161557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-17b78b0b-2089-4930-a1c9-716e46367283 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:05.168154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17b78b0b-2089-4930-a1c9-716e46367283 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.168630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17b78b0b-2089-4930-a1c9-716e46367283 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.169391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17b78b0b-2089-4930-a1c9-716e46367283 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.169835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17b78b0b-2089-4930-a1c9-716e46367283 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.236533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2a573b0-d8fc-4694-93e9-55070de67c9f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:05.237218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c2a573b0-d8fc-4694-93e9-55070de67c9f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:05.243855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2a573b0-d8fc-4694-93e9-55070de67c9f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.244632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2a573b0-d8fc-4694-93e9-55070de67c9f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.245419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2a573b0-d8fc-4694-93e9-55070de67c9f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.245856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2a573b0-d8fc-4694-93e9-55070de67c9f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.306715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-17b78b0b-2089-4930-a1c9-716e46367283 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:05.318174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-17b78b0b-2089-4930-a1c9-716e46367283 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160826 May 23 14:00:05.318775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1363/2800] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:05 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:05.324228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:05.324878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:05.331651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.332105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.332915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.333358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.393209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c2a573b0-d8fc-4694-93e9-55070de67c9f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:05.402293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2a573b0-d8fc-4694-93e9-55070de67c9f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.170248 May 23 14:00:05.402949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1438/2801] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:05 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:05.408762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-766fc47d-b46c-400d-863c-538b5a8c32ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:05.409405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-766fc47d-b46c-400d-863c-538b5a8c32ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:05.409774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:05.416451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-766fc47d-b46c-400d-863c-538b5a8c32ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.416857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-766fc47d-b46c-400d-863c-538b5a8c32ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.417699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-766fc47d-b46c-400d-863c-538b5a8c32ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.418149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-766fc47d-b46c-400d-863c-538b5a8c32ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.419481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:05.421762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:05.423080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-27d26f85-979d-46f7-97ac-fc1de636c0f6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.102971 May 23 14:00:05.424606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1364/2802] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:05 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:05.486788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-766fc47d-b46c-400d-863c-538b5a8c32ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:05.495671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-766fc47d-b46c-400d-863c-538b5a8c32ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091573 May 23 14:00:05.496422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1439/2803] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:05 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:05.500464 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-70f5f9ad-afd6-405f-99c0-b36a204b2717 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:05.501254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-70f5f9ad-afd6-405f-99c0-b36a204b2717 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:05.507750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70f5f9ad-afd6-405f-99c0-b36a204b2717 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.508238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70f5f9ad-afd6-405f-99c0-b36a204b2717 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.509040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70f5f9ad-afd6-405f-99c0-b36a204b2717 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:05.509481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70f5f9ad-afd6-405f-99c0-b36a204b2717 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:05.529260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:05.649503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-70f5f9ad-afd6-405f-99c0-b36a204b2717 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:05.658038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-70f5f9ad-afd6-405f-99c0-b36a204b2717 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162756 May 23 14:00:05.658624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1365/2804] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:05 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:06.343524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb4c0ce5-ea05-4477-83f6-72e20d0a91d7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:06.344138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb4c0ce5-ea05-4477-83f6-72e20d0a91d7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:06.350752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb4c0ce5-ea05-4477-83f6-72e20d0a91d7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.351196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb4c0ce5-ea05-4477-83f6-72e20d0a91d7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.351947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb4c0ce5-ea05-4477-83f6-72e20d0a91d7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.352381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb4c0ce5-ea05-4477-83f6-72e20d0a91d7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.420797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-094e5e12-fe91-4a34-9798-27bc17318e34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:06.421397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-094e5e12-fe91-4a34-9798-27bc17318e34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:06.428618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-094e5e12-fe91-4a34-9798-27bc17318e34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.429066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-094e5e12-fe91-4a34-9798-27bc17318e34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.429825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-094e5e12-fe91-4a34-9798-27bc17318e34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.430252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-094e5e12-fe91-4a34-9798-27bc17318e34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.487816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb4c0ce5-ea05-4477-83f6-72e20d0a91d7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:06.495838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb4c0ce5-ea05-4477-83f6-72e20d0a91d7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156335 May 23 14:00:06.496417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1440/2805] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:06 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:06.500939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:06.501544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:06.507513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.507963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.509010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.509871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.563328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-094e5e12-fe91-4a34-9798-27bc17318e34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:06.574005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:06.577292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-094e5e12-fe91-4a34-9798-27bc17318e34 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159953 May 23 14:00:06.577886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1366/2806] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:06 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:06.582480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ec82dd2-cb29-416f-873d-5da000ae5ab3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:06.582826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:06.583076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ec82dd2-cb29-416f-873d-5da000ae5ab3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:06.584536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:06.584825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:06.586243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cc17a8c2-a16a-46d2-b25a-a42495fc8852 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088886 May 23 14:00:06.586878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1441/2807] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:06 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:06.590267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ec82dd2-cb29-416f-873d-5da000ae5ab3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.590852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ec82dd2-cb29-416f-873d-5da000ae5ab3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.591494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ec82dd2-cb29-416f-873d-5da000ae5ab3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.592455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ec82dd2-cb29-416f-873d-5da000ae5ab3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.657038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ec82dd2-cb29-416f-873d-5da000ae5ab3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:06.665142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ec82dd2-cb29-416f-873d-5da000ae5ab3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086261 May 23 14:00:06.665664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1367/2808] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:06 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:06.675663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-27768d83-9a76-4d63-9d96-f5c6b7dfdb34 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:06.676543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-27768d83-9a76-4d63-9d96-f5c6b7dfdb34 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:06.682374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27768d83-9a76-4d63-9d96-f5c6b7dfdb34 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.682831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27768d83-9a76-4d63-9d96-f5c6b7dfdb34 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.683604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27768d83-9a76-4d63-9d96-f5c6b7dfdb34 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:06.684097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27768d83-9a76-4d63-9d96-f5c6b7dfdb34 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:06.818598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27768d83-9a76-4d63-9d96-f5c6b7dfdb34 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:06.827302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-27768d83-9a76-4d63-9d96-f5c6b7dfdb34 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155957 May 23 14:00:06.827987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1442/2809] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:06 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:07.513748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eaedf4f5-2494-47ab-8815-329630626e89 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:07.515409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eaedf4f5-2494-47ab-8815-329630626e89 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:07.522100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaedf4f5-2494-47ab-8815-329630626e89 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.522551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaedf4f5-2494-47ab-8815-329630626e89 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.523314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaedf4f5-2494-47ab-8815-329630626e89 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.523750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaedf4f5-2494-47ab-8815-329630626e89 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.594999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-40b7ebbc-7f60-44a8-8be9-54b37b30a0a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:07.595657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40b7ebbc-7f60-44a8-8be9-54b37b30a0a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:07.602564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b7ebbc-7f60-44a8-8be9-54b37b30a0a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.603129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b7ebbc-7f60-44a8-8be9-54b37b30a0a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.603775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b7ebbc-7f60-44a8-8be9-54b37b30a0a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.604212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b7ebbc-7f60-44a8-8be9-54b37b30a0a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.660519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eaedf4f5-2494-47ab-8815-329630626e89 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:07.668903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eaedf4f5-2494-47ab-8815-329630626e89 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159105 May 23 14:00:07.669479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1368/2810] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:07 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:07.674709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:07.675455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:07.681426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.681876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.682639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.683071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.750378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-40b7ebbc-7f60-44a8-8be9-54b37b30a0a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:07.752060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:07.758455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-40b7ebbc-7f60-44a8-8be9-54b37b30a0a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.167862 May 23 14:00:07.759026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1443/2811] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:07 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:07.760368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:07.761851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:07.762987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b9cdebb5-60c3-4a09-b607-0c6b1365900b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092052 May 23 14:00:07.763697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1369/2812] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:07 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:07.763995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a51afaab-eeae-48bb-b948-0e30ff751450 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:07.764737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a51afaab-eeae-48bb-b948-0e30ff751450 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:07.770657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a51afaab-eeae-48bb-b948-0e30ff751450 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.771108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a51afaab-eeae-48bb-b948-0e30ff751450 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.771883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a51afaab-eeae-48bb-b948-0e30ff751450 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.772320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a51afaab-eeae-48bb-b948-0e30ff751450 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.776290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:07.835251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a51afaab-eeae-48bb-b948-0e30ff751450 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:07.843334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a51afaab-eeae-48bb-b948-0e30ff751450 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083327 May 23 14:00:07.843903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1444/2813] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:07 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:07.844424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e313e158-630b-4a52-88bd-a5bc1e5d09c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:07.845103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e313e158-630b-4a52-88bd-a5bc1e5d09c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:07.851154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e313e158-630b-4a52-88bd-a5bc1e5d09c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.851607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e313e158-630b-4a52-88bd-a5bc1e5d09c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.852369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e313e158-630b-4a52-88bd-a5bc1e5d09c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:07.852837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e313e158-630b-4a52-88bd-a5bc1e5d09c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:07.982066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e313e158-630b-4a52-88bd-a5bc1e5d09c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:07.990046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e313e158-630b-4a52-88bd-a5bc1e5d09c0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.149532 May 23 14:00:07.990619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1370/2814] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:07 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:08.687940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15789d22-41f2-4bd4-a3df-abff090df98c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:08.688538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15789d22-41f2-4bd4-a3df-abff090df98c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:08.695210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15789d22-41f2-4bd4-a3df-abff090df98c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:08.695662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15789d22-41f2-4bd4-a3df-abff090df98c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:08.696412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15789d22-41f2-4bd4-a3df-abff090df98c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:08.696881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15789d22-41f2-4bd4-a3df-abff090df98c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:08.775214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-837ef14c-253c-45e8-9f8f-f0af4ec022f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:08.775864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-837ef14c-253c-45e8-9f8f-f0af4ec022f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:08.783014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-837ef14c-253c-45e8-9f8f-f0af4ec022f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:08.783467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-837ef14c-253c-45e8-9f8f-f0af4ec022f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:08.784230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-837ef14c-253c-45e8-9f8f-f0af4ec022f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:08.784702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-837ef14c-253c-45e8-9f8f-f0af4ec022f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:08.831057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15789d22-41f2-4bd4-a3df-abff090df98c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:08.839276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15789d22-41f2-4bd4-a3df-abff090df98c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.155950 May 23 14:00:08.839839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1445/2815] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:08 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:08.844649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:08.845266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:08.851055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:08.851507 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:08.852283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:08.852761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:08.924182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-837ef14c-253c-45e8-9f8f-f0af4ec022f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:08.932991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-837ef14c-253c-45e8-9f8f-f0af4ec022f3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161468 May 23 14:00:08.933593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1371/2816] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:08 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:08.938638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a261dd0c-66a6-4e45-af73-c12134e8d713 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:08.939182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a261dd0c-66a6-4e45-af73-c12134e8d713 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:08.946014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a261dd0c-66a6-4e45-af73-c12134e8d713 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:08.946292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a261dd0c-66a6-4e45-af73-c12134e8d713 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:08.946962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a261dd0c-66a6-4e45-af73-c12134e8d713 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:08.947400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a261dd0c-66a6-4e45-af73-c12134e8d713 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:09.014924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a261dd0c-66a6-4e45-af73-c12134e8d713 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:09.023704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a261dd0c-66a6-4e45-af73-c12134e8d713 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089057 May 23 14:00:09.024280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1372/2817] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:08 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:09.030595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9a1ffbc5-0ed0-4049-8cb9-470a2401f736 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:09.031270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9a1ffbc5-0ed0-4049-8cb9-470a2401f736 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:09.046968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9a1ffbc5-0ed0-4049-8cb9-470a2401f736 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:09.047412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9a1ffbc5-0ed0-4049-8cb9-470a2401f736 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:09.048174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9a1ffbc5-0ed0-4049-8cb9-470a2401f736 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:09.048734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9a1ffbc5-0ed0-4049-8cb9-470a2401f736 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:09.084910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:09.095261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:09.096956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:09.098110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6c08863d-314c-43e1-9590-8940fe7b39d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.257366 May 23 14:00:09.098654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1446/2818] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:08 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:09.180665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9a1ffbc5-0ed0-4049-8cb9-470a2401f736 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:09.189648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9a1ffbc5-0ed0-4049-8cb9-470a2401f736 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164052 May 23 14:00:09.190156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1373/2819] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:09 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:09.856949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-af0cd89e-c321-408e-a7d1-6954ca30640b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:09.858071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-af0cd89e-c321-408e-a7d1-6954ca30640b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:09.864731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af0cd89e-c321-408e-a7d1-6954ca30640b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:09.865185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af0cd89e-c321-408e-a7d1-6954ca30640b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:09.865943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af0cd89e-c321-408e-a7d1-6954ca30640b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:09.866381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af0cd89e-c321-408e-a7d1-6954ca30640b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:09.950225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca452dde-8d6f-4aed-b5ef-d41acf8a08ed tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:09.950838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ca452dde-8d6f-4aed-b5ef-d41acf8a08ed tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:09.958399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca452dde-8d6f-4aed-b5ef-d41acf8a08ed tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:09.958686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca452dde-8d6f-4aed-b5ef-d41acf8a08ed tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:09.959473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca452dde-8d6f-4aed-b5ef-d41acf8a08ed tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:09.959895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca452dde-8d6f-4aed-b5ef-d41acf8a08ed tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:09.999047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-af0cd89e-c321-408e-a7d1-6954ca30640b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:10.007135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-af0cd89e-c321-408e-a7d1-6954ca30640b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.153931 May 23 14:00:10.007698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1447/2820] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:09 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:10.043817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a6d1ac3-a7e3-4648-90b7-b144218cddd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:10.043949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3a6d1ac3-a7e3-4648-90b7-b144218cddd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:10.049962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a6d1ac3-a7e3-4648-90b7-b144218cddd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:10.050420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a6d1ac3-a7e3-4648-90b7-b144218cddd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:10.051186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a6d1ac3-a7e3-4648-90b7-b144218cddd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:10.051631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a6d1ac3-a7e3-4648-90b7-b144218cddd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:10.097474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ca452dde-8d6f-4aed-b5ef-d41acf8a08ed tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:10.105517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ca452dde-8d6f-4aed-b5ef-d41acf8a08ed tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159375 May 23 14:00:10.106097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1374/2821] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:09 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:10.115808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:10.116460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:10.118119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a6d1ac3-a7e3-4648-90b7-b144218cddd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:10.122686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:10.123850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:10.124720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:10.125167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:10.126434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a6d1ac3-a7e3-4648-90b7-b144218cddd4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087010 May 23 14:00:10.127006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1448/2822] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:10 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:10.189442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:10.197891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:10.199391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:10.200646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-089f1618-5e46-4e3e-9fee-ee918d652630 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089251 May 23 14:00:10.201766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1375/2823] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:10 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:10.207680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-844e73b2-5d12-44d6-abc2-0371fb394be5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:10.208305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-844e73b2-5d12-44d6-abc2-0371fb394be5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:10.214353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-844e73b2-5d12-44d6-abc2-0371fb394be5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:10.214804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-844e73b2-5d12-44d6-abc2-0371fb394be5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:10.215567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-844e73b2-5d12-44d6-abc2-0371fb394be5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:10.216008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-844e73b2-5d12-44d6-abc2-0371fb394be5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:10.344862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-844e73b2-5d12-44d6-abc2-0371fb394be5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:10.352762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-844e73b2-5d12-44d6-abc2-0371fb394be5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.148984 May 23 14:00:10.353322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1449/2824] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:10 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:11.025643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ba31396-7c23-4afb-8ce7-03076e06f27b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:11.026408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ba31396-7c23-4afb-8ce7-03076e06f27b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:11.033385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ba31396-7c23-4afb-8ce7-03076e06f27b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.033830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ba31396-7c23-4afb-8ce7-03076e06f27b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.034583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ba31396-7c23-4afb-8ce7-03076e06f27b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.035011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ba31396-7c23-4afb-8ce7-03076e06f27b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.123766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-11794e7b-4832-4208-b3c3-a1bfabe9256e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:11.124464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-11794e7b-4832-4208-b3c3-a1bfabe9256e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:11.131933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11794e7b-4832-4208-b3c3-a1bfabe9256e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.132388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11794e7b-4832-4208-b3c3-a1bfabe9256e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.133311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11794e7b-4832-4208-b3c3-a1bfabe9256e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.133751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11794e7b-4832-4208-b3c3-a1bfabe9256e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.174250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ba31396-7c23-4afb-8ce7-03076e06f27b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:11.182440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ba31396-7c23-4afb-8ce7-03076e06f27b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160597 May 23 14:00:11.184147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1376/2825] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:11 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:11.193158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5988eaaa-27b1-4f33-a525-913af3c470db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:11.193833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5988eaaa-27b1-4f33-a525-913af3c470db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:11.200783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5988eaaa-27b1-4f33-a525-913af3c470db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.201356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5988eaaa-27b1-4f33-a525-913af3c470db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.202133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5988eaaa-27b1-4f33-a525-913af3c470db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.202578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5988eaaa-27b1-4f33-a525-913af3c470db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.269375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5988eaaa-27b1-4f33-a525-913af3c470db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:11.270092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-11794e7b-4832-4208-b3c3-a1bfabe9256e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:11.277600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5988eaaa-27b1-4f33-a525-913af3c470db tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.093054 May 23 14:00:11.278099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1377/2826] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:11 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:11.278210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-11794e7b-4832-4208-b3c3-a1bfabe9256e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158392 May 23 14:00:11.278824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1450/2827] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:11 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:11.283234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:11.283834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:11.289665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.290111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.290866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.291318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.356643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:11.367258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:11.368960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:11.370048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d94f4e4-4c73-4457-a627-ef8ff6144fbb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091027 May 23 14:00:11.371827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1378/2828] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:11.371992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85fc33b3-0a2d-4f82-b82b-e1ddb8d73ce0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:11.371992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85fc33b3-0a2d-4f82-b82b-e1ddb8d73ce0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:11.378452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85fc33b3-0a2d-4f82-b82b-e1ddb8d73ce0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.378898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85fc33b3-0a2d-4f82-b82b-e1ddb8d73ce0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.379664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85fc33b3-0a2d-4f82-b82b-e1ddb8d73ce0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:11.380093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85fc33b3-0a2d-4f82-b82b-e1ddb8d73ce0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:11.513234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-85fc33b3-0a2d-4f82-b82b-e1ddb8d73ce0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:11.521231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85fc33b3-0a2d-4f82-b82b-e1ddb8d73ce0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154422 May 23 14:00:11.521807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1451/2829] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:11 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:12.201379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-61272d9d-3708-4e65-9f3e-9bc302f6cf31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:12.202441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-61272d9d-3708-4e65-9f3e-9bc302f6cf31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:12.208962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61272d9d-3708-4e65-9f3e-9bc302f6cf31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.209414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61272d9d-3708-4e65-9f3e-9bc302f6cf31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.210172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61272d9d-3708-4e65-9f3e-9bc302f6cf31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.210605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61272d9d-3708-4e65-9f3e-9bc302f6cf31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.295478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b98e76f8-9879-495d-bbdb-c03dfda931ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:12.296096 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b98e76f8-9879-495d-bbdb-c03dfda931ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:12.302787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98e76f8-9879-495d-bbdb-c03dfda931ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.303137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98e76f8-9879-495d-bbdb-c03dfda931ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.303900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98e76f8-9879-495d-bbdb-c03dfda931ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.304336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b98e76f8-9879-495d-bbdb-c03dfda931ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.345793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-61272d9d-3708-4e65-9f3e-9bc302f6cf31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:12.354373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-61272d9d-3708-4e65-9f3e-9bc302f6cf31 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157421 May 23 14:00:12.354954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1379/2830] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:12 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:12.360236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f67627f4-dae3-4897-8df4-d9b7836de80d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:12.360859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f67627f4-dae3-4897-8df4-d9b7836de80d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:12.366951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f67627f4-dae3-4897-8df4-d9b7836de80d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.367395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f67627f4-dae3-4897-8df4-d9b7836de80d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.368152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f67627f4-dae3-4897-8df4-d9b7836de80d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.368614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f67627f4-dae3-4897-8df4-d9b7836de80d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.376199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b98e76f8-9879-495d-bbdb-c03dfda931ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:12.384061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b98e76f8-9879-495d-bbdb-c03dfda931ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.093084 May 23 14:00:12.384831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1452/2831] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:12 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:12.390348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:12.391288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:12.393392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:12.398215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.398669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.399444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.399882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.468703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:12.477224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:12.478732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:12.479876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-61b9f6aa-b3c5-411a-a56b-e8fc0de2437c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.093805 May 23 14:00:12.480427 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1453/2832] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:12.504851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f67627f4-dae3-4897-8df4-d9b7836de80d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:12.512994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f67627f4-dae3-4897-8df4-d9b7836de80d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.157046 May 23 14:00:12.513613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1380/2833] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:12 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:12.538218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ffed90c6-7d72-4020-a1b1-22a8ce99c062 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:12.538859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ffed90c6-7d72-4020-a1b1-22a8ce99c062 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:12.545396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffed90c6-7d72-4020-a1b1-22a8ce99c062 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.545935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffed90c6-7d72-4020-a1b1-22a8ce99c062 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.546687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffed90c6-7d72-4020-a1b1-22a8ce99c062 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:12.547118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffed90c6-7d72-4020-a1b1-22a8ce99c062 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:12.678496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ffed90c6-7d72-4020-a1b1-22a8ce99c062 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:12.686710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ffed90c6-7d72-4020-a1b1-22a8ce99c062 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152282 May 23 14:00:12.687262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1454/2834] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:12 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:13.373425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8ed60815-c295-469e-96af-fd6230e2f9dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:13.374358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8ed60815-c295-469e-96af-fd6230e2f9dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:13.380757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ed60815-c295-469e-96af-fd6230e2f9dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.381227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ed60815-c295-469e-96af-fd6230e2f9dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.381958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ed60815-c295-469e-96af-fd6230e2f9dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.382678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ed60815-c295-469e-96af-fd6230e2f9dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.401808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bcb37082-6eaf-4650-ab34-b322dc7a5f69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:13.402423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bcb37082-6eaf-4650-ab34-b322dc7a5f69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:13.409563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcb37082-6eaf-4650-ab34-b322dc7a5f69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.410018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcb37082-6eaf-4650-ab34-b322dc7a5f69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.410789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcb37082-6eaf-4650-ab34-b322dc7a5f69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.411226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcb37082-6eaf-4650-ab34-b322dc7a5f69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.473030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcb37082-6eaf-4650-ab34-b322dc7a5f69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:13.480885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bcb37082-6eaf-4650-ab34-b322dc7a5f69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.082867 May 23 14:00:13.481456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1455/2835] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:13 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:13.499735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:13.500456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:13.506497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.506945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.507714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.508151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.515864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8ed60815-c295-469e-96af-fd6230e2f9dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:13.524206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8ed60815-c295-469e-96af-fd6230e2f9dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.155225 May 23 14:00:13.525011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1381/2836] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:13 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:13.530502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6fa5d889-5a3b-4370-ba4a-2baf7f2bf75f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:13.531511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6fa5d889-5a3b-4370-ba4a-2baf7f2bf75f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:13.537076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fa5d889-5a3b-4370-ba4a-2baf7f2bf75f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.537523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fa5d889-5a3b-4370-ba4a-2baf7f2bf75f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.538280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fa5d889-5a3b-4370-ba4a-2baf7f2bf75f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.538706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6fa5d889-5a3b-4370-ba4a-2baf7f2bf75f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.542803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:13.572144 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:13.581962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:13.583480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:13.584707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1d6a8cf-6f7c-4b5c-baa0-7eba6a4bdb20 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089525 May 23 14:00:13.585274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1456/2837] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:13 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:13.668616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6fa5d889-5a3b-4370-ba4a-2baf7f2bf75f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:13.678131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6fa5d889-5a3b-4370-ba4a-2baf7f2bf75f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.151455 May 23 14:00:13.678704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1382/2838] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:13 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:13.703146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56b88a6b-02d4-4164-b03a-ed6b6e7362c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:13.703759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56b88a6b-02d4-4164-b03a-ed6b6e7362c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:13.709918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56b88a6b-02d4-4164-b03a-ed6b6e7362c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.710375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56b88a6b-02d4-4164-b03a-ed6b6e7362c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.711140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56b88a6b-02d4-4164-b03a-ed6b6e7362c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:13.711583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56b88a6b-02d4-4164-b03a-ed6b6e7362c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:13.858349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56b88a6b-02d4-4164-b03a-ed6b6e7362c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:13.858349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56b88a6b-02d4-4164-b03a-ed6b6e7362c1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154828 May 23 14:00:13.858349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1457/2839] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:13 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:14.498852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dce6b26c-6c89-434c-8d4a-f6ed69411e05 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:14.499423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dce6b26c-6c89-434c-8d4a-f6ed69411e05 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:14.505767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dce6b26c-6c89-434c-8d4a-f6ed69411e05 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.506217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dce6b26c-6c89-434c-8d4a-f6ed69411e05 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:14.506974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dce6b26c-6c89-434c-8d4a-f6ed69411e05 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.507409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dce6b26c-6c89-434c-8d4a-f6ed69411e05 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:14.541777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4d80c7dd-d69d-40f5-a215-69b544f3878a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:14.542387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4d80c7dd-d69d-40f5-a215-69b544f3878a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:14.550282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d80c7dd-d69d-40f5-a215-69b544f3878a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.550737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d80c7dd-d69d-40f5-a215-69b544f3878a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:14.551518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d80c7dd-d69d-40f5-a215-69b544f3878a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.551957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d80c7dd-d69d-40f5-a215-69b544f3878a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:14.572916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dce6b26c-6c89-434c-8d4a-f6ed69411e05 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:14.581172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dce6b26c-6c89-434c-8d4a-f6ed69411e05 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087028 May 23 14:00:14.582130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1383/2840] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:14 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:14.602683 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:14.603284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:14.610128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.610567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:14.611327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.611756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:14.673682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:14.682022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:14.683529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:14.684692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9fe786cc-7044-4427-8428-48df9078f1ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.085941 May 23 14:00:14.686321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1384/2841] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:14 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:14.688068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4d80c7dd-d69d-40f5-a215-69b544f3878a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:14.695626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c324a19e-55e3-4bfc-8b62-6a1a883aa744 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:14.696277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c324a19e-55e3-4bfc-8b62-6a1a883aa744 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:14.697335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4d80c7dd-d69d-40f5-a215-69b544f3878a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159353 May 23 14:00:14.697919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1458/2842] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:14 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:14.703050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c324a19e-55e3-4bfc-8b62-6a1a883aa744 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.703505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c324a19e-55e3-4bfc-8b62-6a1a883aa744 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:14.704276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c324a19e-55e3-4bfc-8b62-6a1a883aa744 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.704749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c324a19e-55e3-4bfc-8b62-6a1a883aa744 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:14.838321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c324a19e-55e3-4bfc-8b62-6a1a883aa744 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:14.847322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c324a19e-55e3-4bfc-8b62-6a1a883aa744 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155878 May 23 14:00:14.847877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1385/2843] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:14 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:14.872461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bcf1446e-7c14-4d93-9be3-4439a22baa48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:14.873158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bcf1446e-7c14-4d93-9be3-4439a22baa48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:14.879021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcf1446e-7c14-4d93-9be3-4439a22baa48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.879466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcf1446e-7c14-4d93-9be3-4439a22baa48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:14.880217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcf1446e-7c14-4d93-9be3-4439a22baa48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:14.880678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcf1446e-7c14-4d93-9be3-4439a22baa48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:15.011425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcf1446e-7c14-4d93-9be3-4439a22baa48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:15.020356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bcf1446e-7c14-4d93-9be3-4439a22baa48 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.151637 May 23 14:00:15.020987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1459/2844] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:14 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:15.598339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1f923102-9135-4237-9fb3-5dde3a15167d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:15.598879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1f923102-9135-4237-9fb3-5dde3a15167d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:15.605511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f923102-9135-4237-9fb3-5dde3a15167d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:15.605964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f923102-9135-4237-9fb3-5dde3a15167d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:15.606725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f923102-9135-4237-9fb3-5dde3a15167d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:15.607310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f923102-9135-4237-9fb3-5dde3a15167d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:15.670250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1f923102-9135-4237-9fb3-5dde3a15167d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:15.678294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1f923102-9135-4237-9fb3-5dde3a15167d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083908 May 23 14:00:15.678858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1386/2845] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:15 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:15.703731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:15.704349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:15.710717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:15.711171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:15.711936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:15.712382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:15.713504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a32320dd-b10d-4e30-89d9-808027572e5c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:15.714112 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a32320dd-b10d-4e30-89d9-808027572e5c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:15.720862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a32320dd-b10d-4e30-89d9-808027572e5c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:15.721314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a32320dd-b10d-4e30-89d9-808027572e5c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:15.722073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a32320dd-b10d-4e30-89d9-808027572e5c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:15.722501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a32320dd-b10d-4e30-89d9-808027572e5c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:15.780735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:15.784294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:15.789481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:15.790979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:15.792122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6d4756ca-2f40-4f8e-97c3-45584adcb06d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092818 May 23 14:00:15.792687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1460/2846] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:15 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:15.864821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39f4ddc3-f5a3-4906-8e17-fd037abc1c69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:15.865610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39f4ddc3-f5a3-4906-8e17-fd037abc1c69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:15.873488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39f4ddc3-f5a3-4906-8e17-fd037abc1c69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:15.873944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39f4ddc3-f5a3-4906-8e17-fd037abc1c69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:15.874723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39f4ddc3-f5a3-4906-8e17-fd037abc1c69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:15.875162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39f4ddc3-f5a3-4906-8e17-fd037abc1c69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:15.883225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a32320dd-b10d-4e30-89d9-808027572e5c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:15.891339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a32320dd-b10d-4e30-89d9-808027572e5c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.181602 May 23 14:00:15.891915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1387/2847] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:15 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:16.005486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39f4ddc3-f5a3-4906-8e17-fd037abc1c69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:16.013398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39f4ddc3-f5a3-4906-8e17-fd037abc1c69 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.152966 May 23 14:00:16.014060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1461/2848] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:15 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:16.037980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23ca16ce-5084-4476-9ef2-3e7c7815fb92 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:16.038591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-23ca16ce-5084-4476-9ef2-3e7c7815fb92 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:16.045793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23ca16ce-5084-4476-9ef2-3e7c7815fb92 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:16.046237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23ca16ce-5084-4476-9ef2-3e7c7815fb92 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:16.047067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23ca16ce-5084-4476-9ef2-3e7c7815fb92 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:16.047577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23ca16ce-5084-4476-9ef2-3e7c7815fb92 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:16.188396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-23ca16ce-5084-4476-9ef2-3e7c7815fb92 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:16.196970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23ca16ce-5084-4476-9ef2-3e7c7815fb92 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162824 May 23 14:00:16.197564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1388/2849] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:16 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:16.695406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d0ba63a5-a476-4459-ace8-b703fde87afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:16.696025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d0ba63a5-a476-4459-ace8-b703fde87afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:16.702221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0ba63a5-a476-4459-ace8-b703fde87afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:16.702682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0ba63a5-a476-4459-ace8-b703fde87afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:16.703454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0ba63a5-a476-4459-ace8-b703fde87afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:16.703894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0ba63a5-a476-4459-ace8-b703fde87afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:16.770209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0ba63a5-a476-4459-ace8-b703fde87afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:16.779545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d0ba63a5-a476-4459-ace8-b703fde87afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087981 May 23 14:00:16.780281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1462/2850] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:16 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:16.818759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:16.819346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:16.825592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:16.826330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:16.827115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:16.827545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:16.895696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:16.905344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:16.906852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:16.908013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a352a074-f57f-44d4-9b1a-8e2cf0d91bb3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094100 May 23 14:00:16.908560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1389/2851] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:16.909134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-24bf3187-85e9-4bef-bdc2-a84173548d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:16.909763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-24bf3187-85e9-4bef-bdc2-a84173548d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:16.916085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24bf3187-85e9-4bef-bdc2-a84173548d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:16.916546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24bf3187-85e9-4bef-bdc2-a84173548d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:16.917343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24bf3187-85e9-4bef-bdc2-a84173548d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:16.917786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24bf3187-85e9-4bef-bdc2-a84173548d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:17.031223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c8ce38f-0568-4c65-956f-16cd4f500796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:17.031821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c8ce38f-0568-4c65-956f-16cd4f500796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:17.038321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c8ce38f-0568-4c65-956f-16cd4f500796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:17.038769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c8ce38f-0568-4c65-956f-16cd4f500796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:17.039557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c8ce38f-0568-4c65-956f-16cd4f500796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:17.039994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c8ce38f-0568-4c65-956f-16cd4f500796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:17.065601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-24bf3187-85e9-4bef-bdc2-a84173548d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:17.073830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-24bf3187-85e9-4bef-bdc2-a84173548d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.168376 May 23 14:00:17.074408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1463/2852] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:16 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:17.177405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3c8ce38f-0568-4c65-956f-16cd4f500796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:17.186726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3c8ce38f-0568-4c65-956f-16cd4f500796 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160081 May 23 14:00:17.187311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1390/2853] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:17 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:17.213818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f835ef7-045e-4a85-80ed-74f3c4898c24 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:17.214428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f835ef7-045e-4a85-80ed-74f3c4898c24 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:17.221309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f835ef7-045e-4a85-80ed-74f3c4898c24 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:17.221755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f835ef7-045e-4a85-80ed-74f3c4898c24 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:17.222511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f835ef7-045e-4a85-80ed-74f3c4898c24 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:17.222944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f835ef7-045e-4a85-80ed-74f3c4898c24 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:17.351942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4f835ef7-045e-4a85-80ed-74f3c4898c24 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:17.360258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f835ef7-045e-4a85-80ed-74f3c4898c24 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.150248 May 23 14:00:17.360856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1464/2854] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:17 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:17.797329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e7f4e68-bd32-4206-9629-7963dab66b5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:17.797964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e7f4e68-bd32-4206-9629-7963dab66b5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:17.804242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e7f4e68-bd32-4206-9629-7963dab66b5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:17.804730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e7f4e68-bd32-4206-9629-7963dab66b5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:17.805515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e7f4e68-bd32-4206-9629-7963dab66b5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:17.805958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e7f4e68-bd32-4206-9629-7963dab66b5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:17.873210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0e7f4e68-bd32-4206-9629-7963dab66b5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:17.881539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e7f4e68-bd32-4206-9629-7963dab66b5e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088613 May 23 14:00:17.882114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1391/2855] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:17 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:17.925919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:17.926533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:17.932804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:17.933263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:17.934036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:17.934477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:18.000069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:18.008665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:18.010184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:18.011337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1f20cac-ff72-4655-83f1-83dc88c81990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089457 May 23 14:00:18.011884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1465/2856] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:18.095149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1c52fa53-8362-474c-aec1-19e7d107434d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:18.095677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1c52fa53-8362-474c-aec1-19e7d107434d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:18.101876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c52fa53-8362-474c-aec1-19e7d107434d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:18.102322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c52fa53-8362-474c-aec1-19e7d107434d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:18.103079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c52fa53-8362-474c-aec1-19e7d107434d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:18.103507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c52fa53-8362-474c-aec1-19e7d107434d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:18.203884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48254d99-7663-4a92-bad1-6a2330a20bac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:18.204493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-48254d99-7663-4a92-bad1-6a2330a20bac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:18.211357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48254d99-7663-4a92-bad1-6a2330a20bac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:18.211357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48254d99-7663-4a92-bad1-6a2330a20bac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:18.212018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48254d99-7663-4a92-bad1-6a2330a20bac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:18.212447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48254d99-7663-4a92-bad1-6a2330a20bac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:18.245839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1c52fa53-8362-474c-aec1-19e7d107434d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:18.255879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1c52fa53-8362-474c-aec1-19e7d107434d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.167598 May 23 14:00:18.256481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1392/2857] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:18 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:18.357620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-48254d99-7663-4a92-bad1-6a2330a20bac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:18.366218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48254d99-7663-4a92-bad1-6a2330a20bac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166383 May 23 14:00:18.366829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1466/2858] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:18 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:18.378392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b3881f4-de95-4a24-9372-04cadb652b3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:18.379067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b3881f4-de95-4a24-9372-04cadb652b3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:18.385225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b3881f4-de95-4a24-9372-04cadb652b3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:18.385669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b3881f4-de95-4a24-9372-04cadb652b3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:18.386419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b3881f4-de95-4a24-9372-04cadb652b3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:18.386928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b3881f4-de95-4a24-9372-04cadb652b3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:18.534953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4b3881f4-de95-4a24-9372-04cadb652b3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:18.543124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b3881f4-de95-4a24-9372-04cadb652b3e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.168540 May 23 14:00:18.543695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1393/2859] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:18 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:18.899116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7ab87f55-4ab9-4b12-b7d4-6aafcdac9a56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:18.899732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7ab87f55-4ab9-4b12-b7d4-6aafcdac9a56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:18.906492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ab87f55-4ab9-4b12-b7d4-6aafcdac9a56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:18.906945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ab87f55-4ab9-4b12-b7d4-6aafcdac9a56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:18.907713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ab87f55-4ab9-4b12-b7d4-6aafcdac9a56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:18.908143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7ab87f55-4ab9-4b12-b7d4-6aafcdac9a56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:18.969838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7ab87f55-4ab9-4b12-b7d4-6aafcdac9a56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:18.978458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7ab87f55-4ab9-4b12-b7d4-6aafcdac9a56 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083155 May 23 14:00:18.979058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1467/2860] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:18 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:19.030795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:19.031406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:19.038118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:19.038570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:19.039376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:19.039821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:19.103073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:19.112103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:19.113649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:19.114789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b0036445-f4b8-41cd-a4d7-9876700cd88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088757 May 23 14:00:19.115339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1394/2861] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:19 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:19.280931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e73ba92a-d96e-4663-a68c-50a28d842180 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:19.281546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e73ba92a-d96e-4663-a68c-50a28d842180 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:19.287678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e73ba92a-d96e-4663-a68c-50a28d842180 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:19.288122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e73ba92a-d96e-4663-a68c-50a28d842180 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:19.288907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e73ba92a-d96e-4663-a68c-50a28d842180 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:19.289342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e73ba92a-d96e-4663-a68c-50a28d842180 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:19.389781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-85b0dfd3-b694-429b-a109-09af9e78b6ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:19.390441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-85b0dfd3-b694-429b-a109-09af9e78b6ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:19.396767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85b0dfd3-b694-429b-a109-09af9e78b6ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:19.397227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85b0dfd3-b694-429b-a109-09af9e78b6ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:19.398003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85b0dfd3-b694-429b-a109-09af9e78b6ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:19.398441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85b0dfd3-b694-429b-a109-09af9e78b6ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:19.430428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e73ba92a-d96e-4663-a68c-50a28d842180 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:19.440120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e73ba92a-d96e-4663-a68c-50a28d842180 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163235 May 23 14:00:19.440648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1468/2862] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:19 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:19.540118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85b0dfd3-b694-429b-a109-09af9e78b6ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:19.548436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-85b0dfd3-b694-429b-a109-09af9e78b6ca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.167652 May 23 14:00:19.549058 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1395/2863] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:19 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:19.561126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-566c8f74-2e83-49f9-8246-e5120516154f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:19.561923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-566c8f74-2e83-49f9-8246-e5120516154f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:19.568824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-566c8f74-2e83-49f9-8246-e5120516154f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:19.569284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-566c8f74-2e83-49f9-8246-e5120516154f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:19.570071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-566c8f74-2e83-49f9-8246-e5120516154f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:19.570526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-566c8f74-2e83-49f9-8246-e5120516154f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:19.709697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-566c8f74-2e83-49f9-8246-e5120516154f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:19.718733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-566c8f74-2e83-49f9-8246-e5120516154f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162452 May 23 14:00:19.719316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1469/2864] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:19 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:19.995559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e828f2ff-a866-4412-8413-23a9a4068b70 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:19.996118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e828f2ff-a866-4412-8413-23a9a4068b70 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:20.003413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e828f2ff-a866-4412-8413-23a9a4068b70 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.003864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e828f2ff-a866-4412-8413-23a9a4068b70 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.004663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e828f2ff-a866-4412-8413-23a9a4068b70 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.005112 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e828f2ff-a866-4412-8413-23a9a4068b70 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.070214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e828f2ff-a866-4412-8413-23a9a4068b70 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:20.079040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e828f2ff-a866-4412-8413-23a9a4068b70 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087480 May 23 14:00:20.079633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1396/2865] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:19 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:20.132954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:20.133587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:20.141200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.141646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.142421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.142942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.207098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:20.215815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:20.217815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:20.218770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c4c9c2a-1085-4962-8dd9-97fbf3b26c6b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089892 May 23 14:00:20.219333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1470/2866] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:20.457658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cfcd60a5-a12e-447b-b825-df3411b57677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:20.458279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cfcd60a5-a12e-447b-b825-df3411b57677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:20.464588 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfcd60a5-a12e-447b-b825-df3411b57677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.465050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfcd60a5-a12e-447b-b825-df3411b57677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.465831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfcd60a5-a12e-447b-b825-df3411b57677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.467469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfcd60a5-a12e-447b-b825-df3411b57677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.565391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc5fa697-96be-4b40-a55f-e761ac2798a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:20.566019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc5fa697-96be-4b40-a55f-e761ac2798a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:20.573942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc5fa697-96be-4b40-a55f-e761ac2798a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.574399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc5fa697-96be-4b40-a55f-e761ac2798a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.575190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc5fa697-96be-4b40-a55f-e761ac2798a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.576177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc5fa697-96be-4b40-a55f-e761ac2798a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.623869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cfcd60a5-a12e-447b-b825-df3411b57677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:20.634406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cfcd60a5-a12e-447b-b825-df3411b57677 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.180619 May 23 14:00:20.634998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1397/2867] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:20 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:20.727541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc5fa697-96be-4b40-a55f-e761ac2798a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:20.736987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cdb8d927-3820-46f6-987d-ef883cf08de2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:20.737510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc5fa697-96be-4b40-a55f-e761ac2798a8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.175762 May 23 14:00:20.737684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cdb8d927-3820-46f6-987d-ef883cf08de2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:20.738112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1471/2868] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:20 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:20.743876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdb8d927-3820-46f6-987d-ef883cf08de2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.744333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdb8d927-3820-46f6-987d-ef883cf08de2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.745127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdb8d927-3820-46f6-987d-ef883cf08de2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:20.745559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdb8d927-3820-46f6-987d-ef883cf08de2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:20.906308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cdb8d927-3820-46f6-987d-ef883cf08de2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:20.912759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:20.921890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cdb8d927-3820-46f6-987d-ef883cf08de2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.188457 May 23 14:00:20.922503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1398/2869] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:20 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:21.097269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-838b9e4e-7dc7-4546-876d-4bc8521d5389 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:21.097810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-838b9e4e-7dc7-4546-876d-4bc8521d5389 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:21.104084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-838b9e4e-7dc7-4546-876d-4bc8521d5389 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.104543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-838b9e4e-7dc7-4546-876d-4bc8521d5389 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:21.105347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-838b9e4e-7dc7-4546-876d-4bc8521d5389 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.105787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-838b9e4e-7dc7-4546-876d-4bc8521d5389 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:21.175273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-838b9e4e-7dc7-4546-876d-4bc8521d5389 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:21.183713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-838b9e4e-7dc7-4546-876d-4bc8521d5389 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090386 May 23 14:00:21.184299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1472/2870] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:21 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:21.238288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:21.239012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:21.246270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.246724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:21.247611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.248186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:21.315179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:21.324349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:21.327064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:21.328236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-be1ef7b3-4df7-4031-8884-1a596813cad7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094923 May 23 14:00:21.328859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1399/2871] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:21 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:21.652914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-54dfdb62-d68c-4142-acdb-c28491cc950d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:21.653582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-54dfdb62-d68c-4142-acdb-c28491cc950d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:21.660322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54dfdb62-d68c-4142-acdb-c28491cc950d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.660818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54dfdb62-d68c-4142-acdb-c28491cc950d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:21.661612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54dfdb62-d68c-4142-acdb-c28491cc950d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.662057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54dfdb62-d68c-4142-acdb-c28491cc950d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:21.758590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5457e18-9eb7-45aa-9a83-a9538fa0eb4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:21.759699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5457e18-9eb7-45aa-9a83-a9538fa0eb4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:21.770886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5457e18-9eb7-45aa-9a83-a9538fa0eb4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.771694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5457e18-9eb7-45aa-9a83-a9538fa0eb4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:21.773133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5457e18-9eb7-45aa-9a83-a9538fa0eb4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.773903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5457e18-9eb7-45aa-9a83-a9538fa0eb4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:21.811019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54dfdb62-d68c-4142-acdb-c28491cc950d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:21.819454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-54dfdb62-d68c-4142-acdb-c28491cc950d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.170419 May 23 14:00:21.820036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1473/2872] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:21 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:21.917107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f5457e18-9eb7-45aa-9a83-a9538fa0eb4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:21.927104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5457e18-9eb7-45aa-9a83-a9538fa0eb4e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.175088 May 23 14:00:21.927104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1400/2873] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:21 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:21.940552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20034c57-1e3b-47b3-bc4a-0e68f88c4297 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:21.941195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-20034c57-1e3b-47b3-bc4a-0e68f88c4297 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:21.947237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20034c57-1e3b-47b3-bc4a-0e68f88c4297 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.947693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20034c57-1e3b-47b3-bc4a-0e68f88c4297 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:21.948460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20034c57-1e3b-47b3-bc4a-0e68f88c4297 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:21.948928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20034c57-1e3b-47b3-bc4a-0e68f88c4297 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:22.088366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-20034c57-1e3b-47b3-bc4a-0e68f88c4297 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:22.097085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-20034c57-1e3b-47b3-bc4a-0e68f88c4297 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160217 May 23 14:00:22.097674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1474/2874] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:21 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:22.201000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e0612cb-ef2c-41c5-87f4-952fb24324ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:22.201615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e0612cb-ef2c-41c5-87f4-952fb24324ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:22.207737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0612cb-ef2c-41c5-87f4-952fb24324ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:22.208177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0612cb-ef2c-41c5-87f4-952fb24324ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:22.208970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0612cb-ef2c-41c5-87f4-952fb24324ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:22.209400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0612cb-ef2c-41c5-87f4-952fb24324ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:22.275852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e0612cb-ef2c-41c5-87f4-952fb24324ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:22.284792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e0612cb-ef2c-41c5-87f4-952fb24324ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087732 May 23 14:00:22.285379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1401/2875] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:22 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:22.347583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:22.348344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:22.355008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:22.355468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:22.356238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:22.357776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:22.422484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:22.431443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:22.432908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:22.434068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-180985cd-6f58-4c48-adb0-83a0a73489e8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090602 May 23 14:00:22.434678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1475/2876] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:22 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:22.837552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0eb97a9e-ab28-4989-b9e1-44c888dad00b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:22.838166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0eb97a9e-ab28-4989-b9e1-44c888dad00b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:22.844438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0eb97a9e-ab28-4989-b9e1-44c888dad00b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:22.844925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0eb97a9e-ab28-4989-b9e1-44c888dad00b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:22.845682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0eb97a9e-ab28-4989-b9e1-44c888dad00b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:22.846130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0eb97a9e-ab28-4989-b9e1-44c888dad00b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:22.943393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-21f9e37d-c48e-4ea9-a682-292472dfd4b8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:22.944263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-21f9e37d-c48e-4ea9-a682-292472dfd4b8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:22.951066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21f9e37d-c48e-4ea9-a682-292472dfd4b8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:22.951726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21f9e37d-c48e-4ea9-a682-292472dfd4b8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:22.952601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21f9e37d-c48e-4ea9-a682-292472dfd4b8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:22.953125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21f9e37d-c48e-4ea9-a682-292472dfd4b8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:22.979283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0eb97a9e-ab28-4989-b9e1-44c888dad00b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:22.988511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0eb97a9e-ab28-4989-b9e1-44c888dad00b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.154775 May 23 14:00:22.989139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1402/2877] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:22 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:23.091935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-21f9e37d-c48e-4ea9-a682-292472dfd4b8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:23.099858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-21f9e37d-c48e-4ea9-a682-292472dfd4b8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160415 May 23 14:00:23.100415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1476/2878] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:22 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:23.114409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b49d0e18-0256-44c9-81ff-f7fd718e46be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:23.114953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b49d0e18-0256-44c9-81ff-f7fd718e46be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:23.121044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49d0e18-0256-44c9-81ff-f7fd718e46be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:23.121494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49d0e18-0256-44c9-81ff-f7fd718e46be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:23.122957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49d0e18-0256-44c9-81ff-f7fd718e46be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:23.123408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b49d0e18-0256-44c9-81ff-f7fd718e46be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:23.257963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b49d0e18-0256-44c9-81ff-f7fd718e46be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:23.266667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b49d0e18-0256-44c9-81ff-f7fd718e46be tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156014 May 23 14:00:23.267483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1403/2879] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:23 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:23.302873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2a4ff2f-681a-4976-b47b-77afcc5b6194 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:23.303533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f2a4ff2f-681a-4976-b47b-77afcc5b6194 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:23.310670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2a4ff2f-681a-4976-b47b-77afcc5b6194 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:23.311134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2a4ff2f-681a-4976-b47b-77afcc5b6194 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:23.311941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2a4ff2f-681a-4976-b47b-77afcc5b6194 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:23.312378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2a4ff2f-681a-4976-b47b-77afcc5b6194 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:23.332649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:23.381895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f2a4ff2f-681a-4976-b47b-77afcc5b6194 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:23.390940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2a4ff2f-681a-4976-b47b-77afcc5b6194 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092021 May 23 14:00:23.391534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1477/2880] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:23 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:23.453278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:23.454015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:23.460056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:23.460500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:23.461286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:23.461716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:23.527173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:23.536523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:23.538082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:23.539239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e6df74e6-b054-4872-908e-e789a585a88e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090436 May 23 14:00:23.539814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1404/2881] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:23 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:24.006050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fc647053-05fe-4580-a0b8-73db9962bce8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:24.006577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fc647053-05fe-4580-a0b8-73db9962bce8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:24.013452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc647053-05fe-4580-a0b8-73db9962bce8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.013914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc647053-05fe-4580-a0b8-73db9962bce8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.014688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc647053-05fe-4580-a0b8-73db9962bce8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.015120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc647053-05fe-4580-a0b8-73db9962bce8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.118298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-599ce114-e811-4c99-bd5f-18fa4f1bccd3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:24.118926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-599ce114-e811-4c99-bd5f-18fa4f1bccd3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:24.134805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-599ce114-e811-4c99-bd5f-18fa4f1bccd3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.135284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-599ce114-e811-4c99-bd5f-18fa4f1bccd3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.136069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-599ce114-e811-4c99-bd5f-18fa4f1bccd3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.136504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-599ce114-e811-4c99-bd5f-18fa4f1bccd3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.151943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fc647053-05fe-4580-a0b8-73db9962bce8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:24.160251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fc647053-05fe-4580-a0b8-73db9962bce8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158192 May 23 14:00:24.160872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1478/2882] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:24 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:24.279157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-599ce114-e811-4c99-bd5f-18fa4f1bccd3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:24.286859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b7d486b-b09f-463c-b7b8-d6c1d31883d4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:24.287564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b7d486b-b09f-463c-b7b8-d6c1d31883d4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:24.287852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-599ce114-e811-4c99-bd5f-18fa4f1bccd3 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.173346 May 23 14:00:24.288446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1405/2883] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:24 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:24.294823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b7d486b-b09f-463c-b7b8-d6c1d31883d4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.295367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b7d486b-b09f-463c-b7b8-d6c1d31883d4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.296149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b7d486b-b09f-463c-b7b8-d6c1d31883d4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.296610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b7d486b-b09f-463c-b7b8-d6c1d31883d4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.412441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5fb48222-73b8-4c93-a47b-4bd12029281b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:24.413241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5fb48222-73b8-4c93-a47b-4bd12029281b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:24.419977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fb48222-73b8-4c93-a47b-4bd12029281b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.420521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fb48222-73b8-4c93-a47b-4bd12029281b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.421368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fb48222-73b8-4c93-a47b-4bd12029281b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.421802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fb48222-73b8-4c93-a47b-4bd12029281b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.437951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b7d486b-b09f-463c-b7b8-d6c1d31883d4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:24.447052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b7d486b-b09f-463c-b7b8-d6c1d31883d4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.163995 May 23 14:00:24.447908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1479/2884] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:24 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:24.493229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5fb48222-73b8-4c93-a47b-4bd12029281b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:24.501848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5fb48222-73b8-4c93-a47b-4bd12029281b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.093444 May 23 14:00:24.502585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1406/2885] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:24 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:24.557864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:24.558396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:24.565934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.566382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.567147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:24.567715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:24.642636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:24.651743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:24.653518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:24.654844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b92988b4-a639-4035-84d3-45452cfb2536 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.101166 May 23 14:00:24.655448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1480/2886] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:24 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:25.178060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-358054cf-f0cc-4679-a607-158190e79069 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:25.178708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-358054cf-f0cc-4679-a607-158190e79069 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:25.186777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-358054cf-f0cc-4679-a607-158190e79069 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.187234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-358054cf-f0cc-4679-a607-158190e79069 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.188026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-358054cf-f0cc-4679-a607-158190e79069 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.188461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-358054cf-f0cc-4679-a607-158190e79069 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.306236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-878d6add-5f60-4fd1-a4ed-4d6b2969a842 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:25.307045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-878d6add-5f60-4fd1-a4ed-4d6b2969a842 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:25.314374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878d6add-5f60-4fd1-a4ed-4d6b2969a842 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.314937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878d6add-5f60-4fd1-a4ed-4d6b2969a842 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.315789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878d6add-5f60-4fd1-a4ed-4d6b2969a842 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.316304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878d6add-5f60-4fd1-a4ed-4d6b2969a842 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.341737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-358054cf-f0cc-4679-a607-158190e79069 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:25.350454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-358054cf-f0cc-4679-a607-158190e79069 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.176239 May 23 14:00:25.351052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1407/2887] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:25 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:25.461941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-878d6add-5f60-4fd1-a4ed-4d6b2969a842 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:25.469050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ccf10405-472f-4bb8-820b-a9bec9ef1f8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:25.469050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ccf10405-472f-4bb8-820b-a9bec9ef1f8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:25.472261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-878d6add-5f60-4fd1-a4ed-4d6b2969a842 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.169996 May 23 14:00:25.472782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccf10405-472f-4bb8-820b-a9bec9ef1f8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.473022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1481/2888] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:25 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:25.473267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccf10405-472f-4bb8-820b-a9bec9ef1f8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.474046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccf10405-472f-4bb8-820b-a9bec9ef1f8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.474483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ccf10405-472f-4bb8-820b-a9bec9ef1f8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.520050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7bceb1e0-125d-4ff2-b176-4fb8ab39483c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:25.520709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7bceb1e0-125d-4ff2-b176-4fb8ab39483c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:25.527231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bceb1e0-125d-4ff2-b176-4fb8ab39483c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.527584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bceb1e0-125d-4ff2-b176-4fb8ab39483c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.529060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bceb1e0-125d-4ff2-b176-4fb8ab39483c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.529686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7bceb1e0-125d-4ff2-b176-4fb8ab39483c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.601628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7bceb1e0-125d-4ff2-b176-4fb8ab39483c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:25.611815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7bceb1e0-125d-4ff2-b176-4fb8ab39483c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.095765 May 23 14:00:25.612418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1482/2889] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:25 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:25.615795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ccf10405-472f-4bb8-820b-a9bec9ef1f8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:25.625015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ccf10405-472f-4bb8-820b-a9bec9ef1f8d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164624 May 23 14:00:25.625589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1408/2890] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:25 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:25.674841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:25.675463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:25.681650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.682094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.682854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:25.683289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:25.752915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:25.761462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:25.763558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:25.764751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-de5dc27b-2436-4a92-bdea-ff870436d26c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.093973 May 23 14:00:25.765315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1483/2891] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:26.368214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6da1dd45-422a-491f-879e-67eb0cbfc619 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:26.368891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6da1dd45-422a-491f-879e-67eb0cbfc619 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:26.375949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6da1dd45-422a-491f-879e-67eb0cbfc619 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.376542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6da1dd45-422a-491f-879e-67eb0cbfc619 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.377346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6da1dd45-422a-491f-879e-67eb0cbfc619 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.377817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6da1dd45-422a-491f-879e-67eb0cbfc619 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.490373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc3db9e8-5c75-4e7c-8855-e71b6558548f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:26.491136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc3db9e8-5c75-4e7c-8855-e71b6558548f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:26.497906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc3db9e8-5c75-4e7c-8855-e71b6558548f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.498373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc3db9e8-5c75-4e7c-8855-e71b6558548f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.499159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc3db9e8-5c75-4e7c-8855-e71b6558548f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.499608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc3db9e8-5c75-4e7c-8855-e71b6558548f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.526175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6da1dd45-422a-491f-879e-67eb0cbfc619 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:26.535305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6da1dd45-422a-491f-879e-67eb0cbfc619 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.170859 May 23 14:00:26.535898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1409/2892] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:26 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:26.628192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c2f285b-5e9a-48c8-bfe8-e5e4a3551960 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:26.628886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7c2f285b-5e9a-48c8-bfe8-e5e4a3551960 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:26.634223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc3db9e8-5c75-4e7c-8855-e71b6558548f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:26.635684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c2f285b-5e9a-48c8-bfe8-e5e4a3551960 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.636161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c2f285b-5e9a-48c8-bfe8-e5e4a3551960 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.636920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c2f285b-5e9a-48c8-bfe8-e5e4a3551960 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.638443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c2f285b-5e9a-48c8-bfe8-e5e4a3551960 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.643049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc3db9e8-5c75-4e7c-8855-e71b6558548f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156529 May 23 14:00:26.644004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1484/2893] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:26 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:26.648679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0bd06aa4-7107-4c94-b9dc-027a07c2cbe9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:26.649304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0bd06aa4-7107-4c94-b9dc-027a07c2cbe9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:26.656612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bd06aa4-7107-4c94-b9dc-027a07c2cbe9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.656889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bd06aa4-7107-4c94-b9dc-027a07c2cbe9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.657666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bd06aa4-7107-4c94-b9dc-027a07c2cbe9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.658110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bd06aa4-7107-4c94-b9dc-027a07c2cbe9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.709984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7c2f285b-5e9a-48c8-bfe8-e5e4a3551960 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:26.718969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c2f285b-5e9a-48c8-bfe8-e5e4a3551960 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094370 May 23 14:00:26.719477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1410/2894] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:26 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:26.782536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:26.783178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:26.789428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.792334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.792334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:26.792334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:26.805714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0bd06aa4-7107-4c94-b9dc-027a07c2cbe9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:26.815656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0bd06aa4-7107-4c94-b9dc-027a07c2cbe9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.170666 May 23 14:00:26.816712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1485/2895] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:26 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:26.854866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:26.864353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:26.865901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:26.867064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-470f5aef-6fa6-48be-9577-62cd27077043 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088792 May 23 14:00:26.867624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1411/2896] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:27.554977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a3a5f372-ee77-476d-a21d-d6934f3f1204 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:27.555617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a3a5f372-ee77-476d-a21d-d6934f3f1204 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:27.562586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3a5f372-ee77-476d-a21d-d6934f3f1204 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.563036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3a5f372-ee77-476d-a21d-d6934f3f1204 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.563801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3a5f372-ee77-476d-a21d-d6934f3f1204 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.564239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3a5f372-ee77-476d-a21d-d6934f3f1204 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.660852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f8b9b5e1-221d-49a6-b642-b27882cc2eac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:27.661556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f8b9b5e1-221d-49a6-b642-b27882cc2eac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:27.668460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8b9b5e1-221d-49a6-b642-b27882cc2eac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.669982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8b9b5e1-221d-49a6-b642-b27882cc2eac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.670776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8b9b5e1-221d-49a6-b642-b27882cc2eac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.671218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8b9b5e1-221d-49a6-b642-b27882cc2eac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.709546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a3a5f372-ee77-476d-a21d-d6934f3f1204 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:27.718681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a3a5f372-ee77-476d-a21d-d6934f3f1204 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.168258 May 23 14:00:27.719281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1486/2897] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:27 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:27.738649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-38749af1-63f3-4dc1-a4d8-3e4c67d0ca66 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:27.739391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-38749af1-63f3-4dc1-a4d8-3e4c67d0ca66 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:27.745646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38749af1-63f3-4dc1-a4d8-3e4c67d0ca66 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.746176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38749af1-63f3-4dc1-a4d8-3e4c67d0ca66 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.747243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38749af1-63f3-4dc1-a4d8-3e4c67d0ca66 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.747830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38749af1-63f3-4dc1-a4d8-3e4c67d0ca66 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.812718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38749af1-63f3-4dc1-a4d8-3e4c67d0ca66 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:27.819280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f8b9b5e1-221d-49a6-b642-b27882cc2eac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:27.821618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-38749af1-63f3-4dc1-a4d8-3e4c67d0ca66 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086648 May 23 14:00:27.822213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1487/2898] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:27 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:27.827149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f8b9b5e1-221d-49a6-b642-b27882cc2eac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.170117 May 23 14:00:27.827933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1412/2899] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:27 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:27.834466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e947bdb-4aab-4fca-b113-be24ece94c85 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:27.834923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e947bdb-4aab-4fca-b113-be24ece94c85 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:27.841685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e947bdb-4aab-4fca-b113-be24ece94c85 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.842137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e947bdb-4aab-4fca-b113-be24ece94c85 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.842902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e947bdb-4aab-4fca-b113-be24ece94c85 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.843339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e947bdb-4aab-4fca-b113-be24ece94c85 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.886089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:27.886694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:27.893386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.893831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.894586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:27.895016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:27.959172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:27.968552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:27.970090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:27.971236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-61444f46-b2c2-4a62-9b2f-ee4495512bcb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089078 May 23 14:00:27.971788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1413/2900] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:27.975552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e947bdb-4aab-4fca-b113-be24ece94c85 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:27.983985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e947bdb-4aab-4fca-b113-be24ece94c85 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153516 May 23 14:00:27.984555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1488/2901] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:27 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:28.736275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-562674c6-be76-4262-a8b7-b2b20944d6fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:28.736908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-562674c6-be76-4262-a8b7-b2b20944d6fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:28.743456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-562674c6-be76-4262-a8b7-b2b20944d6fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:28.743897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-562674c6-be76-4262-a8b7-b2b20944d6fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:28.744766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-562674c6-be76-4262-a8b7-b2b20944d6fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:28.745199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-562674c6-be76-4262-a8b7-b2b20944d6fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:28.842267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a30d23ac-7676-49af-9766-1a308f7b736d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:28.842907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a30d23ac-7676-49af-9766-1a308f7b736d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:28.849726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a30d23ac-7676-49af-9766-1a308f7b736d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:28.850186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a30d23ac-7676-49af-9766-1a308f7b736d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:28.851055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a30d23ac-7676-49af-9766-1a308f7b736d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:28.851503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a30d23ac-7676-49af-9766-1a308f7b736d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:28.883040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-562674c6-be76-4262-a8b7-b2b20944d6fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:28.891910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-562674c6-be76-4262-a8b7-b2b20944d6fb tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159526 May 23 14:00:28.892811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1414/2902] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:28 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:28.897471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a0d5ed57-12d2-4c2e-b919-d764ef35fb35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:28.898167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a0d5ed57-12d2-4c2e-b919-d764ef35fb35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:28.904721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0d5ed57-12d2-4c2e-b919-d764ef35fb35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:28.905170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0d5ed57-12d2-4c2e-b919-d764ef35fb35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:28.905930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0d5ed57-12d2-4c2e-b919-d764ef35fb35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:28.906362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0d5ed57-12d2-4c2e-b919-d764ef35fb35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:28.920666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a30d23ac-7676-49af-9766-1a308f7b736d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:28.926399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:28.929334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a30d23ac-7676-49af-9766-1a308f7b736d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092356 May 23 14:00:28.929773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1489/2903] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:28 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:28.989330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:28.989997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:28.997664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:28.998114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:28.998887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:28.999328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:29.048888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a0d5ed57-12d2-4c2e-b919-d764ef35fb35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:29.057590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a0d5ed57-12d2-4c2e-b919-d764ef35fb35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.163913 May 23 14:00:29.061690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1415/2904] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:28 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:29.063629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-84843f7a-b231-4f1f-97de-b461292bc44a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:29.064376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-84843f7a-b231-4f1f-97de-b461292bc44a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:29.067170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:29.070839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84843f7a-b231-4f1f-97de-b461292bc44a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:29.071390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84843f7a-b231-4f1f-97de-b461292bc44a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:29.072224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84843f7a-b231-4f1f-97de-b461292bc44a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:29.072682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84843f7a-b231-4f1f-97de-b461292bc44a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:29.076129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:29.077700 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:29.078880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-19372a34-0613-4b33-8244-25a4f65da51f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.093555 May 23 14:00:29.079483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1490/2905] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:28 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:29.212883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84843f7a-b231-4f1f-97de-b461292bc44a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:29.221553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-84843f7a-b231-4f1f-97de-b461292bc44a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162081 May 23 14:00:29.222136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1416/2906] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:29 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:29.910539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-60da5bb6-c3b4-473a-87eb-005a2de99dfe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:29.911188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-60da5bb6-c3b4-473a-87eb-005a2de99dfe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:29.917928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60da5bb6-c3b4-473a-87eb-005a2de99dfe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:29.918991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60da5bb6-c3b4-473a-87eb-005a2de99dfe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:29.919792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60da5bb6-c3b4-473a-87eb-005a2de99dfe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:29.920233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60da5bb6-c3b4-473a-87eb-005a2de99dfe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:29.947493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9f69a67-864d-44ed-965e-da9918be9f04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:29.948197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9f69a67-864d-44ed-965e-da9918be9f04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:29.951087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:29.956250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9f69a67-864d-44ed-965e-da9918be9f04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:29.956827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9f69a67-864d-44ed-965e-da9918be9f04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:29.957609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9f69a67-864d-44ed-965e-da9918be9f04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:29.958050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9f69a67-864d-44ed-965e-da9918be9f04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:30.033586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9f69a67-864d-44ed-965e-da9918be9f04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:30.042570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9f69a67-864d-44ed-965e-da9918be9f04 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.098784 May 23 14:00:30.043812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1417/2907] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:29 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:30.054870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-60da5bb6-c3b4-473a-87eb-005a2de99dfe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:30.063492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-60da5bb6-c3b4-473a-87eb-005a2de99dfe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156779 May 23 14:00:30.064063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1491/2908] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:29 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:30.075722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-22d31c69-c029-407d-be05-3fb636c12d6f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:30.076474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-22d31c69-c029-407d-be05-3fb636c12d6f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:30.082621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22d31c69-c029-407d-be05-3fb636c12d6f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:30.083156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22d31c69-c029-407d-be05-3fb636c12d6f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:30.083916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22d31c69-c029-407d-be05-3fb636c12d6f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:30.084345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22d31c69-c029-407d-be05-3fb636c12d6f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:30.098553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:30.099176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:30.105652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:30.106173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:30.106989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:30.107437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:30.175333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:30.186327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:30.189881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:30.192047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7493e28-fabc-42b3-92f6-9d8297b1379f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098089 May 23 14:00:30.193109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1492/2909] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:30.231657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22d31c69-c029-407d-be05-3fb636c12d6f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:30.239367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f2f8b84-9b6a-49a6-a826-d56c1b77f000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:30.239989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f2f8b84-9b6a-49a6-a826-d56c1b77f000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:30.240171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-22d31c69-c029-407d-be05-3fb636c12d6f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.168841 May 23 14:00:30.240796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1418/2910] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:30 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:30.247887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f2f8b84-9b6a-49a6-a826-d56c1b77f000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:30.248337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f2f8b84-9b6a-49a6-a826-d56c1b77f000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:30.249143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f2f8b84-9b6a-49a6-a826-d56c1b77f000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:30.249586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f2f8b84-9b6a-49a6-a826-d56c1b77f000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:30.391977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f2f8b84-9b6a-49a6-a826-d56c1b77f000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:30.400216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f2f8b84-9b6a-49a6-a826-d56c1b77f000 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164672 May 23 14:00:30.400842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1493/2911] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:30 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:31.064116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7dc0336a-861c-4624-8184-fe05f4367ccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:31.064820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7dc0336a-861c-4624-8184-fe05f4367ccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:31.071826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc0336a-861c-4624-8184-fe05f4367ccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.072272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc0336a-861c-4624-8184-fe05f4367ccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.073100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc0336a-861c-4624-8184-fe05f4367ccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.073533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc0336a-861c-4624-8184-fe05f4367ccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.084596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b0eabdf-322b-40c9-996b-6c8f0a4f51f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:31.085555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b0eabdf-322b-40c9-996b-6c8f0a4f51f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:31.097863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0eabdf-322b-40c9-996b-6c8f0a4f51f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.098704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0eabdf-322b-40c9-996b-6c8f0a4f51f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.100121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0eabdf-322b-40c9-996b-6c8f0a4f51f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.100958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b0eabdf-322b-40c9-996b-6c8f0a4f51f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.110337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:31.146864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7dc0336a-861c-4624-8184-fe05f4367ccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:31.156958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7dc0336a-861c-4624-8184-fe05f4367ccc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.099412 May 23 14:00:31.158140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1419/2912] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:31 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:31.221894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:31.222514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:31.228984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.229440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.230214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.230657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.265725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b0eabdf-322b-40c9-996b-6c8f0a4f51f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:31.275479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b0eabdf-322b-40c9-996b-6c8f0a4f51f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.197589 May 23 14:00:31.276082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1494/2913] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:31 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:31.286359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f15a0e8-ca51-4852-b1bd-84ba985b5b76 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:31.286359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f15a0e8-ca51-4852-b1bd-84ba985b5b76 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:31.288879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f15a0e8-ca51-4852-b1bd-84ba985b5b76 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.289345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f15a0e8-ca51-4852-b1bd-84ba985b5b76 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.290126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f15a0e8-ca51-4852-b1bd-84ba985b5b76 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.290567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f15a0e8-ca51-4852-b1bd-84ba985b5b76 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.304153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:31.313402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:31.315007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:31.316097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b92d46be-61e5-4528-bac2-86ba25d817dd tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098168 May 23 14:00:31.316681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1420/2914] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:31 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:31.417593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-82bdf6d9-2f22-4373-b680-c75ddf38aadb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:31.418215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-82bdf6d9-2f22-4373-b680-c75ddf38aadb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:31.426014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82bdf6d9-2f22-4373-b680-c75ddf38aadb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.426463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82bdf6d9-2f22-4373-b680-c75ddf38aadb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.427252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82bdf6d9-2f22-4373-b680-c75ddf38aadb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:31.427730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82bdf6d9-2f22-4373-b680-c75ddf38aadb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:31.445215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f15a0e8-ca51-4852-b1bd-84ba985b5b76 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:31.465938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f15a0e8-ca51-4852-b1bd-84ba985b5b76 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.188101 May 23 14:00:31.466566 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1495/2915] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:31 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:31.583025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82bdf6d9-2f22-4373-b680-c75ddf38aadb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:31.591836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-82bdf6d9-2f22-4373-b680-c75ddf38aadb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.177983 May 23 14:00:31.592431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1421/2916] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:31 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:32.174629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b83b61a2-89c0-4249-8280-83b5a2bd918b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:32.175248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b83b61a2-89c0-4249-8280-83b5a2bd918b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:32.182058 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83b61a2-89c0-4249-8280-83b5a2bd918b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.182890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83b61a2-89c0-4249-8280-83b5a2bd918b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.183204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83b61a2-89c0-4249-8280-83b5a2bd918b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.183649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b83b61a2-89c0-4249-8280-83b5a2bd918b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.252644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b83b61a2-89c0-4249-8280-83b5a2bd918b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:32.260993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b83b61a2-89c0-4249-8280-83b5a2bd918b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090144 May 23 14:00:32.261586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1496/2917] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:32 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:32.295304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ecc77a4-c139-4ca3-badb-70ded166f4d9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:32.295919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ecc77a4-c139-4ca3-badb-70ded166f4d9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:32.302960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ecc77a4-c139-4ca3-badb-70ded166f4d9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.303410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ecc77a4-c139-4ca3-badb-70ded166f4d9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.304196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ecc77a4-c139-4ca3-badb-70ded166f4d9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.304638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ecc77a4-c139-4ca3-badb-70ded166f4d9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.334825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:32.335607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:32.342766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.343217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.343995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.344437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.408360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:32.417148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:32.418961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:32.420149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-714a0947-3a46-4616-a8ec-0ed6394365c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089239 May 23 14:00:32.420780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1497/2918] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:32 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:32.440610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ecc77a4-c139-4ca3-badb-70ded166f4d9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:32.448469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ecc77a4-c139-4ca3-badb-70ded166f4d9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158103 May 23 14:00:32.449065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1422/2919] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:32 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:32.483726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8352ce19-e4fa-4dd4-9ad9-69ccee73e9f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:32.484337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8352ce19-e4fa-4dd4-9ad9-69ccee73e9f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:32.490358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8352ce19-e4fa-4dd4-9ad9-69ccee73e9f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.490805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8352ce19-e4fa-4dd4-9ad9-69ccee73e9f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.491550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8352ce19-e4fa-4dd4-9ad9-69ccee73e9f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.491985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8352ce19-e4fa-4dd4-9ad9-69ccee73e9f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.609342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b3da2595-f089-4475-8314-a9c26633e078 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:32.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b3da2595-f089-4475-8314-a9c26633e078 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:32.616258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3da2595-f089-4475-8314-a9c26633e078 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.616757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3da2595-f089-4475-8314-a9c26633e078 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.617554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3da2595-f089-4475-8314-a9c26633e078 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:32.618087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3da2595-f089-4475-8314-a9c26633e078 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:32.638154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8352ce19-e4fa-4dd4-9ad9-69ccee73e9f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:32.646253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8352ce19-e4fa-4dd4-9ad9-69ccee73e9f5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166595 May 23 14:00:32.646851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1498/2920] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:32 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:32.761014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b3da2595-f089-4475-8314-a9c26633e078 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:32.769886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b3da2595-f089-4475-8314-a9c26633e078 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164577 May 23 14:00:32.770475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1423/2921] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:32 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:33.289459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ac1d1390-15bb-458c-ab51-5d7773dbde75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:33.290077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ac1d1390-15bb-458c-ab51-5d7773dbde75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:33.297050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac1d1390-15bb-458c-ab51-5d7773dbde75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.297506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac1d1390-15bb-458c-ab51-5d7773dbde75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.298275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac1d1390-15bb-458c-ab51-5d7773dbde75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.298720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ac1d1390-15bb-458c-ab51-5d7773dbde75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.362165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ac1d1390-15bb-458c-ab51-5d7773dbde75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:33.370352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ac1d1390-15bb-458c-ab51-5d7773dbde75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084746 May 23 14:00:33.370922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1499/2922] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:33 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:33.439293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:33.439834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:33.446535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.446983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.447741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.448174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.466355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f308955-35ec-425d-a1c6-f4062bd21eca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:33.466974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f308955-35ec-425d-a1c6-f4062bd21eca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:33.473281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f308955-35ec-425d-a1c6-f4062bd21eca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.473740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f308955-35ec-425d-a1c6-f4062bd21eca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.474518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f308955-35ec-425d-a1c6-f4062bd21eca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.474960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f308955-35ec-425d-a1c6-f4062bd21eca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.519601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:33.528274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:33.529874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:33.531071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-25ecd68c-5cbb-45ee-9e0f-451620326743 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.096680 May 23 14:00:33.531596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1424/2923] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:33.614512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f308955-35ec-425d-a1c6-f4062bd21eca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:33.623012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f308955-35ec-425d-a1c6-f4062bd21eca tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159995 May 23 14:00:33.623779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1500/2924] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:33 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:33.665788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d608f561-382a-42a2-8cbf-3e9138f22500 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:33.666439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d608f561-382a-42a2-8cbf-3e9138f22500 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:33.672855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d608f561-382a-42a2-8cbf-3e9138f22500 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.673311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d608f561-382a-42a2-8cbf-3e9138f22500 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.674080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d608f561-382a-42a2-8cbf-3e9138f22500 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.674515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d608f561-382a-42a2-8cbf-3e9138f22500 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.787382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c3257834-78e2-45a8-8817-68a9b6ebe9a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:33.788118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c3257834-78e2-45a8-8817-68a9b6ebe9a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:33.794098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3257834-78e2-45a8-8817-68a9b6ebe9a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.795269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3257834-78e2-45a8-8817-68a9b6ebe9a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.796054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3257834-78e2-45a8-8817-68a9b6ebe9a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:33.796488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c3257834-78e2-45a8-8817-68a9b6ebe9a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:33.824957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d608f561-382a-42a2-8cbf-3e9138f22500 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:33.833057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d608f561-382a-42a2-8cbf-3e9138f22500 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.171151 May 23 14:00:33.833754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1425/2925] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:33 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:33.939759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c3257834-78e2-45a8-8817-68a9b6ebe9a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:33.947954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c3257834-78e2-45a8-8817-68a9b6ebe9a9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164524 May 23 14:00:33.948532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1501/2926] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:33 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:34.387757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1bec005d-0740-4b28-b41f-659fef4addc5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:34.388936 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1bec005d-0740-4b28-b41f-659fef4addc5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:34.395402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bec005d-0740-4b28-b41f-659fef4addc5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.395851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bec005d-0740-4b28-b41f-659fef4addc5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:34.396648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bec005d-0740-4b28-b41f-659fef4addc5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.397092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1bec005d-0740-4b28-b41f-659fef4addc5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:34.467298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1bec005d-0740-4b28-b41f-659fef4addc5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:34.483044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1bec005d-0740-4b28-b41f-659fef4addc5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.099022 May 23 14:00:34.483632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1426/2927] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:34 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:34.550000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:34.550621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:34.557286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.557748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:34.558520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.559099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:34.625527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:34.634285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:34.635922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:34.637138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f818940-cafc-4ba4-b168-8c333b739538 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091273 May 23 14:00:34.637722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1502/2928] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:34 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:34.640751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-231e98d7-586b-4a50-a5ac-779fd90a3687 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:34.641498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-231e98d7-586b-4a50-a5ac-779fd90a3687 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:34.647781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-231e98d7-586b-4a50-a5ac-779fd90a3687 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.648236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-231e98d7-586b-4a50-a5ac-779fd90a3687 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:34.649042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-231e98d7-586b-4a50-a5ac-779fd90a3687 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.649482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-231e98d7-586b-4a50-a5ac-779fd90a3687 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:34.791868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-231e98d7-586b-4a50-a5ac-779fd90a3687 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:34.801162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-231e98d7-586b-4a50-a5ac-779fd90a3687 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.164516 May 23 14:00:34.801947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1427/2929] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:34 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:34.855189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d5ee753f-f2be-491e-b149-52ac2443022b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:34.855826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d5ee753f-f2be-491e-b149-52ac2443022b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:34.858410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:34.863491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5ee753f-f2be-491e-b149-52ac2443022b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.863943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5ee753f-f2be-491e-b149-52ac2443022b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:34.864771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5ee753f-f2be-491e-b149-52ac2443022b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.865215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5ee753f-f2be-491e-b149-52ac2443022b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:34.967447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6923db55-23ed-400e-9692-3c22a40f1230 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:34.968065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6923db55-23ed-400e-9692-3c22a40f1230 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:34.974713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6923db55-23ed-400e-9692-3c22a40f1230 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.975163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6923db55-23ed-400e-9692-3c22a40f1230 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:34.975943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6923db55-23ed-400e-9692-3c22a40f1230 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:34.976381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6923db55-23ed-400e-9692-3c22a40f1230 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:35.008493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d5ee753f-f2be-491e-b149-52ac2443022b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:35.017443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d5ee753f-f2be-491e-b149-52ac2443022b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166091 May 23 14:00:35.018148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1503/2930] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:34 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:35.111494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6923db55-23ed-400e-9692-3c22a40f1230 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:35.119637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6923db55-23ed-400e-9692-3c22a40f1230 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156818 May 23 14:00:35.120218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1428/2931] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:34 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:35.501310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b6dca7f-bdc6-4948-8625-1ff87067d400 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:35.502071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b6dca7f-bdc6-4948-8625-1ff87067d400 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:35.508315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b6dca7f-bdc6-4948-8625-1ff87067d400 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:35.508813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b6dca7f-bdc6-4948-8625-1ff87067d400 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:35.509586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b6dca7f-bdc6-4948-8625-1ff87067d400 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:35.510029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b6dca7f-bdc6-4948-8625-1ff87067d400 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:35.579040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b6dca7f-bdc6-4948-8625-1ff87067d400 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:35.587357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b6dca7f-bdc6-4948-8625-1ff87067d400 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091272 May 23 14:00:35.587949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1504/2932] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:35 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:35.656171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:35.657342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:35.663465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:35.663949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:35.664818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:35.665256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:35.728637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:35.737631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:35.739153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:35.740299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59fd17f3-b748-4a38-9fd9-324144c14998 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088807 May 23 14:00:35.740889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1429/2933] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:35 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:35.819620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c546ad15-6e80-4141-89b3-155428c8de19 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:35.820253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c546ad15-6e80-4141-89b3-155428c8de19 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:35.827302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c546ad15-6e80-4141-89b3-155428c8de19 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:35.827752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c546ad15-6e80-4141-89b3-155428c8de19 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:35.828525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c546ad15-6e80-4141-89b3-155428c8de19 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:35.828998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c546ad15-6e80-4141-89b3-155428c8de19 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:35.965396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c546ad15-6e80-4141-89b3-155428c8de19 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:35.973593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c546ad15-6e80-4141-89b3-155428c8de19 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157991 May 23 14:00:35.974171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1505/2934] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:35 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:36.034862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ac93baae-9cc3-41e0-ab8b-ed80b767cf35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:36.035474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ac93baae-9cc3-41e0-ab8b-ed80b767cf35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:36.041514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac93baae-9cc3-41e0-ab8b-ed80b767cf35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:36.041962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac93baae-9cc3-41e0-ab8b-ed80b767cf35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:36.042712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac93baae-9cc3-41e0-ab8b-ed80b767cf35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:36.043151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac93baae-9cc3-41e0-ab8b-ed80b767cf35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:36.146237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0402eaa0-a1f9-4d7d-9341-17d42a8e1fb8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:36.146237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0402eaa0-a1f9-4d7d-9341-17d42a8e1fb8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:36.146237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0402eaa0-a1f9-4d7d-9341-17d42a8e1fb8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:36.146237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0402eaa0-a1f9-4d7d-9341-17d42a8e1fb8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:36.146703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0402eaa0-a1f9-4d7d-9341-17d42a8e1fb8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:36.146703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0402eaa0-a1f9-4d7d-9341-17d42a8e1fb8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:36.193518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ac93baae-9cc3-41e0-ab8b-ed80b767cf35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:36.202054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ac93baae-9cc3-41e0-ab8b-ed80b767cf35 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.170971 May 23 14:00:36.202689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1430/2935] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:36 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:36.285254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0402eaa0-a1f9-4d7d-9341-17d42a8e1fb8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:36.293517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0402eaa0-a1f9-4d7d-9341-17d42a8e1fb8 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160532 May 23 14:00:36.294576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1506/2936] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:36 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:36.605130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9d2a48a5-a6f4-4fda-9a77-e455a960fe72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:36.605766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9d2a48a5-a6f4-4fda-9a77-e455a960fe72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:36.612828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d2a48a5-a6f4-4fda-9a77-e455a960fe72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:36.613279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d2a48a5-a6f4-4fda-9a77-e455a960fe72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:36.614038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d2a48a5-a6f4-4fda-9a77-e455a960fe72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:36.614469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d2a48a5-a6f4-4fda-9a77-e455a960fe72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:36.677287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d2a48a5-a6f4-4fda-9a77-e455a960fe72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:36.685828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9d2a48a5-a6f4-4fda-9a77-e455a960fe72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084501 May 23 14:00:36.686405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1431/2937] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:36 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:36.759380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:36.760001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:36.768388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:36.768879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:36.769675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:36.770125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:36.835503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:36.845293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:36.846803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:36.847944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49a9df3c-32ea-4cc2-9cbe-0282fdd06435 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092555 May 23 14:00:36.848494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1507/2938] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:36 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:36.991804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55ac0d77-ed78-4501-abc4-cf144749856b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:36.992356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55ac0d77-ed78-4501-abc4-cf144749856b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:36.998940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55ac0d77-ed78-4501-abc4-cf144749856b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:36.999386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55ac0d77-ed78-4501-abc4-cf144749856b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.000148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55ac0d77-ed78-4501-abc4-cf144749856b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:37.000607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55ac0d77-ed78-4501-abc4-cf144749856b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.004722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:37.135737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55ac0d77-ed78-4501-abc4-cf144749856b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:37.144973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55ac0d77-ed78-4501-abc4-cf144749856b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157211 May 23 14:00:37.145574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1432/2939] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:36 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:37.219644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-516a6d62-7aef-48b9-9b7c-1f54a2d59eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:37.220305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-516a6d62-7aef-48b9-9b7c-1f54a2d59eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:37.226506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-516a6d62-7aef-48b9-9b7c-1f54a2d59eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:37.226967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-516a6d62-7aef-48b9-9b7c-1f54a2d59eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.227912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-516a6d62-7aef-48b9-9b7c-1f54a2d59eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:37.228358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-516a6d62-7aef-48b9-9b7c-1f54a2d59eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.312941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-14ef61d7-37d1-4aac-8262-151f67d5a28d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:37.313570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-14ef61d7-37d1-4aac-8262-151f67d5a28d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:37.319752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14ef61d7-37d1-4aac-8262-151f67d5a28d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:37.320205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14ef61d7-37d1-4aac-8262-151f67d5a28d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.321082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14ef61d7-37d1-4aac-8262-151f67d5a28d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:37.321521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14ef61d7-37d1-4aac-8262-151f67d5a28d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.363528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-516a6d62-7aef-48b9-9b7c-1f54a2d59eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:37.371907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-516a6d62-7aef-48b9-9b7c-1f54a2d59eca tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156489 May 23 14:00:37.373799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1508/2940] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:37 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:37.458195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-14ef61d7-37d1-4aac-8262-151f67d5a28d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:37.466380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-14ef61d7-37d1-4aac-8262-151f67d5a28d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158964 May 23 14:00:37.466958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1433/2941] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:37 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:37.703709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0009a3ef-cb5e-46ee-b65a-36387fb7c6c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:37.704330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0009a3ef-cb5e-46ee-b65a-36387fb7c6c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:37.710477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0009a3ef-cb5e-46ee-b65a-36387fb7c6c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:37.710936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0009a3ef-cb5e-46ee-b65a-36387fb7c6c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.711705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0009a3ef-cb5e-46ee-b65a-36387fb7c6c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:37.712149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0009a3ef-cb5e-46ee-b65a-36387fb7c6c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.774858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0009a3ef-cb5e-46ee-b65a-36387fb7c6c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:37.783357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0009a3ef-cb5e-46ee-b65a-36387fb7c6c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083824 May 23 14:00:37.783942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1509/2942] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:37 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:37.866465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:37.867059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:37.874417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:37.874868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.875656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:37.876091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:37.942165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:37.950832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:37.952362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:37.953538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c56e6c15-fe09-4dad-9086-1093654c3961 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091037 May 23 14:00:37.954164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1434/2943] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:37 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:38.171122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7ba846a-201d-4c7e-ab93-a6d5fb58af5a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:38.171736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7ba846a-201d-4c7e-ab93-a6d5fb58af5a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:38.177984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7ba846a-201d-4c7e-ab93-a6d5fb58af5a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.178465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7ba846a-201d-4c7e-ab93-a6d5fb58af5a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:38.179237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7ba846a-201d-4c7e-ab93-a6d5fb58af5a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.179680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7ba846a-201d-4c7e-ab93-a6d5fb58af5a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:38.327236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7ba846a-201d-4c7e-ab93-a6d5fb58af5a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:38.327773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:38.332902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7ba846a-201d-4c7e-ab93-a6d5fb58af5a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.166237 May 23 14:00:38.333482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1510/2944] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:38 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:38.390820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59f84ef3-f086-4d4a-b602-f273bafb8d1e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:38.391442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59f84ef3-f086-4d4a-b602-f273bafb8d1e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:38.397810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59f84ef3-f086-4d4a-b602-f273bafb8d1e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.398352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59f84ef3-f086-4d4a-b602-f273bafb8d1e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:38.399125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59f84ef3-f086-4d4a-b602-f273bafb8d1e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.399564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59f84ef3-f086-4d4a-b602-f273bafb8d1e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:38.484226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-155d52e5-7d04-48b0-9cc6-2ab9add873b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:38.484873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-155d52e5-7d04-48b0-9cc6-2ab9add873b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:38.491553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-155d52e5-7d04-48b0-9cc6-2ab9add873b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.492001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-155d52e5-7d04-48b0-9cc6-2ab9add873b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:38.492805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-155d52e5-7d04-48b0-9cc6-2ab9add873b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.493243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-155d52e5-7d04-48b0-9cc6-2ab9add873b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:38.538190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59f84ef3-f086-4d4a-b602-f273bafb8d1e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:38.546708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59f84ef3-f086-4d4a-b602-f273bafb8d1e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160395 May 23 14:00:38.547612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1435/2945] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:38 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:38.631697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-155d52e5-7d04-48b0-9cc6-2ab9add873b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:38.640223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-155d52e5-7d04-48b0-9cc6-2ab9add873b9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160606 May 23 14:00:38.640819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1511/2946] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:38 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:38.799722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99fe33b4-c686-4bc0-b393-d14705643605 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:38.800250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99fe33b4-c686-4bc0-b393-d14705643605 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:38.806555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99fe33b4-c686-4bc0-b393-d14705643605 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.807006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99fe33b4-c686-4bc0-b393-d14705643605 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:38.807766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99fe33b4-c686-4bc0-b393-d14705643605 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.808198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99fe33b4-c686-4bc0-b393-d14705643605 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:38.881489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99fe33b4-c686-4bc0-b393-d14705643605 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:38.890651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99fe33b4-c686-4bc0-b393-d14705643605 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094893 May 23 14:00:38.891260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1436/2947] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:38 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:38.971789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:38.972410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:38.979523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.979970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:38.980782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:38.981223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:39.045921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:39.054766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:39.056256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:39.057438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-507f70d4-a6de-4fdb-bc59-2c47aa827bd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089700 May 23 14:00:39.058003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1512/2948] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:38 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:39.351354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b50a6d09-a620-4550-92bb-18c43b9d005d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:39.351878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b50a6d09-a620-4550-92bb-18c43b9d005d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:39.358848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b50a6d09-a620-4550-92bb-18c43b9d005d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:39.359301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b50a6d09-a620-4550-92bb-18c43b9d005d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:39.360079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b50a6d09-a620-4550-92bb-18c43b9d005d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:39.360513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b50a6d09-a620-4550-92bb-18c43b9d005d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:39.500933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b50a6d09-a620-4550-92bb-18c43b9d005d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:39.509275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b50a6d09-a620-4550-92bb-18c43b9d005d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161824 May 23 14:00:39.509834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1437/2949] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:39 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:39.564256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2a01165-51b4-42fa-8876-0acfa35ff97c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:39.564934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2a01165-51b4-42fa-8876-0acfa35ff97c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:39.571683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2a01165-51b4-42fa-8876-0acfa35ff97c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:39.572138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2a01165-51b4-42fa-8876-0acfa35ff97c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:39.572967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2a01165-51b4-42fa-8876-0acfa35ff97c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:39.573406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2a01165-51b4-42fa-8876-0acfa35ff97c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:39.659093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-01d52b6b-8e25-44a6-a6c4-6e07a915430c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:39.659706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-01d52b6b-8e25-44a6-a6c4-6e07a915430c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:39.665919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01d52b6b-8e25-44a6-a6c4-6e07a915430c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:39.666374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01d52b6b-8e25-44a6-a6c4-6e07a915430c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:39.667143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01d52b6b-8e25-44a6-a6c4-6e07a915430c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:39.667576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01d52b6b-8e25-44a6-a6c4-6e07a915430c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:39.710890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2a01165-51b4-42fa-8876-0acfa35ff97c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:39.720042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2a01165-51b4-42fa-8876-0acfa35ff97c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159562 May 23 14:00:39.720651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1513/2950] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:39 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:39.806604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-01d52b6b-8e25-44a6-a6c4-6e07a915430c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:39.815262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-01d52b6b-8e25-44a6-a6c4-6e07a915430c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160967 May 23 14:00:39.815846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1438/2951] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:39 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:39.908018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f302935-dbc5-4ae8-befb-6b67a97bbfc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:39.908558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f302935-dbc5-4ae8-befb-6b67a97bbfc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:39.914605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f302935-dbc5-4ae8-befb-6b67a97bbfc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:39.915091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f302935-dbc5-4ae8-befb-6b67a97bbfc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:39.915854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f302935-dbc5-4ae8-befb-6b67a97bbfc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:39.916292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f302935-dbc5-4ae8-befb-6b67a97bbfc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:39.980275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f302935-dbc5-4ae8-befb-6b67a97bbfc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:39.989149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f302935-dbc5-4ae8-befb-6b67a97bbfc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085654 May 23 14:00:39.989758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1514/2952] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:39 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:40.076250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:40.076885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:40.083468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:40.083902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:40.084713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:40.085148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:40.154057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:40.162858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:40.164274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:40.165435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d2a62ab2-ddcc-4583-9452-7ecffc2391c1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094021 May 23 14:00:40.165990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1439/2953] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:40.531531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9539656b-1cb3-45e4-9ed3-78d6237adf2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:40.532328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9539656b-1cb3-45e4-9ed3-78d6237adf2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:40.538737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9539656b-1cb3-45e4-9ed3-78d6237adf2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:40.539196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9539656b-1cb3-45e4-9ed3-78d6237adf2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:40.539973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9539656b-1cb3-45e4-9ed3-78d6237adf2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:40.540425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9539656b-1cb3-45e4-9ed3-78d6237adf2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:40.681232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9539656b-1cb3-45e4-9ed3-78d6237adf2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:40.689607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9539656b-1cb3-45e4-9ed3-78d6237adf2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.164636 May 23 14:00:40.690189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1515/2954] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:40 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:40.736709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65278168-d565-438f-aa7e-e24afcd1e9bb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:40.737359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65278168-d565-438f-aa7e-e24afcd1e9bb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:40.743608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65278168-d565-438f-aa7e-e24afcd1e9bb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:40.744053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65278168-d565-438f-aa7e-e24afcd1e9bb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:40.744840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65278168-d565-438f-aa7e-e24afcd1e9bb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:40.745270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65278168-d565-438f-aa7e-e24afcd1e9bb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:40.832623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-98c48dfe-f887-47a7-af14-11acb287aca2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:40.833355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-98c48dfe-f887-47a7-af14-11acb287aca2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:40.839551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98c48dfe-f887-47a7-af14-11acb287aca2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:40.839999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98c48dfe-f887-47a7-af14-11acb287aca2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:40.841624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98c48dfe-f887-47a7-af14-11acb287aca2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:40.842220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98c48dfe-f887-47a7-af14-11acb287aca2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:40.883447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-65278168-d565-438f-aa7e-e24afcd1e9bb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:40.892430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65278168-d565-438f-aa7e-e24afcd1e9bb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159379 May 23 14:00:40.892892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1440/2955] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:40 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:40.976984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-98c48dfe-f887-47a7-af14-11acb287aca2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:40.985561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-98c48dfe-f887-47a7-af14-11acb287aca2 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156868 May 23 14:00:40.986273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1516/2956] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:40 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:41.007179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9e55982-e4fe-4f36-9dd4-bdb338ea65d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:41.007790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9e55982-e4fe-4f36-9dd4-bdb338ea65d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:41.014672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9e55982-e4fe-4f36-9dd4-bdb338ea65d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:41.015121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9e55982-e4fe-4f36-9dd4-bdb338ea65d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:41.015884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9e55982-e4fe-4f36-9dd4-bdb338ea65d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:41.016328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9e55982-e4fe-4f36-9dd4-bdb338ea65d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:41.086559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9e55982-e4fe-4f36-9dd4-bdb338ea65d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:41.094770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9e55982-e4fe-4f36-9dd4-bdb338ea65d3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091485 May 23 14:00:41.095350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1441/2957] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:41 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:41.183678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:41.184299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:41.191749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:41.192192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:41.192986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:41.193418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:41.258552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:41.267681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:41.269245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:41.270401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b3a9d4a1-a599-42d5-8182-c87eaabbd764 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090732 May 23 14:00:41.270957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1517/2958] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:41 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:41.707370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0226c7c3-e542-4218-a376-a24890c40614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:41.707981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0226c7c3-e542-4218-a376-a24890c40614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:41.714218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0226c7c3-e542-4218-a376-a24890c40614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:41.714665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0226c7c3-e542-4218-a376-a24890c40614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:41.715429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0226c7c3-e542-4218-a376-a24890c40614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:41.715862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0226c7c3-e542-4218-a376-a24890c40614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:41.857165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0226c7c3-e542-4218-a376-a24890c40614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:41.866080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0226c7c3-e542-4218-a376-a24890c40614 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162662 May 23 14:00:41.866648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1442/2959] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:41 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:41.913033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-afd727b2-3a70-4119-8d99-a0820f3964a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:41.913737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-afd727b2-3a70-4119-8d99-a0820f3964a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:41.921628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afd727b2-3a70-4119-8d99-a0820f3964a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:41.922074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afd727b2-3a70-4119-8d99-a0820f3964a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:41.922851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afd727b2-3a70-4119-8d99-a0820f3964a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:41.923291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afd727b2-3a70-4119-8d99-a0820f3964a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:42.003717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e3cdc2f-4aea-421a-a6a8-bae5188b4184 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:42.004271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e3cdc2f-4aea-421a-a6a8-bae5188b4184 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:42.010382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e3cdc2f-4aea-421a-a6a8-bae5188b4184 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:42.010825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e3cdc2f-4aea-421a-a6a8-bae5188b4184 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:42.011585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e3cdc2f-4aea-421a-a6a8-bae5188b4184 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:42.012016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e3cdc2f-4aea-421a-a6a8-bae5188b4184 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:42.069178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-afd727b2-3a70-4119-8d99-a0820f3964a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:42.079680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-afd727b2-3a70-4119-8d99-a0820f3964a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.173186 May 23 14:00:42.080366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1518/2960] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:41 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:42.111546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-42293fc5-21ae-4d17-8277-38cae7271658 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:42.112340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-42293fc5-21ae-4d17-8277-38cae7271658 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:42.120232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42293fc5-21ae-4d17-8277-38cae7271658 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:42.120821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42293fc5-21ae-4d17-8277-38cae7271658 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:42.121680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42293fc5-21ae-4d17-8277-38cae7271658 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:42.122131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42293fc5-21ae-4d17-8277-38cae7271658 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:42.153719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e3cdc2f-4aea-421a-a6a8-bae5188b4184 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:42.163193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e3cdc2f-4aea-421a-a6a8-bae5188b4184 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164438 May 23 14:00:42.163793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1443/2961] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:41 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:42.188595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42293fc5-21ae-4d17-8277-38cae7271658 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:42.197152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-42293fc5-21ae-4d17-8277-38cae7271658 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089719 May 23 14:00:42.197733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1519/2962] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:42 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:42.288586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:42.289089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:42.296051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:42.296515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:42.297323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:42.297767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:42.366227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:42.376100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:42.377724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:42.378944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-93c0ca9d-618d-48c9-9c78-b33df88e5526 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094438 May 23 14:00:42.379518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1444/2963] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:42 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:42.884436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-32ddd611-99bf-4ee8-9935-e8c0d8f2a5a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:42.885082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-32ddd611-99bf-4ee8-9935-e8c0d8f2a5a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:42.891435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32ddd611-99bf-4ee8-9935-e8c0d8f2a5a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:42.891884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32ddd611-99bf-4ee8-9935-e8c0d8f2a5a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:42.892689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32ddd611-99bf-4ee8-9935-e8c0d8f2a5a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:42.893128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32ddd611-99bf-4ee8-9935-e8c0d8f2a5a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:43.025230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-32ddd611-99bf-4ee8-9935-e8c0d8f2a5a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:43.033328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-32ddd611-99bf-4ee8-9935-e8c0d8f2a5a9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.153374 May 23 14:00:43.033990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1520/2964] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:42 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:43.098594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-79bf6717-27d3-4514-9f86-935293a581a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:43.099217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-79bf6717-27d3-4514-9f86-935293a581a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:43.106009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79bf6717-27d3-4514-9f86-935293a581a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:43.106459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79bf6717-27d3-4514-9f86-935293a581a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:43.107351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79bf6717-27d3-4514-9f86-935293a581a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:43.108357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79bf6717-27d3-4514-9f86-935293a581a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:43.181851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-93475f53-4de4-44dc-bb0d-99c6be6e8355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:43.183517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-93475f53-4de4-44dc-bb0d-99c6be6e8355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:43.191574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93475f53-4de4-44dc-bb0d-99c6be6e8355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:43.192141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93475f53-4de4-44dc-bb0d-99c6be6e8355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:43.193055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93475f53-4de4-44dc-bb0d-99c6be6e8355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:43.193563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93475f53-4de4-44dc-bb0d-99c6be6e8355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:43.257285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-79bf6717-27d3-4514-9f86-935293a581a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:43.266194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-79bf6717-27d3-4514-9f86-935293a581a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.171618 May 23 14:00:43.266773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1445/2965] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:43 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:43.271689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fb31af72-09a0-4d63-a062-55009ce592ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:43.272301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fb31af72-09a0-4d63-a062-55009ce592ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:43.278386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb31af72-09a0-4d63-a062-55009ce592ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:43.278839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb31af72-09a0-4d63-a062-55009ce592ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:43.280280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb31af72-09a0-4d63-a062-55009ce592ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:43.281241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb31af72-09a0-4d63-a062-55009ce592ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:43.329290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93475f53-4de4-44dc-bb0d-99c6be6e8355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:43.337414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-93475f53-4de4-44dc-bb0d-99c6be6e8355 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160496 May 23 14:00:43.338072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1521/2966] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:43 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:43.345962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb31af72-09a0-4d63-a062-55009ce592ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:43.354336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fb31af72-09a0-4d63-a062-55009ce592ff tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086351 May 23 14:00:43.354915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1446/2967] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:43 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:43.398742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:43.399348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:43.406249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:43.406699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:43.407492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:43.407930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:43.471523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:43.480086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:43.481605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:43.483308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a34f500-e658-45d4-9a60-2c56f1d7ffdb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.087976 May 23 14:00:43.483870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1522/2968] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:43 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:43.820893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:00:43.821152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:00:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:00:44.050922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-172ee6bc-ce29-436b-aabc-9889644f2b6a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:44.051532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-172ee6bc-ce29-436b-aabc-9889644f2b6a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:44.058658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-172ee6bc-ce29-436b-aabc-9889644f2b6a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.059490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-172ee6bc-ce29-436b-aabc-9889644f2b6a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.060272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-172ee6bc-ce29-436b-aabc-9889644f2b6a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.061397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-172ee6bc-ce29-436b-aabc-9889644f2b6a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.216071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-172ee6bc-ce29-436b-aabc-9889644f2b6a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:44.225902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-172ee6bc-ce29-436b-aabc-9889644f2b6a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.178889 May 23 14:00:44.227572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1447/2969] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:44 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:44.284359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-453adf94-6f69-4ade-8ddb-22fa23c2770a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:44.285055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-453adf94-6f69-4ade-8ddb-22fa23c2770a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:44.291816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-453adf94-6f69-4ade-8ddb-22fa23c2770a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.292267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-453adf94-6f69-4ade-8ddb-22fa23c2770a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.293072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-453adf94-6f69-4ade-8ddb-22fa23c2770a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.293515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-453adf94-6f69-4ade-8ddb-22fa23c2770a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.355320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-081d3658-0f36-404a-940d-3fe4b942a993 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:44.355935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-081d3658-0f36-404a-940d-3fe4b942a993 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:44.362643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-081d3658-0f36-404a-940d-3fe4b942a993 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.363091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-081d3658-0f36-404a-940d-3fe4b942a993 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.363855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-081d3658-0f36-404a-940d-3fe4b942a993 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.364287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-081d3658-0f36-404a-940d-3fe4b942a993 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.436773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-453adf94-6f69-4ade-8ddb-22fa23c2770a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:44.444959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-453adf94-6f69-4ade-8ddb-22fa23c2770a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165287 May 23 14:00:44.445737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1523/2970] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:44 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:44.458379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fa86007-c0fc-4fec-a4b3-784bb4c2761a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:44.459314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fa86007-c0fc-4fec-a4b3-784bb4c2761a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:44.465382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fa86007-c0fc-4fec-a4b3-784bb4c2761a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.465836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fa86007-c0fc-4fec-a4b3-784bb4c2761a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.466603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fa86007-c0fc-4fec-a4b3-784bb4c2761a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.467188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fa86007-c0fc-4fec-a4b3-784bb4c2761a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.501996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-081d3658-0f36-404a-940d-3fe4b942a993 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:44.505631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:44.513455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-081d3658-0f36-404a-940d-3fe4b942a993 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161701 May 23 14:00:44.519177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1448/2971] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:44 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:44.521725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:44.522334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:44.528679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.529131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.530224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:44.530661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:44.535475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fa86007-c0fc-4fec-a4b3-784bb4c2761a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:44.543378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fa86007-c0fc-4fec-a4b3-784bb4c2761a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.095806 May 23 14:00:44.544033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1524/2972] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:44 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:44.594676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:44.603518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:44.605057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:44.606255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34bafd94-a642-4432-90ec-1206a19b4ee1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090042 May 23 14:00:44.606750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1449/2973] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:44 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:45.244081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1fc74b3-35dc-43ef-8345-62db2e8643a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:45.244738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1fc74b3-35dc-43ef-8345-62db2e8643a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:45.250943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1fc74b3-35dc-43ef-8345-62db2e8643a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.251396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1fc74b3-35dc-43ef-8345-62db2e8643a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.252196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1fc74b3-35dc-43ef-8345-62db2e8643a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.252663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1fc74b3-35dc-43ef-8345-62db2e8643a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.389827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1fc74b3-35dc-43ef-8345-62db2e8643a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:45.398283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1fc74b3-35dc-43ef-8345-62db2e8643a1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158128 May 23 14:00:45.398939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1525/2974] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:45 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:45.461572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-752422a2-fe1a-429f-a5fa-82b8c121a977 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:45.462283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-752422a2-fe1a-429f-a5fa-82b8c121a977 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:45.468924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-752422a2-fe1a-429f-a5fa-82b8c121a977 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.469404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-752422a2-fe1a-429f-a5fa-82b8c121a977 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.470170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-752422a2-fe1a-429f-a5fa-82b8c121a977 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.470602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-752422a2-fe1a-429f-a5fa-82b8c121a977 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.536244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52738ad2-1e70-4653-84cd-c829681f153d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:45.536926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52738ad2-1e70-4653-84cd-c829681f153d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:45.543289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52738ad2-1e70-4653-84cd-c829681f153d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.543739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52738ad2-1e70-4653-84cd-c829681f153d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.544518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52738ad2-1e70-4653-84cd-c829681f153d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.545020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52738ad2-1e70-4653-84cd-c829681f153d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.624486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-752422a2-fe1a-429f-a5fa-82b8c121a977 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:45.632738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-752422a2-fe1a-429f-a5fa-82b8c121a977 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.175003 May 23 14:00:45.633324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1450/2975] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:45 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:45.638224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb3ff569-bf7c-4423-bc24-5c97248aa6ad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:45.639404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb3ff569-bf7c-4423-bc24-5c97248aa6ad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:45.646643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb3ff569-bf7c-4423-bc24-5c97248aa6ad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.647100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb3ff569-bf7c-4423-bc24-5c97248aa6ad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.647866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb3ff569-bf7c-4423-bc24-5c97248aa6ad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.648299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb3ff569-bf7c-4423-bc24-5c97248aa6ad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.699813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52738ad2-1e70-4653-84cd-c829681f153d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:45.709679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52738ad2-1e70-4653-84cd-c829681f153d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.178713 May 23 14:00:45.710257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1526/2976] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:45 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:45.715429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:45.716044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:45.716171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bb3ff569-bf7c-4423-bc24-5c97248aa6ad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:45.722481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.722930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.723757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:45.724229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:45.727089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb3ff569-bf7c-4423-bc24-5c97248aa6ad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092403 May 23 14:00:45.727675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1451/2977] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:45 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:45.744783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:45.794082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:45.803189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:45.804865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:45.806016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-79f5cccc-9031-4439-a80d-f8d94a236b5e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094613 May 23 14:00:45.806580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1527/2978] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:46.415436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c7cd659-d92f-4ed5-989e-923180e678b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:46.416083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c7cd659-d92f-4ed5-989e-923180e678b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:46.423733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c7cd659-d92f-4ed5-989e-923180e678b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.424193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c7cd659-d92f-4ed5-989e-923180e678b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.425005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c7cd659-d92f-4ed5-989e-923180e678b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.425446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c7cd659-d92f-4ed5-989e-923180e678b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.579203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c7cd659-d92f-4ed5-989e-923180e678b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:46.587585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c7cd659-d92f-4ed5-989e-923180e678b1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.175922 May 23 14:00:46.588165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1452/2979] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:46 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:46.657057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b6aa59c-f0ea-496d-8dbf-5338546419a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:46.657722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b6aa59c-f0ea-496d-8dbf-5338546419a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:46.664868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b6aa59c-f0ea-496d-8dbf-5338546419a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.665323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b6aa59c-f0ea-496d-8dbf-5338546419a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.666107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b6aa59c-f0ea-496d-8dbf-5338546419a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.666552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b6aa59c-f0ea-496d-8dbf-5338546419a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.728021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3df0a358-7553-4e33-a241-af65aa417069 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:46.728671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3df0a358-7553-4e33-a241-af65aa417069 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:46.736321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3df0a358-7553-4e33-a241-af65aa417069 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.736802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3df0a358-7553-4e33-a241-af65aa417069 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.737582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3df0a358-7553-4e33-a241-af65aa417069 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.738015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3df0a358-7553-4e33-a241-af65aa417069 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.815639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b6aa59c-f0ea-496d-8dbf-5338546419a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:46.823982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b6aa59c-f0ea-496d-8dbf-5338546419a5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.176284 May 23 14:00:46.824598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1528/2980] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:46 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:46.830771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b0966a5-7eba-4526-a59f-a2e906c1f8f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:46.831621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b0966a5-7eba-4526-a59f-a2e906c1f8f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:46.838014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b0966a5-7eba-4526-a59f-a2e906c1f8f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.838473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b0966a5-7eba-4526-a59f-a2e906c1f8f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.839251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b0966a5-7eba-4526-a59f-a2e906c1f8f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.839696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b0966a5-7eba-4526-a59f-a2e906c1f8f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.886479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3df0a358-7553-4e33-a241-af65aa417069 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:46.898642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3df0a358-7553-4e33-a241-af65aa417069 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.174880 May 23 14:00:46.899685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1453/2981] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:46 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:46.905110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:46.906186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:46.914584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.915028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.915812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:46.916251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:46.923465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b0966a5-7eba-4526-a59f-a2e906c1f8f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:46.932702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b0966a5-7eba-4526-a59f-a2e906c1f8f3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.106863 May 23 14:00:46.933283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1529/2982] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:46 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:46.992726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:47.003296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:47.004918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:47.006036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-52158d8f-7aa5-42ae-9788-f2f81c93ab8a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.105010 May 23 14:00:47.006596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1454/2983] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:47.611921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3fbd6b15-ccc9-48f3-8fde-d312bd4627e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:47.612546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3fbd6b15-ccc9-48f3-8fde-d312bd4627e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:47.619065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3fbd6b15-ccc9-48f3-8fde-d312bd4627e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:47.619520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3fbd6b15-ccc9-48f3-8fde-d312bd4627e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:47.620307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3fbd6b15-ccc9-48f3-8fde-d312bd4627e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:47.620853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3fbd6b15-ccc9-48f3-8fde-d312bd4627e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:47.770428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3fbd6b15-ccc9-48f3-8fde-d312bd4627e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:47.785110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3fbd6b15-ccc9-48f3-8fde-d312bd4627e9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.177336 May 23 14:00:47.786121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1530/2984] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:47 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:47.842237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13a9260e-7169-40cb-97f3-236e75221982 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:47.842880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-13a9260e-7169-40cb-97f3-236e75221982 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:47.849560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13a9260e-7169-40cb-97f3-236e75221982 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:47.850013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13a9260e-7169-40cb-97f3-236e75221982 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:47.850783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13a9260e-7169-40cb-97f3-236e75221982 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:47.851220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13a9260e-7169-40cb-97f3-236e75221982 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:47.919194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e6dc75f-9d21-49ee-89a7-2e36c1d72709 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:47.919870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e6dc75f-9d21-49ee-89a7-2e36c1d72709 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:47.926198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e6dc75f-9d21-49ee-89a7-2e36c1d72709 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:47.926936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e6dc75f-9d21-49ee-89a7-2e36c1d72709 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:47.927710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e6dc75f-9d21-49ee-89a7-2e36c1d72709 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:47.928143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e6dc75f-9d21-49ee-89a7-2e36c1d72709 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:47.995506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-13a9260e-7169-40cb-97f3-236e75221982 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:48.004662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-13a9260e-7169-40cb-97f3-236e75221982 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.166300 May 23 14:00:48.005253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1455/2985] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:47 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:48.009779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d425764e-6b73-40a7-81a0-a021a77d2253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:48.010702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d425764e-6b73-40a7-81a0-a021a77d2253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:48.019295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d425764e-6b73-40a7-81a0-a021a77d2253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:48.019764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d425764e-6b73-40a7-81a0-a021a77d2253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:48.020545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d425764e-6b73-40a7-81a0-a021a77d2253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:48.021002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d425764e-6b73-40a7-81a0-a021a77d2253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:48.071648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e6dc75f-9d21-49ee-89a7-2e36c1d72709 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:48.080104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e6dc75f-9d21-49ee-89a7-2e36c1d72709 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164903 May 23 14:00:48.090039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1531/2986] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:47 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:48.090039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:48.090518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d425764e-6b73-40a7-81a0-a021a77d2253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:48.090629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:48.092296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:48.092787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:48.093569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:48.094008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:48.094576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d425764e-6b73-40a7-81a0-a021a77d2253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088299 May 23 14:00:48.095166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1456/2987] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:48.157535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:48.166539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:48.168065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:48.169301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-399f647d-ea7a-47ba-9e90-3c6e39cad567 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.087617 May 23 14:00:48.170382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1532/2988] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:48.811507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eb083999-efbf-4d7c-931a-41ead861bcc2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:48.812119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eb083999-efbf-4d7c-931a-41ead861bcc2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:48.818537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb083999-efbf-4d7c-931a-41ead861bcc2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:48.818980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb083999-efbf-4d7c-931a-41ead861bcc2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:48.819744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb083999-efbf-4d7c-931a-41ead861bcc2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:48.820174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb083999-efbf-4d7c-931a-41ead861bcc2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:48.953725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eb083999-efbf-4d7c-931a-41ead861bcc2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:48.962098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eb083999-efbf-4d7c-931a-41ead861bcc2 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.155300 May 23 14:00:48.962689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1457/2989] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:48 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:49.022981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f81d2c5b-93a2-460d-9d4d-9cf4813060e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:49.023627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f81d2c5b-93a2-460d-9d4d-9cf4813060e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:49.031477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f81d2c5b-93a2-460d-9d4d-9cf4813060e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.031954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f81d2c5b-93a2-460d-9d4d-9cf4813060e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:49.032789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f81d2c5b-93a2-460d-9d4d-9cf4813060e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.033271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f81d2c5b-93a2-460d-9d4d-9cf4813060e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:49.098332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-284e074e-3a74-4209-8fa6-c9191783e03a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:49.098905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-284e074e-3a74-4209-8fa6-c9191783e03a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:49.105318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-284e074e-3a74-4209-8fa6-c9191783e03a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.105766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-284e074e-3a74-4209-8fa6-c9191783e03a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:49.106809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-284e074e-3a74-4209-8fa6-c9191783e03a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.107295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-284e074e-3a74-4209-8fa6-c9191783e03a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:49.166212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f81d2c5b-93a2-460d-9d4d-9cf4813060e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:49.174529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f81d2c5b-93a2-460d-9d4d-9cf4813060e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155593 May 23 14:00:49.183357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1533/2990] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:49 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:49.183357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d821b35-c90a-4edd-b872-ebeec458c05f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:49.183357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d821b35-c90a-4edd-b872-ebeec458c05f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:49.187621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d821b35-c90a-4edd-b872-ebeec458c05f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.188084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d821b35-c90a-4edd-b872-ebeec458c05f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:49.188900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d821b35-c90a-4edd-b872-ebeec458c05f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.189348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d821b35-c90a-4edd-b872-ebeec458c05f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:49.252059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7d821b35-c90a-4edd-b872-ebeec458c05f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:49.253605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-284e074e-3a74-4209-8fa6-c9191783e03a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:49.260274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d821b35-c90a-4edd-b872-ebeec458c05f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084116 May 23 14:00:49.260878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1534/2991] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:49 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:49.261979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-284e074e-3a74-4209-8fa6-c9191783e03a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.167516 May 23 14:00:49.262542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1458/2992] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:49 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:49.275013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:49.275639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:49.282693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.283145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:49.284356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.284356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:49.352791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:49.361637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:49.363161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:49.364309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-69b394c5-bbc0-4d72-87b4-d68068d01f7a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.093264 May 23 14:00:49.364899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1535/2993] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:49 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:49.980241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57d208b7-cab1-45cb-932a-4a1e7013b6c0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:49.981001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57d208b7-cab1-45cb-932a-4a1e7013b6c0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:49.988312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57d208b7-cab1-45cb-932a-4a1e7013b6c0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.989103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57d208b7-cab1-45cb-932a-4a1e7013b6c0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:49.989567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57d208b7-cab1-45cb-932a-4a1e7013b6c0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:49.990009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57d208b7-cab1-45cb-932a-4a1e7013b6c0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:50.127378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57d208b7-cab1-45cb-932a-4a1e7013b6c0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:50.136140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57d208b7-cab1-45cb-932a-4a1e7013b6c0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159723 May 23 14:00:50.136747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1459/2994] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:49 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:50.191967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7849431-7e8a-4254-b451-4ebd1dea1a2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:50.192820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7849431-7e8a-4254-b451-4ebd1dea1a2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:50.199784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7849431-7e8a-4254-b451-4ebd1dea1a2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:50.200240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7849431-7e8a-4254-b451-4ebd1dea1a2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:50.201074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7849431-7e8a-4254-b451-4ebd1dea1a2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:50.202122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7849431-7e8a-4254-b451-4ebd1dea1a2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:50.278468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ffc414ae-69b8-476a-95d2-6ea90660be6d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:50.279640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ffc414ae-69b8-476a-95d2-6ea90660be6d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:50.286496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffc414ae-69b8-476a-95d2-6ea90660be6d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:50.286957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffc414ae-69b8-476a-95d2-6ea90660be6d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:50.287736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffc414ae-69b8-476a-95d2-6ea90660be6d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:50.288180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffc414ae-69b8-476a-95d2-6ea90660be6d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:50.340002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7849431-7e8a-4254-b451-4ebd1dea1a2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:50.350416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7849431-7e8a-4254-b451-4ebd1dea1a2b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.162240 May 23 14:00:50.354555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1536/2995] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:50 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:50.356217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ffc414ae-69b8-476a-95d2-6ea90660be6d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:50.358822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f7e1119-f7c1-4c22-9317-ef9dc9c88ba4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:50.359634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f7e1119-f7c1-4c22-9317-ef9dc9c88ba4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:50.367281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7e1119-f7c1-4c22-9317-ef9dc9c88ba4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:50.367735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7e1119-f7c1-4c22-9317-ef9dc9c88ba4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:50.368512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7e1119-f7c1-4c22-9317-ef9dc9c88ba4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:50.368991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f7e1119-f7c1-4c22-9317-ef9dc9c88ba4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:50.369168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ffc414ae-69b8-476a-95d2-6ea90660be6d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094554 May 23 14:00:50.370166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1460/2996] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:50.382490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:50.383090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:50.389608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:50.390055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:50.390816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:50.391233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:50.458682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:50.467976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:50.469503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:50.470641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2cb27be0-28a3-4f06-91f6-5bc0c36b6685 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092162 May 23 14:00:50.471191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1461/2997] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:50 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:50.553993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f7e1119-f7c1-4c22-9317-ef9dc9c88ba4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:50.562874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f7e1119-f7c1-4c22-9317-ef9dc9c88ba4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.210621 May 23 14:00:50.563442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1537/2998] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:50 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:51.153711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c70ccf71-28a1-4fc1-812c-479d7ff8f190 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:51.154868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c70ccf71-28a1-4fc1-812c-479d7ff8f190 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:51.161551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c70ccf71-28a1-4fc1-812c-479d7ff8f190 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.162004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c70ccf71-28a1-4fc1-812c-479d7ff8f190 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.162764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c70ccf71-28a1-4fc1-812c-479d7ff8f190 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.163202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c70ccf71-28a1-4fc1-812c-479d7ff8f190 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.305784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c70ccf71-28a1-4fc1-812c-479d7ff8f190 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:51.315257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c70ccf71-28a1-4fc1-812c-479d7ff8f190 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165331 May 23 14:00:51.315843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1462/2999] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:51 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:51.368620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a5e8dc78-a2f2-4024-87be-4cdaa21e7702 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:51.369522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a5e8dc78-a2f2-4024-87be-4cdaa21e7702 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:51.376934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5e8dc78-a2f2-4024-87be-4cdaa21e7702 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.377381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5e8dc78-a2f2-4024-87be-4cdaa21e7702 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.378155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5e8dc78-a2f2-4024-87be-4cdaa21e7702 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.378593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5e8dc78-a2f2-4024-87be-4cdaa21e7702 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.387209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-828b60e0-367c-4f5d-82a6-ceff66d50eb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:51.387851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-828b60e0-367c-4f5d-82a6-ceff66d50eb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:51.394144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-828b60e0-367c-4f5d-82a6-ceff66d50eb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.394598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-828b60e0-367c-4f5d-82a6-ceff66d50eb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.395372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-828b60e0-367c-4f5d-82a6-ceff66d50eb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.395814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-828b60e0-367c-4f5d-82a6-ceff66d50eb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.461797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-828b60e0-367c-4f5d-82a6-ceff66d50eb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:51.475819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-828b60e0-367c-4f5d-82a6-ceff66d50eb1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092153 May 23 14:00:51.476889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1463/3000] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:51 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:51.489038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:51.489650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:51.495724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.496172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.496974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.497409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.520832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a5e8dc78-a2f2-4024-87be-4cdaa21e7702 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:51.530182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a5e8dc78-a2f2-4024-87be-4cdaa21e7702 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165439 May 23 14:00:51.531125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1538/3001] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:51 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:51.564637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:51.578120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:51.580549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:51.580764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0bc97c29-db12-4258-a8b5-69a269bdea3c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:51.580960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8ffa692-e15e-47fd-b7c0-e2a7eb37e43f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.095724 May 23 14:00:51.581124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0bc97c29-db12-4258-a8b5-69a269bdea3c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:51.581754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1464/3002] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:51 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:51.587657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bc97c29-db12-4258-a8b5-69a269bdea3c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.588140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bc97c29-db12-4258-a8b5-69a269bdea3c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.589258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bc97c29-db12-4258-a8b5-69a269bdea3c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:51.589724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bc97c29-db12-4258-a8b5-69a269bdea3c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:51.733672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0bc97c29-db12-4258-a8b5-69a269bdea3c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:51.741795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0bc97c29-db12-4258-a8b5-69a269bdea3c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.166324 May 23 14:00:51.742366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1539/3003] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:51 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:52.333291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-85a827fe-336b-4e99-ba2e-7edd147c5e28 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:52.333902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-85a827fe-336b-4e99-ba2e-7edd147c5e28 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:52.340376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85a827fe-336b-4e99-ba2e-7edd147c5e28 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.340858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85a827fe-336b-4e99-ba2e-7edd147c5e28 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.341642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85a827fe-336b-4e99-ba2e-7edd147c5e28 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.342091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85a827fe-336b-4e99-ba2e-7edd147c5e28 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.362000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:52.485167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85a827fe-336b-4e99-ba2e-7edd147c5e28 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:52.493472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9b20ccd0-f32e-4221-b01b-67a0cbf3cd2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:52.494012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-85a827fe-336b-4e99-ba2e-7edd147c5e28 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.164058 May 23 14:00:52.494128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9b20ccd0-f32e-4221-b01b-67a0cbf3cd2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:52.494238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1465/3004] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:52 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:52.501622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b20ccd0-f32e-4221-b01b-67a0cbf3cd2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.502075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b20ccd0-f32e-4221-b01b-67a0cbf3cd2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.502843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b20ccd0-f32e-4221-b01b-67a0cbf3cd2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.503279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b20ccd0-f32e-4221-b01b-67a0cbf3cd2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.551037 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aa695ef0-7639-4cab-ae5b-d18f4c91704c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:52.551649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aa695ef0-7639-4cab-ae5b-d18f4c91704c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:52.557726 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa695ef0-7639-4cab-ae5b-d18f4c91704c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.558186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa695ef0-7639-4cab-ae5b-d18f4c91704c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.559226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa695ef0-7639-4cab-ae5b-d18f4c91704c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.559666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa695ef0-7639-4cab-ae5b-d18f4c91704c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.567072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9b20ccd0-f32e-4221-b01b-67a0cbf3cd2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:52.575038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9b20ccd0-f32e-4221-b01b-67a0cbf3cd2b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085362 May 23 14:00:52.575866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1540/3005] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:52 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:52.602227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:52.602853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:52.610180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.610637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.611415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.611862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.675861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:52.686594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:52.688078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:52.689348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f85d52b9-36e7-44ae-975d-53d07f1ff91d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091034 May 23 14:00:52.692256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1541/3006] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:52 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:52.694165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aa695ef0-7639-4cab-ae5b-d18f4c91704c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:52.702409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aa695ef0-7639-4cab-ae5b-d18f4c91704c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155201 May 23 14:00:52.703059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1466/3007] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:52 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:52.759294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f18a39bc-0abf-415e-990b-475bb80a0dd0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:52.759819 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f18a39bc-0abf-415e-990b-475bb80a0dd0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:52.765943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f18a39bc-0abf-415e-990b-475bb80a0dd0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.766389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f18a39bc-0abf-415e-990b-475bb80a0dd0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.767164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f18a39bc-0abf-415e-990b-475bb80a0dd0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:52.767596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f18a39bc-0abf-415e-990b-475bb80a0dd0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:52.938671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f18a39bc-0abf-415e-990b-475bb80a0dd0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:52.947163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f18a39bc-0abf-415e-990b-475bb80a0dd0 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.191795 May 23 14:00:52.947742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1542/3008] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:52 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:53.511950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bff8b6a0-bb8f-451a-a097-c71aa17ab34f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:53.512587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bff8b6a0-bb8f-451a-a097-c71aa17ab34f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:53.516364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:53.521787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bff8b6a0-bb8f-451a-a097-c71aa17ab34f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:53.522242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bff8b6a0-bb8f-451a-a097-c71aa17ab34f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:53.523048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bff8b6a0-bb8f-451a-a097-c71aa17ab34f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:53.523491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bff8b6a0-bb8f-451a-a097-c71aa17ab34f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:53.592504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-19582fb0-d060-4dd1-8d06-b245db7adbc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:53.593334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-19582fb0-d060-4dd1-8d06-b245db7adbc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:53.603999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19582fb0-d060-4dd1-8d06-b245db7adbc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:53.604840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19582fb0-d060-4dd1-8d06-b245db7adbc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:53.606268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19582fb0-d060-4dd1-8d06-b245db7adbc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:53.607056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19582fb0-d060-4dd1-8d06-b245db7adbc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:53.690883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bff8b6a0-bb8f-451a-a097-c71aa17ab34f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:53.706465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bff8b6a0-bb8f-451a-a097-c71aa17ab34f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.198052 May 23 14:00:53.707517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1467/3009] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:53 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:53.717857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-19582fb0-d060-4dd1-8d06-b245db7adbc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:53.727068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-19582fb0-d060-4dd1-8d06-b245db7adbc3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.139421 May 23 14:00:53.727663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1543/3010] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:53 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:53.732499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3b178d0b-466c-470c-8e8b-176cefe467df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:53.733184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3b178d0b-466c-470c-8e8b-176cefe467df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:53.740090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b178d0b-466c-470c-8e8b-176cefe467df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:53.740539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b178d0b-466c-470c-8e8b-176cefe467df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:53.741379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b178d0b-466c-470c-8e8b-176cefe467df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:53.741817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b178d0b-466c-470c-8e8b-176cefe467df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:53.746221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:53.861579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:53.867700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:53.868314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:53.868807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:53.869570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:53.869998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:53.888786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b178d0b-466c-470c-8e8b-176cefe467df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:53.897563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3b178d0b-466c-470c-8e8b-176cefe467df tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.168875 May 23 14:00:53.900504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1544/3011] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:53 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:53.936616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:53.942674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:53.944628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:53.945327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-22d87a21-d9e3-42b5-be14-03da5357f1c5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.236856 May 23 14:00:53.945882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1468/3012] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:53 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:54.079047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dedcfe28-411d-4fa7-89ca-4194c109d1d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:54.079719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dedcfe28-411d-4fa7-89ca-4194c109d1d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:54.085868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dedcfe28-411d-4fa7-89ca-4194c109d1d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.086319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dedcfe28-411d-4fa7-89ca-4194c109d1d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:54.087087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dedcfe28-411d-4fa7-89ca-4194c109d1d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.087519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dedcfe28-411d-4fa7-89ca-4194c109d1d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:54.227909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dedcfe28-411d-4fa7-89ca-4194c109d1d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:54.234478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dedcfe28-411d-4fa7-89ca-4194c109d1d9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.274236 May 23 14:00:54.235045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1545/3013] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:53 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:54.726453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52bc22dd-83c6-4dd2-93ee-9ad2deda4c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:54.727091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-52bc22dd-83c6-4dd2-93ee-9ad2deda4c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:54.733942 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bc22dd-83c6-4dd2-93ee-9ad2deda4c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.734394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bc22dd-83c6-4dd2-93ee-9ad2deda4c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:54.735207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bc22dd-83c6-4dd2-93ee-9ad2deda4c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.735646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bc22dd-83c6-4dd2-93ee-9ad2deda4c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:54.881142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a69bb93-1e61-4e9f-bd71-8141abc0213f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:54.881874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a69bb93-1e61-4e9f-bd71-8141abc0213f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:54.884940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-52bc22dd-83c6-4dd2-93ee-9ad2deda4c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:54.889245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a69bb93-1e61-4e9f-bd71-8141abc0213f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.889245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a69bb93-1e61-4e9f-bd71-8141abc0213f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:54.889989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a69bb93-1e61-4e9f-bd71-8141abc0213f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.890426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a69bb93-1e61-4e9f-bd71-8141abc0213f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:54.894107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-52bc22dd-83c6-4dd2-93ee-9ad2deda4c20 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.171706 May 23 14:00:54.894698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1469/3014] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:54 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:54.915759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7183915a-037c-446a-9480-5373971b0f38 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:54.916440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7183915a-037c-446a-9480-5373971b0f38 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:54.923634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7183915a-037c-446a-9480-5373971b0f38 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.924087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7183915a-037c-446a-9480-5373971b0f38 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:54.924893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7183915a-037c-446a-9480-5373971b0f38 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.925333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7183915a-037c-446a-9480-5373971b0f38 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:54.960242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a69bb93-1e61-4e9f-bd71-8141abc0213f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:54.964484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a69bb93-1e61-4e9f-bd71-8141abc0213f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.217990 May 23 14:00:54.965177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1546/3015] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:54 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:54.970636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:54.977286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:54.977286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.977749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:54.978587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:54.979089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:55.048195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:55.065958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:55.067641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:55.068954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c8b4f7d-a8ee-4832-a56c-6041b80ec987 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.102736 May 23 14:00:55.069642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1547/3016] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:54 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:55.253034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be6fea71-a0c0-4a44-9c37-58d28ea3fce4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:55.253685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be6fea71-a0c0-4a44-9c37-58d28ea3fce4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:55.260000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be6fea71-a0c0-4a44-9c37-58d28ea3fce4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:55.260456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be6fea71-a0c0-4a44-9c37-58d28ea3fce4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:55.261263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be6fea71-a0c0-4a44-9c37-58d28ea3fce4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:55.261706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be6fea71-a0c0-4a44-9c37-58d28ea3fce4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:55.322341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7183915a-037c-446a-9480-5373971b0f38 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:55.331900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7183915a-037c-446a-9480-5373971b0f38 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.420296 May 23 14:00:55.332477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1470/3017] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:54 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:55.397628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be6fea71-a0c0-4a44-9c37-58d28ea3fce4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:55.406307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be6fea71-a0c0-4a44-9c37-58d28ea3fce4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.157778 May 23 14:00:55.406885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1548/3018] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:55 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:55.911708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d959509-0880-451e-b221-86df67d18031 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:55.912477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d959509-0880-451e-b221-86df67d18031 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:55.922309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d959509-0880-451e-b221-86df67d18031 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:55.922766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d959509-0880-451e-b221-86df67d18031 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:55.923557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d959509-0880-451e-b221-86df67d18031 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:55.923995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d959509-0880-451e-b221-86df67d18031 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:55.983148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-30d183c5-a798-47d7-9c1f-7e6c0349a425 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:55.983757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-30d183c5-a798-47d7-9c1f-7e6c0349a425 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:55.990621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30d183c5-a798-47d7-9c1f-7e6c0349a425 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:55.991073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30d183c5-a798-47d7-9c1f-7e6c0349a425 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:55.991911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30d183c5-a798-47d7-9c1f-7e6c0349a425 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:55.992347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30d183c5-a798-47d7-9c1f-7e6c0349a425 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:56.062806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-30d183c5-a798-47d7-9c1f-7e6c0349a425 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:56.066415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d959509-0880-451e-b221-86df67d18031 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:56.071320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-30d183c5-a798-47d7-9c1f-7e6c0349a425 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092974 May 23 14:00:56.072091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1549/3019] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:55 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:56.074839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d959509-0880-451e-b221-86df67d18031 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.167118 May 23 14:00:56.075697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1471/3020] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:55 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:56.087499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:56.088112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:56.095682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:56.096133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:56.096940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:56.097381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:56.160840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:56.170472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:56.171909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:56.173652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4a62fe84-2ae3-434f-81d7-6cb01c732593 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090001 May 23 14:00:56.174211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1550/3021] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:56 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:56.350085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-516ce3ff-f7a2-470e-aae9-55cc7bb26f19 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:56.350837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-516ce3ff-f7a2-470e-aae9-55cc7bb26f19 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:56.356799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-516ce3ff-f7a2-470e-aae9-55cc7bb26f19 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:56.357247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-516ce3ff-f7a2-470e-aae9-55cc7bb26f19 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:56.357986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-516ce3ff-f7a2-470e-aae9-55cc7bb26f19 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:56.358408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-516ce3ff-f7a2-470e-aae9-55cc7bb26f19 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:56.424112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12990cec-aeaa-42c5-b044-26f2a2e0e6bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:56.424787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12990cec-aeaa-42c5-b044-26f2a2e0e6bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:56.431114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12990cec-aeaa-42c5-b044-26f2a2e0e6bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:56.431648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12990cec-aeaa-42c5-b044-26f2a2e0e6bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:56.432528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12990cec-aeaa-42c5-b044-26f2a2e0e6bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:56.432990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12990cec-aeaa-42c5-b044-26f2a2e0e6bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:56.501634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-516ce3ff-f7a2-470e-aae9-55cc7bb26f19 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:56.510473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-516ce3ff-f7a2-470e-aae9-55cc7bb26f19 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164098 May 23 14:00:56.511171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1472/3022] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:56 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:56.572944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12990cec-aeaa-42c5-b044-26f2a2e0e6bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:56.581365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12990cec-aeaa-42c5-b044-26f2a2e0e6bb tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161625 May 23 14:00:56.581944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1551/3023] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:56 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:57.087552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5927c645-ca21-4fb1-b54b-b0be6cfe1253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:57.088177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5927c645-ca21-4fb1-b54b-b0be6cfe1253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:57.094275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c0a940e-285c-4e43-a125-1b046e03c6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:57.095019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c0a940e-285c-4e43-a125-1b046e03c6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:57.096157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5927c645-ca21-4fb1-b54b-b0be6cfe1253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.096634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5927c645-ca21-4fb1-b54b-b0be6cfe1253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.097406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5927c645-ca21-4fb1-b54b-b0be6cfe1253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.097843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5927c645-ca21-4fb1-b54b-b0be6cfe1253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.102442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c0a940e-285c-4e43-a125-1b046e03c6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.102893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c0a940e-285c-4e43-a125-1b046e03c6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.103677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c0a940e-285c-4e43-a125-1b046e03c6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.104113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c0a940e-285c-4e43-a125-1b046e03c6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.163672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5927c645-ca21-4fb1-b54b-b0be6cfe1253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:57.171990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5927c645-ca21-4fb1-b54b-b0be6cfe1253 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088343 May 23 14:00:57.172602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1473/3024] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:57 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:57.191829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:57.192645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:57.204302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.205062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.206051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.207199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.240973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c0a940e-285c-4e43-a125-1b046e03c6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:57.249808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c0a940e-285c-4e43-a125-1b046e03c6c8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160198 May 23 14:00:57.250430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1552/3025] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:57 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:57.272399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:57.281533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:57.283129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:57.284276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b9f4a13a-e0c9-4836-bea6-d761ac3a4634 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.096505 May 23 14:00:57.284877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1474/3026] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:57 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:57.529220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f0a92422-4f22-43b6-a799-7a5634866a58 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:57.530511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f0a92422-4f22-43b6-a799-7a5634866a58 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:57.532436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:00:57.537525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0a92422-4f22-43b6-a799-7a5634866a58 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.537971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0a92422-4f22-43b6-a799-7a5634866a58 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.538801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0a92422-4f22-43b6-a799-7a5634866a58 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.539240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f0a92422-4f22-43b6-a799-7a5634866a58 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.599277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae57dee7-7514-4ecd-859e-78451a338e63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:57.599895 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae57dee7-7514-4ecd-859e-78451a338e63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:57.606174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae57dee7-7514-4ecd-859e-78451a338e63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.606678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae57dee7-7514-4ecd-859e-78451a338e63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.608106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae57dee7-7514-4ecd-859e-78451a338e63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:57.608537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae57dee7-7514-4ecd-859e-78451a338e63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:57.695669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f0a92422-4f22-43b6-a799-7a5634866a58 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:57.708482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f0a92422-4f22-43b6-a799-7a5634866a58 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.183710 May 23 14:00:57.709293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1553/3027] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:57 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:57.761190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae57dee7-7514-4ecd-859e-78451a338e63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:57.769981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae57dee7-7514-4ecd-859e-78451a338e63 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.174496 May 23 14:00:57.770567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1475/3028] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:57 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:58.189933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f6409ac-988b-491f-a24b-61ca3bf72583 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:58.190553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f6409ac-988b-491f-a24b-61ca3bf72583 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:58.197231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f6409ac-988b-491f-a24b-61ca3bf72583 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.197612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f6409ac-988b-491f-a24b-61ca3bf72583 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.198381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f6409ac-988b-491f-a24b-61ca3bf72583 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.198826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f6409ac-988b-491f-a24b-61ca3bf72583 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.261964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f6409ac-988b-491f-a24b-61ca3bf72583 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:58.267181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06e02ea5-3174-4c3b-bd7e-8616a22ad5aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:58.267788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06e02ea5-3174-4c3b-bd7e-8616a22ad5aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:58.270482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f6409ac-988b-491f-a24b-61ca3bf72583 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085085 May 23 14:00:58.271068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1554/3029] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:58 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:58.274506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06e02ea5-3174-4c3b-bd7e-8616a22ad5aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.274950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06e02ea5-3174-4c3b-bd7e-8616a22ad5aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.275705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06e02ea5-3174-4c3b-bd7e-8616a22ad5aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.276133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06e02ea5-3174-4c3b-bd7e-8616a22ad5aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.302782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:58.303389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:58.309764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.310223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.310984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.311431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.385790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:58.394876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:58.396380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:58.397564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1dc25ff3-9fe2-4d9f-898e-72bf21bb327e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098701 May 23 14:00:58.398128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1555/3030] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:58 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:00:58.429116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06e02ea5-3174-4c3b-bd7e-8616a22ad5aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:58.437428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06e02ea5-3174-4c3b-bd7e-8616a22ad5aa tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.174284 May 23 14:00:58.437986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1476/3031] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:58 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:58.726308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-406fade0-9dd2-4d93-a3fe-aecf28bb0ad5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:58.726927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-406fade0-9dd2-4d93-a3fe-aecf28bb0ad5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:58.733146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-406fade0-9dd2-4d93-a3fe-aecf28bb0ad5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.733598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-406fade0-9dd2-4d93-a3fe-aecf28bb0ad5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.734358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-406fade0-9dd2-4d93-a3fe-aecf28bb0ad5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.734795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-406fade0-9dd2-4d93-a3fe-aecf28bb0ad5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.787576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c237e456-6f63-4fea-b04a-15b6ecfa631b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:58.788185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c237e456-6f63-4fea-b04a-15b6ecfa631b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:58.794481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c237e456-6f63-4fea-b04a-15b6ecfa631b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.795118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c237e456-6f63-4fea-b04a-15b6ecfa631b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.795958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c237e456-6f63-4fea-b04a-15b6ecfa631b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:58.796397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c237e456-6f63-4fea-b04a-15b6ecfa631b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:58.867553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-406fade0-9dd2-4d93-a3fe-aecf28bb0ad5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:58.876550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-406fade0-9dd2-4d93-a3fe-aecf28bb0ad5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.154107 May 23 14:00:58.877158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1556/3032] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:58 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:58.926092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c237e456-6f63-4fea-b04a-15b6ecfa631b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:58.934342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c237e456-6f63-4fea-b04a-15b6ecfa631b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.150636 May 23 14:00:58.935409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1477/3033] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:58 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:59.287798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97701fa8-d0f9-4ad4-af67-a9f2fec35a32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:59.288406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97701fa8-d0f9-4ad4-af67-a9f2fec35a32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:59.295573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97701fa8-d0f9-4ad4-af67-a9f2fec35a32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.296031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97701fa8-d0f9-4ad4-af67-a9f2fec35a32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:59.296836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97701fa8-d0f9-4ad4-af67-a9f2fec35a32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.297274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97701fa8-d0f9-4ad4-af67-a9f2fec35a32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:59.362772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97701fa8-d0f9-4ad4-af67-a9f2fec35a32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:59.370733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97701fa8-d0f9-4ad4-af67-a9f2fec35a32 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086793 May 23 14:00:59.371308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1557/3034] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:59 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:00:59.416214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:59.416852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:59.424250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.424731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:59.425487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.425916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:59.455020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-380433ce-bc5e-4869-a1d5-43934152daf4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:59.455566 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-380433ce-bc5e-4869-a1d5-43934152daf4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:59.461902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-380433ce-bc5e-4869-a1d5-43934152daf4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.462355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-380433ce-bc5e-4869-a1d5-43934152daf4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:59.463166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-380433ce-bc5e-4869-a1d5-43934152daf4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.463608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-380433ce-bc5e-4869-a1d5-43934152daf4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:59.494471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:59.504182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:59.505722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:59.506877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7421da35-e856-4d43-9f8a-46193452f0ee tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094532 May 23 14:00:59.507443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1478/3035] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:00:59 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:00:59.603388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-380433ce-bc5e-4869-a1d5-43934152daf4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:00:59.612521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-380433ce-bc5e-4869-a1d5-43934152daf4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161704 May 23 14:00:59.613135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1558/3036] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:59 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:00:59.893900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-01e18c19-48cb-4df0-a331-37aead17d0eb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:59.894521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-01e18c19-48cb-4df0-a331-37aead17d0eb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:59.901170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01e18c19-48cb-4df0-a331-37aead17d0eb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.901626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01e18c19-48cb-4df0-a331-37aead17d0eb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:59.902395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01e18c19-48cb-4df0-a331-37aead17d0eb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.902835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-01e18c19-48cb-4df0-a331-37aead17d0eb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:59.951362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f7af55f-c80d-4afa-9d56-fee55a1d75ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:00:59.952213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f7af55f-c80d-4afa-9d56-fee55a1d75ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:00:59.958658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f7af55f-c80d-4afa-9d56-fee55a1d75ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.959162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f7af55f-c80d-4afa-9d56-fee55a1d75ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:00:59.959906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f7af55f-c80d-4afa-9d56-fee55a1d75ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:00:59.960317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f7af55f-c80d-4afa-9d56-fee55a1d75ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:00.040775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-01e18c19-48cb-4df0-a331-37aead17d0eb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:00.049533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-01e18c19-48cb-4df0-a331-37aead17d0eb tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159573 May 23 14:01:00.050113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1479/3037] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:59 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:00.101419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f7af55f-c80d-4afa-9d56-fee55a1d75ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:00.109401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f7af55f-c80d-4afa-9d56-fee55a1d75ad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161924 May 23 14:01:00.109968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1559/3038] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:00:59 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:00.389387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-884ff0a7-0647-4384-89ab-8791f4b6f0e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:00.389997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-884ff0a7-0647-4384-89ab-8791f4b6f0e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:00.396039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-884ff0a7-0647-4384-89ab-8791f4b6f0e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:00.396488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-884ff0a7-0647-4384-89ab-8791f4b6f0e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:00.397281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-884ff0a7-0647-4384-89ab-8791f4b6f0e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:00.397758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-884ff0a7-0647-4384-89ab-8791f4b6f0e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:00.461978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-884ff0a7-0647-4384-89ab-8791f4b6f0e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:00.470475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-884ff0a7-0647-4384-89ab-8791f4b6f0e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085819 May 23 14:01:00.471051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1480/3039] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:00 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:00.525020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:00.525637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:00.533369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:00.533848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:00.534670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:00.535129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:00.601689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:00.607750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:00.614222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:00.616004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:00.617250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-81db8132-9573-45a3-a93f-b89037f368f1 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.096143 May 23 14:01:00.617878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1560/3040] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:00 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:00.630206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da50cbab-e85d-491a-bee6-36ea73a86b2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:00.630818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da50cbab-e85d-491a-bee6-36ea73a86b2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:00.636981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da50cbab-e85d-491a-bee6-36ea73a86b2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:00.637441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da50cbab-e85d-491a-bee6-36ea73a86b2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:00.639466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da50cbab-e85d-491a-bee6-36ea73a86b2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:00.639924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da50cbab-e85d-491a-bee6-36ea73a86b2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:00.784316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da50cbab-e85d-491a-bee6-36ea73a86b2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:00.793221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da50cbab-e85d-491a-bee6-36ea73a86b2b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.166753 May 23 14:01:00.793789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1481/3041] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:00 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:01.066844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d18595a0-4624-4bab-83d9-0b656f852a6c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:01.067463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d18595a0-4624-4bab-83d9-0b656f852a6c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:01.074146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18595a0-4624-4bab-83d9-0b656f852a6c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.074597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18595a0-4624-4bab-83d9-0b656f852a6c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.076005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18595a0-4624-4bab-83d9-0b656f852a6c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.076554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d18595a0-4624-4bab-83d9-0b656f852a6c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.127258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-50d4824d-aa3f-40f2-84a4-118959a2e6fe tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:01.127874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-50d4824d-aa3f-40f2-84a4-118959a2e6fe tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:01.134554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50d4824d-aa3f-40f2-84a4-118959a2e6fe tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.135039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50d4824d-aa3f-40f2-84a4-118959a2e6fe tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.135805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50d4824d-aa3f-40f2-84a4-118959a2e6fe tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.136237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50d4824d-aa3f-40f2-84a4-118959a2e6fe tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.141485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:01.213787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d18595a0-4624-4bab-83d9-0b656f852a6c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:01.222826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d18595a0-4624-4bab-83d9-0b656f852a6c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160083 May 23 14:01:01.223692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1561/3042] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:01 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:01.269347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-50d4824d-aa3f-40f2-84a4-118959a2e6fe tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:01.277152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-50d4824d-aa3f-40f2-84a4-118959a2e6fe tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153792 May 23 14:01:01.277720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1482/3043] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:01 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:01.487902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d1516d4a-16d1-443d-9dab-bb720f52ac79 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:01.488520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d1516d4a-16d1-443d-9dab-bb720f52ac79 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:01.494839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1516d4a-16d1-443d-9dab-bb720f52ac79 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.495297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1516d4a-16d1-443d-9dab-bb720f52ac79 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.496065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1516d4a-16d1-443d-9dab-bb720f52ac79 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.496508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1516d4a-16d1-443d-9dab-bb720f52ac79 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.565338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d1516d4a-16d1-443d-9dab-bb720f52ac79 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:01.573323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d1516d4a-16d1-443d-9dab-bb720f52ac79 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089276 May 23 14:01:01.573911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1562/3044] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:01 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:01.636204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:01.636990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:01.643915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.644362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.645145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.645577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.709285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:01.718910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:01.720420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:01.722501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e13c5a10-49d7-48de-ba56-df9b446e1b2e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089336 May 23 14:01:01.722501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1483/3045] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:01 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:01.810761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-41419a2d-864a-4088-9ea0-28e881d3bf9a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:01.811296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-41419a2d-864a-4088-9ea0-28e881d3bf9a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:01.817800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41419a2d-864a-4088-9ea0-28e881d3bf9a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.818251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41419a2d-864a-4088-9ea0-28e881d3bf9a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.819033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41419a2d-864a-4088-9ea0-28e881d3bf9a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:01.819515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41419a2d-864a-4088-9ea0-28e881d3bf9a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:01.961033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-41419a2d-864a-4088-9ea0-28e881d3bf9a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:01.969828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-41419a2d-864a-4088-9ea0-28e881d3bf9a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163252 May 23 14:01:01.970424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1563/3046] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:01 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:02.240419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f08ca96-46c0-453c-8412-73e8477dc97b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:02.241047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f08ca96-46c0-453c-8412-73e8477dc97b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:02.248073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f08ca96-46c0-453c-8412-73e8477dc97b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.248518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f08ca96-46c0-453c-8412-73e8477dc97b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:02.249301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f08ca96-46c0-453c-8412-73e8477dc97b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.249741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f08ca96-46c0-453c-8412-73e8477dc97b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:02.295935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1063d55f-01ba-419a-9614-97cf37191cfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:02.296557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1063d55f-01ba-419a-9614-97cf37191cfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:02.303411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1063d55f-01ba-419a-9614-97cf37191cfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.303855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1063d55f-01ba-419a-9614-97cf37191cfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:02.304677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1063d55f-01ba-419a-9614-97cf37191cfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.305339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1063d55f-01ba-419a-9614-97cf37191cfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:02.398870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f08ca96-46c0-453c-8412-73e8477dc97b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:02.407643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f08ca96-46c0-453c-8412-73e8477dc97b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.171060 May 23 14:01:02.408229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1484/3047] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:02 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:02.456518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1063d55f-01ba-419a-9614-97cf37191cfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:02.464701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1063d55f-01ba-419a-9614-97cf37191cfd tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.173580 May 23 14:01:02.465284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1564/3048] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:02 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:02.591909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-996d0223-ddbb-4490-9d00-859782d930d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:02.592522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-996d0223-ddbb-4490-9d00-859782d930d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:02.598997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-996d0223-ddbb-4490-9d00-859782d930d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.599449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-996d0223-ddbb-4490-9d00-859782d930d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:02.600211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-996d0223-ddbb-4490-9d00-859782d930d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.600710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-996d0223-ddbb-4490-9d00-859782d930d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:02.674076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-996d0223-ddbb-4490-9d00-859782d930d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:02.682609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-996d0223-ddbb-4490-9d00-859782d930d2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.095129 May 23 14:01:02.683190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1485/3049] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:02 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:02.739636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:02.740196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:02.747146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.747640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:02.748414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.748883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:02.815790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:02.824254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:02.826415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:02.827593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9c9a87e9-8d7d-400f-9c7e-cf482407a73c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092066 May 23 14:01:02.828156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1565/3050] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:02 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:02.988595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e8cb46d-1de6-4bcf-a98b-ae6f21470e38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:02.989207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e8cb46d-1de6-4bcf-a98b-ae6f21470e38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:02.995824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8cb46d-1de6-4bcf-a98b-ae6f21470e38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.996181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8cb46d-1de6-4bcf-a98b-ae6f21470e38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:02.997553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8cb46d-1de6-4bcf-a98b-ae6f21470e38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:02.997963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8cb46d-1de6-4bcf-a98b-ae6f21470e38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:03.142932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0e8cb46d-1de6-4bcf-a98b-ae6f21470e38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:03.151306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e8cb46d-1de6-4bcf-a98b-ae6f21470e38 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.167188 May 23 14:01:03.151896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1486/3051] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:02 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:03.425589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ded9f3f8-3074-4c6d-aa89-d34e860c2715 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:03.426287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ded9f3f8-3074-4c6d-aa89-d34e860c2715 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:03.432529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded9f3f8-3074-4c6d-aa89-d34e860c2715 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:03.433004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded9f3f8-3074-4c6d-aa89-d34e860c2715 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:03.434064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded9f3f8-3074-4c6d-aa89-d34e860c2715 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:03.434592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded9f3f8-3074-4c6d-aa89-d34e860c2715 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:03.483062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6cb5c330-4cf4-4209-8145-ad9d4e63bb0c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:03.483668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6cb5c330-4cf4-4209-8145-ad9d4e63bb0c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:03.490483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cb5c330-4cf4-4209-8145-ad9d4e63bb0c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:03.490928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cb5c330-4cf4-4209-8145-ad9d4e63bb0c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:03.491686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cb5c330-4cf4-4209-8145-ad9d4e63bb0c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:03.492115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cb5c330-4cf4-4209-8145-ad9d4e63bb0c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:03.577972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ded9f3f8-3074-4c6d-aa89-d34e860c2715 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:03.586045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ded9f3f8-3074-4c6d-aa89-d34e860c2715 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164617 May 23 14:01:03.586621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1566/3052] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:03 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:03.641539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6cb5c330-4cf4-4209-8145-ad9d4e63bb0c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:03.649660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6cb5c330-4cf4-4209-8145-ad9d4e63bb0c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.171106 May 23 14:01:03.650229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1487/3053] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:03 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:03.701589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a1e2a0e-40c6-48df-a38c-5caaafecbafd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:03.702127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a1e2a0e-40c6-48df-a38c-5caaafecbafd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:03.708514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a1e2a0e-40c6-48df-a38c-5caaafecbafd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:03.709021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a1e2a0e-40c6-48df-a38c-5caaafecbafd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:03.709805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a1e2a0e-40c6-48df-a38c-5caaafecbafd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:03.710239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a1e2a0e-40c6-48df-a38c-5caaafecbafd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:03.775108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a1e2a0e-40c6-48df-a38c-5caaafecbafd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:03.783345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a1e2a0e-40c6-48df-a38c-5caaafecbafd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086624 May 23 14:01:03.783914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1567/3054] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:03 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:03.847032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:03.847649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:03.853793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:03.854245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:03.855024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:03.855454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:03.922316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:03.931201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:03.932764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:03.934197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b6ad4cf3-b107-4506-a2b5-b4b2192b6226 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091134 May 23 14:01:03.934760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1488/3055] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:03 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:04.169400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a22308f6-fc44-4237-a96b-eb0e82e64ecc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:04.170091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a22308f6-fc44-4237-a96b-eb0e82e64ecc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:04.176545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a22308f6-fc44-4237-a96b-eb0e82e64ecc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.177030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a22308f6-fc44-4237-a96b-eb0e82e64ecc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:04.177808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a22308f6-fc44-4237-a96b-eb0e82e64ecc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.178248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a22308f6-fc44-4237-a96b-eb0e82e64ecc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:04.316235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a22308f6-fc44-4237-a96b-eb0e82e64ecc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:04.324890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a22308f6-fc44-4237-a96b-eb0e82e64ecc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159497 May 23 14:01:04.326336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1568/3056] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:04 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:04.604227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5e9f5d72-7932-499f-8412-aa9c564518a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:04.604859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5e9f5d72-7932-499f-8412-aa9c564518a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:04.612172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e9f5d72-7932-499f-8412-aa9c564518a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.612654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e9f5d72-7932-499f-8412-aa9c564518a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:04.613411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e9f5d72-7932-499f-8412-aa9c564518a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.613843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5e9f5d72-7932-499f-8412-aa9c564518a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:04.668065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4c0277d3-ba78-4e2f-a6f8-a5d1dac04f7b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:04.669311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4c0277d3-ba78-4e2f-a6f8-a5d1dac04f7b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:04.676143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c0277d3-ba78-4e2f-a6f8-a5d1dac04f7b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.676697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c0277d3-ba78-4e2f-a6f8-a5d1dac04f7b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:04.677483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c0277d3-ba78-4e2f-a6f8-a5d1dac04f7b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.677921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c0277d3-ba78-4e2f-a6f8-a5d1dac04f7b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:04.756588 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5e9f5d72-7932-499f-8412-aa9c564518a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:04.765264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5e9f5d72-7932-499f-8412-aa9c564518a4 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165183 May 23 14:01:04.765845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1489/3057] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:04 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:04.800983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7dfd701-9622-4f9c-9b6b-30c09b90b109 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:04.801756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7dfd701-9622-4f9c-9b6b-30c09b90b109 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:04.808008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7dfd701-9622-4f9c-9b6b-30c09b90b109 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.808760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7dfd701-9622-4f9c-9b6b-30c09b90b109 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:04.810283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7dfd701-9622-4f9c-9b6b-30c09b90b109 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.810731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7dfd701-9622-4f9c-9b6b-30c09b90b109 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:04.829745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4c0277d3-ba78-4e2f-a6f8-a5d1dac04f7b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:04.837802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4c0277d3-ba78-4e2f-a6f8-a5d1dac04f7b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.173814 May 23 14:01:04.838387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1569/3058] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:04 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:04.881642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7dfd701-9622-4f9c-9b6b-30c09b90b109 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:04.889094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7dfd701-9622-4f9c-9b6b-30c09b90b109 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091916 May 23 14:01:04.889682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1490/3059] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:04 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:04.952269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:04.952921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:04.961778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.961778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:04.961778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:04.961778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:05.030042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:05.039763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:05.042271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:05.044013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ffa4ce25-a140-49ad-a7bd-e6842900ba28 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.096104 May 23 14:01:05.044964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1570/3060] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:04 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:05.343671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dcf53cd8-51f5-4c45-8fd1-4b01ca4de385 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:05.344299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dcf53cd8-51f5-4c45-8fd1-4b01ca4de385 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:05.350810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcf53cd8-51f5-4c45-8fd1-4b01ca4de385 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:05.351294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcf53cd8-51f5-4c45-8fd1-4b01ca4de385 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:05.352081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcf53cd8-51f5-4c45-8fd1-4b01ca4de385 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:05.353083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcf53cd8-51f5-4c45-8fd1-4b01ca4de385 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:05.493480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcf53cd8-51f5-4c45-8fd1-4b01ca4de385 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:05.501804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dcf53cd8-51f5-4c45-8fd1-4b01ca4de385 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162209 May 23 14:01:05.502354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1491/3061] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:05 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:05.783620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bef08aaa-bfbd-43b7-b7b2-a8da11630610 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:05.784139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bef08aaa-bfbd-43b7-b7b2-a8da11630610 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:05.791718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bef08aaa-bfbd-43b7-b7b2-a8da11630610 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:05.792226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bef08aaa-bfbd-43b7-b7b2-a8da11630610 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:05.793243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bef08aaa-bfbd-43b7-b7b2-a8da11630610 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:05.793805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bef08aaa-bfbd-43b7-b7b2-a8da11630610 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:05.855149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d7e49ba-3aaf-4aa7-b912-8f49f852e415 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:05.855929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d7e49ba-3aaf-4aa7-b912-8f49f852e415 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:05.863540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d7e49ba-3aaf-4aa7-b912-8f49f852e415 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:05.864134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d7e49ba-3aaf-4aa7-b912-8f49f852e415 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:05.865103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d7e49ba-3aaf-4aa7-b912-8f49f852e415 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:05.865717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d7e49ba-3aaf-4aa7-b912-8f49f852e415 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:05.938802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bef08aaa-bfbd-43b7-b7b2-a8da11630610 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:05.947215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bef08aaa-bfbd-43b7-b7b2-a8da11630610 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.167705 May 23 14:01:05.948023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1571/3062] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:05 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:05.953876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c352cf23-04a8-49ce-b372-748f0b6e5a35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:05.954508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c352cf23-04a8-49ce-b372-748f0b6e5a35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:05.963311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c352cf23-04a8-49ce-b372-748f0b6e5a35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:05.963774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c352cf23-04a8-49ce-b372-748f0b6e5a35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:05.964559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c352cf23-04a8-49ce-b372-748f0b6e5a35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:05.965039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c352cf23-04a8-49ce-b372-748f0b6e5a35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:06.010333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d7e49ba-3aaf-4aa7-b912-8f49f852e415 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:06.020080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d7e49ba-3aaf-4aa7-b912-8f49f852e415 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.168739 May 23 14:01:06.020687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1492/3063] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:05 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:06.032947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c352cf23-04a8-49ce-b372-748f0b6e5a35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:06.041596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c352cf23-04a8-49ce-b372-748f0b6e5a35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092612 May 23 14:01:06.042232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1572/3064] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:05 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:06.066304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:06.066912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:06.073295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:06.073748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:06.074519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:06.075148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:06.148637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:06.157921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:06.159432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:06.160607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cefab8ff-97bd-4734-8ef5-066aede8c8fe tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098266 May 23 14:01:06.161184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1493/3065] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:06 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:06.519390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-979589ed-100c-4ae0-8a51-9afdc024c2f1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:06.520005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-979589ed-100c-4ae0-8a51-9afdc024c2f1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:06.526191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-979589ed-100c-4ae0-8a51-9afdc024c2f1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:06.526645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-979589ed-100c-4ae0-8a51-9afdc024c2f1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:06.527409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-979589ed-100c-4ae0-8a51-9afdc024c2f1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:06.527838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-979589ed-100c-4ae0-8a51-9afdc024c2f1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:06.666607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-979589ed-100c-4ae0-8a51-9afdc024c2f1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:06.677087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-979589ed-100c-4ae0-8a51-9afdc024c2f1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161411 May 23 14:01:06.677681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1573/3066] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:06 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:06.965521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04cc772e-5245-4e3c-9012-6b9630346a2f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:06.966401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04cc772e-5245-4e3c-9012-6b9630346a2f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:06.974746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04cc772e-5245-4e3c-9012-6b9630346a2f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:06.975192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04cc772e-5245-4e3c-9012-6b9630346a2f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:06.978138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04cc772e-5245-4e3c-9012-6b9630346a2f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:06.978628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04cc772e-5245-4e3c-9012-6b9630346a2f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:07.039766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5411f6c9-6c51-4a95-aa67-2b33f6da8316 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:07.040381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5411f6c9-6c51-4a95-aa67-2b33f6da8316 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:07.050613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5411f6c9-6c51-4a95-aa67-2b33f6da8316 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:07.051061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5411f6c9-6c51-4a95-aa67-2b33f6da8316 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:07.051847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5411f6c9-6c51-4a95-aa67-2b33f6da8316 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:07.052342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5411f6c9-6c51-4a95-aa67-2b33f6da8316 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:07.145754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04cc772e-5245-4e3c-9012-6b9630346a2f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:07.159108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04cc772e-5245-4e3c-9012-6b9630346a2f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.197309 May 23 14:01:07.160133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1494/3067] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:06 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:07.165140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56efb4ae-cdaa-4c38-b580-78b96fb1ef7c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:07.165896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56efb4ae-cdaa-4c38-b580-78b96fb1ef7c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:07.173360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56efb4ae-cdaa-4c38-b580-78b96fb1ef7c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:07.174159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56efb4ae-cdaa-4c38-b580-78b96fb1ef7c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:07.175148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56efb4ae-cdaa-4c38-b580-78b96fb1ef7c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:07.175749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56efb4ae-cdaa-4c38-b580-78b96fb1ef7c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:07.241865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5411f6c9-6c51-4a95-aa67-2b33f6da8316 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:07.251039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5411f6c9-6c51-4a95-aa67-2b33f6da8316 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.216223 May 23 14:01:07.251219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56efb4ae-cdaa-4c38-b580-78b96fb1ef7c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:07.256615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1574/3068] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:07 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:07.256615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:07.257095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:07.260840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56efb4ae-cdaa-4c38-b580-78b96fb1ef7c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.099336 May 23 14:01:07.261601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1495/3069] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:07 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:07.263115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:07.263538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:07.264310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:07.264901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:07.327962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:07.336767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:07.338317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:07.339511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6303bf53-7a2d-4c06-b3ff-07f83b8cb45b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.086629 May 23 14:01:07.340091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1575/3070] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:07 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:07.695250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6cc56202-1d85-477d-acb0-80108e48b2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:07.695867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6cc56202-1d85-477d-acb0-80108e48b2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:07.702091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cc56202-1d85-477d-acb0-80108e48b2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:07.703214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cc56202-1d85-477d-acb0-80108e48b2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:07.704016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cc56202-1d85-477d-acb0-80108e48b2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:07.704455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cc56202-1d85-477d-acb0-80108e48b2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:07.840278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6cc56202-1d85-477d-acb0-80108e48b2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:07.849275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6cc56202-1d85-477d-acb0-80108e48b2df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157893 May 23 14:01:07.849846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1496/3071] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:07 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:08.177659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a90a7435-7a83-4dc9-a45d-46c821d431cf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:08.178346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a90a7435-7a83-4dc9-a45d-46c821d431cf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:08.185412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a90a7435-7a83-4dc9-a45d-46c821d431cf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.185862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a90a7435-7a83-4dc9-a45d-46c821d431cf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:08.186954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a90a7435-7a83-4dc9-a45d-46c821d431cf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.187475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a90a7435-7a83-4dc9-a45d-46c821d431cf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:08.267898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-37a6363c-5792-4d9e-bdf3-ba00265b28ba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:08.268456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-37a6363c-5792-4d9e-bdf3-ba00265b28ba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:08.275192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37a6363c-5792-4d9e-bdf3-ba00265b28ba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.275635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37a6363c-5792-4d9e-bdf3-ba00265b28ba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:08.276389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37a6363c-5792-4d9e-bdf3-ba00265b28ba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.276840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37a6363c-5792-4d9e-bdf3-ba00265b28ba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:08.325645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a90a7435-7a83-4dc9-a45d-46c821d431cf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:08.334539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a90a7435-7a83-4dc9-a45d-46c821d431cf tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160663 May 23 14:01:08.335100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1576/3072] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:08 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:08.347531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e711510-b33c-4024-bbc6-5b38b143f738 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:08.348163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e711510-b33c-4024-bbc6-5b38b143f738 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:08.354862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e711510-b33c-4024-bbc6-5b38b143f738 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.355443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e711510-b33c-4024-bbc6-5b38b143f738 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:08.356163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e711510-b33c-4024-bbc6-5b38b143f738 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.356510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e711510-b33c-4024-bbc6-5b38b143f738 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:08.378197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:08.414188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-37a6363c-5792-4d9e-bdf3-ba00265b28ba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:08.423289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-37a6363c-5792-4d9e-bdf3-ba00265b28ba tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159882 May 23 14:01:08.424083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1497/3073] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:08 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:08.428697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:08.429242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e711510-b33c-4024-bbc6-5b38b143f738 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:08.429411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:08.435932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.436384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:08.437787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.438235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:08.438405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e711510-b33c-4024-bbc6-5b38b143f738 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.096347 May 23 14:01:08.439020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1577/3074] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:08 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:08.506506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:08.509976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:08.516600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:08.518206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:08.519298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d3d3546e-c5c8-48e6-8f96-d26e2c64518e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094262 May 23 14:01:08.519860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1498/3075] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:08 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:08.867437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec818eb4-be51-4cdb-856c-ecf3146595b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:08.868094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec818eb4-be51-4cdb-856c-ecf3146595b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:08.874809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec818eb4-be51-4cdb-856c-ecf3146595b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.875265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec818eb4-be51-4cdb-856c-ecf3146595b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:08.876033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec818eb4-be51-4cdb-856c-ecf3146595b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:08.876475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec818eb4-be51-4cdb-856c-ecf3146595b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:09.012523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec818eb4-be51-4cdb-856c-ecf3146595b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:09.020847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec818eb4-be51-4cdb-856c-ecf3146595b8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157197 May 23 14:01:09.021603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1578/3076] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:08 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:09.352488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e91bdbcf-6fb8-4733-a51c-9687cc341d86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:09.353115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e91bdbcf-6fb8-4733-a51c-9687cc341d86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:09.361071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e91bdbcf-6fb8-4733-a51c-9687cc341d86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:09.361522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e91bdbcf-6fb8-4733-a51c-9687cc341d86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:09.362338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e91bdbcf-6fb8-4733-a51c-9687cc341d86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:09.362793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e91bdbcf-6fb8-4733-a51c-9687cc341d86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:09.443687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-72c95bf5-f46f-4778-87f7-16f710e4ffad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:09.444272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-72c95bf5-f46f-4778-87f7-16f710e4ffad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:09.451755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72c95bf5-f46f-4778-87f7-16f710e4ffad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:09.457076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72c95bf5-f46f-4778-87f7-16f710e4ffad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:09.457076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72c95bf5-f46f-4778-87f7-16f710e4ffad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:09.457076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72c95bf5-f46f-4778-87f7-16f710e4ffad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:09.499975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e91bdbcf-6fb8-4733-a51c-9687cc341d86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:09.508298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e91bdbcf-6fb8-4733-a51c-9687cc341d86 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159808 May 23 14:01:09.508916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1499/3077] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:09 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:09.513584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c05250fb-8e81-4c6f-bd30-a49e3ced7ff8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:09.514192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c05250fb-8e81-4c6f-bd30-a49e3ced7ff8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:09.521070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05250fb-8e81-4c6f-bd30-a49e3ced7ff8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:09.521522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05250fb-8e81-4c6f-bd30-a49e3ced7ff8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:09.522300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05250fb-8e81-4c6f-bd30-a49e3ced7ff8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:09.522766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05250fb-8e81-4c6f-bd30-a49e3ced7ff8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:09.598000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c05250fb-8e81-4c6f-bd30-a49e3ced7ff8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:09.607080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c05250fb-8e81-4c6f-bd30-a49e3ced7ff8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.097128 May 23 14:01:09.607745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1500/3078] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:09 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:09.609970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-72c95bf5-f46f-4778-87f7-16f710e4ffad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:09.613386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:09.614071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:09.620419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:09.620913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:09.621681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:09.622109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:09.625037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-72c95bf5-f46f-4778-87f7-16f710e4ffad tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.185924 May 23 14:01:09.626105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1579/3079] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:09 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:09.687584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:09.697635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:09.699114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:09.700302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7b99a361-6f6f-439b-a22c-a7a1d533dc52 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091568 May 23 14:01:09.700915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1501/3080] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:09 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:10.038181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-427a75b2-cbab-4a6f-b933-392e58f94762 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:10.038802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-427a75b2-cbab-4a6f-b933-392e58f94762 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:10.044960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-427a75b2-cbab-4a6f-b933-392e58f94762 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.045400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-427a75b2-cbab-4a6f-b933-392e58f94762 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.046205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-427a75b2-cbab-4a6f-b933-392e58f94762 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.046855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-427a75b2-cbab-4a6f-b933-392e58f94762 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.185728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-427a75b2-cbab-4a6f-b933-392e58f94762 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:10.194672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-427a75b2-cbab-4a6f-b933-392e58f94762 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160479 May 23 14:01:10.195241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1580/3081] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:10 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:10.526129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d8bdab48-ba03-4787-8125-0913ca821c29 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:10.526751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d8bdab48-ba03-4787-8125-0913ca821c29 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:10.534146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8bdab48-ba03-4787-8125-0913ca821c29 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.534604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8bdab48-ba03-4787-8125-0913ca821c29 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.535376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8bdab48-ba03-4787-8125-0913ca821c29 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.535811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8bdab48-ba03-4787-8125-0913ca821c29 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.625823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f3d8c24-fd96-4edd-b02a-36b96ea701bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:10.626446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f3d8c24-fd96-4edd-b02a-36b96ea701bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:10.633271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f3d8c24-fd96-4edd-b02a-36b96ea701bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.633736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f3d8c24-fd96-4edd-b02a-36b96ea701bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.634518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f3d8c24-fd96-4edd-b02a-36b96ea701bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.634956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f3d8c24-fd96-4edd-b02a-36b96ea701bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.677902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d8bdab48-ba03-4787-8125-0913ca821c29 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:10.687237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d8bdab48-ba03-4787-8125-0913ca821c29 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.164324 May 23 14:01:10.700801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1502/3082] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:10 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:10.700801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f11dedd4-7385-4692-bb6a-efc8c6f18f28 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:10.700801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f11dedd4-7385-4692-bb6a-efc8c6f18f28 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:10.701693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f3d8c24-fd96-4edd-b02a-36b96ea701bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:10.701834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11dedd4-7385-4692-bb6a-efc8c6f18f28 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.701834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11dedd4-7385-4692-bb6a-efc8c6f18f28 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.701834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11dedd4-7385-4692-bb6a-efc8c6f18f28 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.702245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f11dedd4-7385-4692-bb6a-efc8c6f18f28 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.707617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f3d8c24-fd96-4edd-b02a-36b96ea701bb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086208 May 23 14:01:10.708295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1581/3083] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:10 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:10.721194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:10.721807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:10.728073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.728522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.729397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:10.729926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:10.796682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:10.806078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:10.807574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:10.809044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f53ce7fb-3727-41a3-8823-83b652262293 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091927 May 23 14:01:10.809606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1582/3084] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:10 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:10.846500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f11dedd4-7385-4692-bb6a-efc8c6f18f28 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:10.854806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f11dedd4-7385-4692-bb6a-efc8c6f18f28 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.165930 May 23 14:01:10.855373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1503/3085] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:10 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:11.212822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-42fa2b8f-5fb7-4c50-a592-be7f84fe1290 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:11.213448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-42fa2b8f-5fb7-4c50-a592-be7f84fe1290 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:11.220746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42fa2b8f-5fb7-4c50-a592-be7f84fe1290 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.221204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42fa2b8f-5fb7-4c50-a592-be7f84fe1290 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.221976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42fa2b8f-5fb7-4c50-a592-be7f84fe1290 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.222417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42fa2b8f-5fb7-4c50-a592-be7f84fe1290 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.360879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42fa2b8f-5fb7-4c50-a592-be7f84fe1290 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:11.370015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-42fa2b8f-5fb7-4c50-a592-be7f84fe1290 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161040 May 23 14:01:11.370581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1583/3086] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:11 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:11.711604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dcccf00f-ba48-4ee4-9863-a01078b97f4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:11.712249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dcccf00f-ba48-4ee4-9863-a01078b97f4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:11.719526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcccf00f-ba48-4ee4-9863-a01078b97f4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.720311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcccf00f-ba48-4ee4-9863-a01078b97f4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.721523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcccf00f-ba48-4ee4-9863-a01078b97f4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.722236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcccf00f-ba48-4ee4-9863-a01078b97f4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.725276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dbe5ad88-0a29-4be3-bfd3-a9677d6c3b75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:11.725896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dbe5ad88-0a29-4be3-bfd3-a9677d6c3b75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:11.732455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad88-0a29-4be3-bfd3-a9677d6c3b75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.732933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad88-0a29-4be3-bfd3-a9677d6c3b75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.733868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad88-0a29-4be3-bfd3-a9677d6c3b75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.734372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad88-0a29-4be3-bfd3-a9677d6c3b75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.814383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dbe5ad88-0a29-4be3-bfd3-a9677d6c3b75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:11.822785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dbe5ad88-0a29-4be3-bfd3-a9677d6c3b75 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.101094 May 23 14:01:11.823238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1584/3087] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:11 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:11.828684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:11.829298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:11.835961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.836413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.837213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.837646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.878784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcccf00f-ba48-4ee4-9863-a01078b97f4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:11.887326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dcccf00f-ba48-4ee4-9863-a01078b97f4b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.179788 May 23 14:01:11.887952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1504/3088] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:11 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:11.893928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0f68219d-6a67-4ca6-92c4-24aea07f8ac3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:11.894546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0f68219d-6a67-4ca6-92c4-24aea07f8ac3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:11.900703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f68219d-6a67-4ca6-92c4-24aea07f8ac3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.900875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:11.901160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f68219d-6a67-4ca6-92c4-24aea07f8ac3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.901935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f68219d-6a67-4ca6-92c4-24aea07f8ac3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:11.902372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f68219d-6a67-4ca6-92c4-24aea07f8ac3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:11.909543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:11.911051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:11.912207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fabdfc7d-e8a3-4e80-9526-2a0b6a547e7b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088045 May 23 14:01:11.912780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1585/3089] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:11 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:12.039595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0f68219d-6a67-4ca6-92c4-24aea07f8ac3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:12.048327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0f68219d-6a67-4ca6-92c4-24aea07f8ac3 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159374 May 23 14:01:12.048934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1505/3090] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:11 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:12.388004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d7a04814-bc7d-46da-90d1-1e808af41bd4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:12.388672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d7a04814-bc7d-46da-90d1-1e808af41bd4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:12.395127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7a04814-bc7d-46da-90d1-1e808af41bd4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:12.395575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7a04814-bc7d-46da-90d1-1e808af41bd4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:12.396357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7a04814-bc7d-46da-90d1-1e808af41bd4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:12.396816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7a04814-bc7d-46da-90d1-1e808af41bd4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:12.534965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7a04814-bc7d-46da-90d1-1e808af41bd4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:12.543139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d7a04814-bc7d-46da-90d1-1e808af41bd4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158991 May 23 14:01:12.543715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1586/3091] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:12 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:12.839584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d5dfa9e-a416-4851-a48d-17512986f93a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:12.840193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d5dfa9e-a416-4851-a48d-17512986f93a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:12.847984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d5dfa9e-a416-4851-a48d-17512986f93a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:12.848430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d5dfa9e-a416-4851-a48d-17512986f93a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:12.849248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d5dfa9e-a416-4851-a48d-17512986f93a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:12.849710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d5dfa9e-a416-4851-a48d-17512986f93a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:12.906025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8876b506-dcce-4bd2-865e-e71d31a9f77f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:12.906756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8876b506-dcce-4bd2-865e-e71d31a9f77f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:12.913483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8876b506-dcce-4bd2-865e-e71d31a9f77f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:12.913939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8876b506-dcce-4bd2-865e-e71d31a9f77f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:12.914715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8876b506-dcce-4bd2-865e-e71d31a9f77f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:12.915048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d5dfa9e-a416-4851-a48d-17512986f93a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:12.915196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8876b506-dcce-4bd2-865e-e71d31a9f77f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:12.923300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d5dfa9e-a416-4851-a48d-17512986f93a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087705 May 23 14:01:12.924133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1506/3092] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:12 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:12.930070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:12.931100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:12.938149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:12.938597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:12.939373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:12.939954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:13.012307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:13.021689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:13.023183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:13.024338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-522e6735-2899-418a-b9d5-62a43bd36d33 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.098355 May 23 14:01:13.024925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1507/3093] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:13.053665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8876b506-dcce-4bd2-865e-e71d31a9f77f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:13.062501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8876b506-dcce-4bd2-865e-e71d31a9f77f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160886 May 23 14:01:13.063067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1587/3094] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:12 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:13.066603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-725f7d07-c05c-4a9d-9b61-8c9e55aaa9f5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:13.067218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-725f7d07-c05c-4a9d-9b61-8c9e55aaa9f5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:13.073334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-725f7d07-c05c-4a9d-9b61-8c9e55aaa9f5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:13.073783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-725f7d07-c05c-4a9d-9b61-8c9e55aaa9f5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:13.074541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-725f7d07-c05c-4a9d-9b61-8c9e55aaa9f5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:13.074970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-725f7d07-c05c-4a9d-9b61-8c9e55aaa9f5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:13.207985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-725f7d07-c05c-4a9d-9b61-8c9e55aaa9f5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:13.215944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-725f7d07-c05c-4a9d-9b61-8c9e55aaa9f5 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153349 May 23 14:01:13.216513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1508/3095] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:13 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:13.560822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e0b1ad5-e50b-4333-b010-e38c505a52cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:13.561978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e0b1ad5-e50b-4333-b010-e38c505a52cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:13.568069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e0b1ad5-e50b-4333-b010-e38c505a52cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:13.568516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e0b1ad5-e50b-4333-b010-e38c505a52cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:13.569300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e0b1ad5-e50b-4333-b010-e38c505a52cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:13.569736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e0b1ad5-e50b-4333-b010-e38c505a52cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:13.704018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9e0b1ad5-e50b-4333-b010-e38c505a52cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:13.712272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e0b1ad5-e50b-4333-b010-e38c505a52cc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.155656 May 23 14:01:13.712897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1588/3096] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:13 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:13.940136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0668bb82-adf6-4e11-8171-6046f9311f22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:13.940767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0668bb82-adf6-4e11-8171-6046f9311f22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:13.947250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0668bb82-adf6-4e11-8171-6046f9311f22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:13.947696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0668bb82-adf6-4e11-8171-6046f9311f22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:13.948442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0668bb82-adf6-4e11-8171-6046f9311f22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:13.948898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0668bb82-adf6-4e11-8171-6046f9311f22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:14.010797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0668bb82-adf6-4e11-8171-6046f9311f22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:14.018953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0668bb82-adf6-4e11-8171-6046f9311f22 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.082683 May 23 14:01:14.019511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1509/3097] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:13 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:14.043156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:14.043780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:14.051597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:14.056036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:14.056036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:14.056036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:14.080721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c90cbbf4-81fb-4316-9fb5-94526d3026e9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:14.081373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c90cbbf4-81fb-4316-9fb5-94526d3026e9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:14.087935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c90cbbf4-81fb-4316-9fb5-94526d3026e9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:14.088491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c90cbbf4-81fb-4316-9fb5-94526d3026e9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:14.089281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c90cbbf4-81fb-4316-9fb5-94526d3026e9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:14.089713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c90cbbf4-81fb-4316-9fb5-94526d3026e9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:14.121192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:14.130367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:14.131871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:14.133105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e0db647d-6ace-491d-a9dc-93b23328bf5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.093873 May 23 14:01:14.133659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1589/3098] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:14 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:14.232509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c90cbbf4-81fb-4316-9fb5-94526d3026e9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:14.234323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97030628-4274-4d5f-b424-3a7dc177796a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:14.235050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97030628-4274-4d5f-b424-3a7dc177796a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:14.240722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c90cbbf4-81fb-4316-9fb5-94526d3026e9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165010 May 23 14:01:14.241187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97030628-4274-4d5f-b424-3a7dc177796a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:14.241322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1510/3099] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:14 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:14.241732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97030628-4274-4d5f-b424-3a7dc177796a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:14.242622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97030628-4274-4d5f-b424-3a7dc177796a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:14.243075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-97030628-4274-4d5f-b424-3a7dc177796a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:14.375348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97030628-4274-4d5f-b424-3a7dc177796a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:14.383136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97030628-4274-4d5f-b424-3a7dc177796a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.153727 May 23 14:01:14.383696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1590/3100] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:14 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:14.730035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97770f4e-0cee-4350-ac41-31219e156784 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:14.730645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97770f4e-0cee-4350-ac41-31219e156784 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:14.736885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97770f4e-0cee-4350-ac41-31219e156784 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:14.737338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97770f4e-0cee-4350-ac41-31219e156784 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:14.738094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97770f4e-0cee-4350-ac41-31219e156784 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:14.738532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97770f4e-0cee-4350-ac41-31219e156784 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:14.869103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97770f4e-0cee-4350-ac41-31219e156784 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:14.878061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97770f4e-0cee-4350-ac41-31219e156784 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.152020 May 23 14:01:14.878655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1511/3101] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:14 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:15.036195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-96805df4-b50e-48dc-a598-c3f747f1b6e5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:15.036768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-96805df4-b50e-48dc-a598-c3f747f1b6e5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:15.042881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96805df4-b50e-48dc-a598-c3f747f1b6e5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.043341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96805df4-b50e-48dc-a598-c3f747f1b6e5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:15.044146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96805df4-b50e-48dc-a598-c3f747f1b6e5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.044617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96805df4-b50e-48dc-a598-c3f747f1b6e5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:15.111468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-96805df4-b50e-48dc-a598-c3f747f1b6e5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:15.119789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-96805df4-b50e-48dc-a598-c3f747f1b6e5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087593 May 23 14:01:15.120360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1591/3102] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:15 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:15.151300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:15.151908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:15.158795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.159249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:15.160015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.160510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:15.224157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:15.232710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:15.234954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:15.236117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dbd47386-e7aa-4141-985e-dd82f290f667 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088733 May 23 14:01:15.236706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1512/3103] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:15 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:15.257726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4a5960fd-e5ef-409e-a3e5-90854a6dea0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:15.258370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4a5960fd-e5ef-409e-a3e5-90854a6dea0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:15.265591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a5960fd-e5ef-409e-a3e5-90854a6dea0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.266048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a5960fd-e5ef-409e-a3e5-90854a6dea0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:15.266835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a5960fd-e5ef-409e-a3e5-90854a6dea0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.267274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4a5960fd-e5ef-409e-a3e5-90854a6dea0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:15.400814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d4dc336-0d65-48ec-80f1-0ee54fdd8080 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:15.401427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d4dc336-0d65-48ec-80f1-0ee54fdd8080 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:15.408426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d4dc336-0d65-48ec-80f1-0ee54fdd8080 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.408911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d4dc336-0d65-48ec-80f1-0ee54fdd8080 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:15.409678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d4dc336-0d65-48ec-80f1-0ee54fdd8080 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.410114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d4dc336-0d65-48ec-80f1-0ee54fdd8080 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:15.413907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4a5960fd-e5ef-409e-a3e5-90854a6dea0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:15.423410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4a5960fd-e5ef-409e-a3e5-90854a6dea0a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.169525 May 23 14:01:15.423990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1592/3104] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:15 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:15.548435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d4dc336-0d65-48ec-80f1-0ee54fdd8080 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:15.558402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d4dc336-0d65-48ec-80f1-0ee54fdd8080 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161055 May 23 14:01:15.559010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1513/3105] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:15 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:15.895461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-947dcb31-f45e-4d19-837a-5fd4918244ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:15.896067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-947dcb31-f45e-4d19-837a-5fd4918244ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:15.902186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-947dcb31-f45e-4d19-837a-5fd4918244ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.902638 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-947dcb31-f45e-4d19-837a-5fd4918244ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:15.903403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-947dcb31-f45e-4d19-837a-5fd4918244ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:15.903842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-947dcb31-f45e-4d19-837a-5fd4918244ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:16.036421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-947dcb31-f45e-4d19-837a-5fd4918244ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:16.044358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-947dcb31-f45e-4d19-837a-5fd4918244ec tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.152841 May 23 14:01:16.045061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1593/3106] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:15 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:16.137934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f796937d-598b-4e42-98e8-719c47ecb40a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:16.138571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f796937d-598b-4e42-98e8-719c47ecb40a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:16.145544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f796937d-598b-4e42-98e8-719c47ecb40a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:16.145915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f796937d-598b-4e42-98e8-719c47ecb40a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:16.146682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f796937d-598b-4e42-98e8-719c47ecb40a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:16.147117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f796937d-598b-4e42-98e8-719c47ecb40a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:16.212258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f796937d-598b-4e42-98e8-719c47ecb40a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:16.220901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f796937d-598b-4e42-98e8-719c47ecb40a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086777 May 23 14:01:16.221515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1514/3107] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:16 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:16.254647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:16.255261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:16.261549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:16.262007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:16.262889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:16.263330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:16.268152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:16.330041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:16.338684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:16.340199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:16.341371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6c3f59d9-e237-4656-910c-956d0b9e1f18 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090666 May 23 14:01:16.341928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1594/3108] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:16 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:16.441821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d9a1f706-3180-424e-94d3-72ef1cd3c545 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:16.442361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d9a1f706-3180-424e-94d3-72ef1cd3c545 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:16.449205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9a1f706-3180-424e-94d3-72ef1cd3c545 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:16.449651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9a1f706-3180-424e-94d3-72ef1cd3c545 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:16.450419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9a1f706-3180-424e-94d3-72ef1cd3c545 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:16.450847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9a1f706-3180-424e-94d3-72ef1cd3c545 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:16.470632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:16.577057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f254ed2-a9b3-4032-8e24-5818e64c72b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:16.577750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f254ed2-a9b3-4032-8e24-5818e64c72b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:16.584144 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f254ed2-a9b3-4032-8e24-5818e64c72b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:16.584614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f254ed2-a9b3-4032-8e24-5818e64c72b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:16.585404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f254ed2-a9b3-4032-8e24-5818e64c72b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:16.585845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f254ed2-a9b3-4032-8e24-5818e64c72b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:16.590271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9a1f706-3180-424e-94d3-72ef1cd3c545 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:16.600185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d9a1f706-3180-424e-94d3-72ef1cd3c545 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.162246 May 23 14:01:16.600850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1515/3109] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:16 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:16.728292 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4f254ed2-a9b3-4032-8e24-5818e64c72b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:16.737831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f254ed2-a9b3-4032-8e24-5818e64c72b4 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164799 May 23 14:01:16.738435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1595/3110] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:16 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:17.062700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f79f1ed9-54eb-4759-a5e5-700b56577920 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:17.063194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f79f1ed9-54eb-4759-a5e5-700b56577920 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:17.069180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f79f1ed9-54eb-4759-a5e5-700b56577920 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.069619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f79f1ed9-54eb-4759-a5e5-700b56577920 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.070360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f79f1ed9-54eb-4759-a5e5-700b56577920 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.070787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f79f1ed9-54eb-4759-a5e5-700b56577920 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.215788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f79f1ed9-54eb-4759-a5e5-700b56577920 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:17.225410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f79f1ed9-54eb-4759-a5e5-700b56577920 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.166577 May 23 14:01:17.231271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1516/3111] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:17 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:17.237830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7a4c146c-af09-4d30-8edc-a3f8961a098a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:17.238436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7a4c146c-af09-4d30-8edc-a3f8961a098a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:17.245054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a4c146c-af09-4d30-8edc-a3f8961a098a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.245501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a4c146c-af09-4d30-8edc-a3f8961a098a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.246250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a4c146c-af09-4d30-8edc-a3f8961a098a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.246683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a4c146c-af09-4d30-8edc-a3f8961a098a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.308661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7a4c146c-af09-4d30-8edc-a3f8961a098a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:17.316665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7a4c146c-af09-4d30-8edc-a3f8961a098a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.082562 May 23 14:01:17.317170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1596/3112] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:17 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:17.359246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:17.359879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:17.361732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:17.366504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.366944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.367687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.368110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.432508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:17.441509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:17.443010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:17.444136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c66de86f-5319-4023-8116-a9f856a773d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088824 May 23 14:01:17.444715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1517/3113] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:17 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:17.618031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-84714f93-e97d-44aa-a56b-8a631198502d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:17.618656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-84714f93-e97d-44aa-a56b-8a631198502d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:17.625520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84714f93-e97d-44aa-a56b-8a631198502d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.625977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84714f93-e97d-44aa-a56b-8a631198502d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.626759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84714f93-e97d-44aa-a56b-8a631198502d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.627205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84714f93-e97d-44aa-a56b-8a631198502d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.756710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34dac6df-3549-4cbc-8300-0c85b49eb60c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:17.757335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-34dac6df-3549-4cbc-8300-0c85b49eb60c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:17.763888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34dac6df-3549-4cbc-8300-0c85b49eb60c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.764965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34dac6df-3549-4cbc-8300-0c85b49eb60c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.767265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34dac6df-3549-4cbc-8300-0c85b49eb60c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:17.767855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-34dac6df-3549-4cbc-8300-0c85b49eb60c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:17.768478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84714f93-e97d-44aa-a56b-8a631198502d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:17.782303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-84714f93-e97d-44aa-a56b-8a631198502d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.167694 May 23 14:01:17.783585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1597/3114] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:17 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:17.927842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-34dac6df-3549-4cbc-8300-0c85b49eb60c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:17.936909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34dac6df-3549-4cbc-8300-0c85b49eb60c tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.183376 May 23 14:01:17.937566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1518/3115] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:17 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:18.242992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-93d90120-c9dd-4318-aa7a-35da36c47d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:18.243602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-93d90120-c9dd-4318-aa7a-35da36c47d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:18.250642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93d90120-c9dd-4318-aa7a-35da36c47d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.251082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93d90120-c9dd-4318-aa7a-35da36c47d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:18.251835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93d90120-c9dd-4318-aa7a-35da36c47d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.252269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93d90120-c9dd-4318-aa7a-35da36c47d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:18.334081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9f2a5067-2e2e-47af-bda3-0397fdfbf516 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:18.335055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9f2a5067-2e2e-47af-bda3-0397fdfbf516 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:18.341838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f2a5067-2e2e-47af-bda3-0397fdfbf516 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.342846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f2a5067-2e2e-47af-bda3-0397fdfbf516 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:18.343606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f2a5067-2e2e-47af-bda3-0397fdfbf516 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.344038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f2a5067-2e2e-47af-bda3-0397fdfbf516 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:18.389827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93d90120-c9dd-4318-aa7a-35da36c47d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:18.398102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-93d90120-c9dd-4318-aa7a-35da36c47d13 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158912 May 23 14:01:18.398690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1598/3116] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:18 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:18.412546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f2a5067-2e2e-47af-bda3-0397fdfbf516 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:18.421748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9f2a5067-2e2e-47af-bda3-0397fdfbf516 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090925 May 23 14:01:18.422336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1519/3117] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:18 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:18.463237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:18.463773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:18.470610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.471061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:18.471837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.472281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:18.535547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:18.544055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:18.546443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:18.547587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-08cb6c34-1ab6-402d-a56e-5e2e4c26317b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088435 May 23 14:01:18.548142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1599/3118] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:18 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:18.809257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d284ba68-4cfb-4b6b-afab-ae0d27d795e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:18.809791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d284ba68-4cfb-4b6b-afab-ae0d27d795e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:18.816050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d284ba68-4cfb-4b6b-afab-ae0d27d795e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.816499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d284ba68-4cfb-4b6b-afab-ae0d27d795e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:18.817287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d284ba68-4cfb-4b6b-afab-ae0d27d795e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.817725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d284ba68-4cfb-4b6b-afab-ae0d27d795e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:18.945179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d284ba68-4cfb-4b6b-afab-ae0d27d795e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:18.953709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d284ba68-4cfb-4b6b-afab-ae0d27d795e0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.148774 May 23 14:01:18.953988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee0fd9fd-d9eb-43b5-9a17-78172bd2b4e7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:18.954281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1520/3119] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:18 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:18.954637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee0fd9fd-d9eb-43b5-9a17-78172bd2b4e7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:18.960854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee0fd9fd-d9eb-43b5-9a17-78172bd2b4e7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.961307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee0fd9fd-d9eb-43b5-9a17-78172bd2b4e7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:18.962086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee0fd9fd-d9eb-43b5-9a17-78172bd2b4e7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:18.962524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee0fd9fd-d9eb-43b5-9a17-78172bd2b4e7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:19.104708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee0fd9fd-d9eb-43b5-9a17-78172bd2b4e7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:19.113717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee0fd9fd-d9eb-43b5-9a17-78172bd2b4e7 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164146 May 23 14:01:19.114293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1600/3120] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:18 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:19.416393 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f1d46bf-a3db-4706-b63d-75b38ab95b26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:19.417031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f1d46bf-a3db-4706-b63d-75b38ab95b26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:19.423796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1d46bf-a3db-4706-b63d-75b38ab95b26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:19.424238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1d46bf-a3db-4706-b63d-75b38ab95b26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:19.425025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1d46bf-a3db-4706-b63d-75b38ab95b26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:19.425454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1d46bf-a3db-4706-b63d-75b38ab95b26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:19.439597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7a93d08d-ca2c-49dd-9dcd-45c162e2de3a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:19.440208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7a93d08d-ca2c-49dd-9dcd-45c162e2de3a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:19.446775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a93d08d-ca2c-49dd-9dcd-45c162e2de3a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:19.447224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a93d08d-ca2c-49dd-9dcd-45c162e2de3a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:19.448021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a93d08d-ca2c-49dd-9dcd-45c162e2de3a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:19.448502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a93d08d-ca2c-49dd-9dcd-45c162e2de3a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:19.513075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7a93d08d-ca2c-49dd-9dcd-45c162e2de3a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:19.521324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7a93d08d-ca2c-49dd-9dcd-45c162e2de3a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085990 May 23 14:01:19.521906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1601/3121] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:19 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:19.566483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f1d46bf-a3db-4706-b63d-75b38ab95b26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:19.566816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:19.567499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:19.573639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:19.574173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:19.574752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f1d46bf-a3db-4706-b63d-75b38ab95b26 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162350 May 23 14:01:19.574961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:19.577335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:19.577517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1521/3122] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:19 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:19.638917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:19.647518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:19.649056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:19.650206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4db1f3af-eafd-4d9f-a5f7-90f591944c88 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.087510 May 23 14:01:19.650754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1602/3123] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:19 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:19.971254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-249ba22f-6159-48da-900d-924c4d53556e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:19.971871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-249ba22f-6159-48da-900d-924c4d53556e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:19.978106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-249ba22f-6159-48da-900d-924c4d53556e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:19.978551 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-249ba22f-6159-48da-900d-924c4d53556e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:19.979311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-249ba22f-6159-48da-900d-924c4d53556e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:19.979743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-249ba22f-6159-48da-900d-924c4d53556e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:20.110253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-249ba22f-6159-48da-900d-924c4d53556e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:20.118580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-249ba22f-6159-48da-900d-924c4d53556e tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.151755 May 23 14:01:20.119145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1522/3124] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:19 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:20.131152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e6703a4a-1e96-46b7-a7af-eedb2cdadc19 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:20.131800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e6703a4a-1e96-46b7-a7af-eedb2cdadc19 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:20.133698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:20.138428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6703a4a-1e96-46b7-a7af-eedb2cdadc19 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:20.138428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6703a4a-1e96-46b7-a7af-eedb2cdadc19 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:20.139757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6703a4a-1e96-46b7-a7af-eedb2cdadc19 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:20.140195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6703a4a-1e96-46b7-a7af-eedb2cdadc19 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:20.285982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6703a4a-1e96-46b7-a7af-eedb2cdadc19 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:20.294207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e6703a4a-1e96-46b7-a7af-eedb2cdadc19 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.166781 May 23 14:01:20.294796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1603/3125] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:20 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:20.538164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b4e8caf8-efbc-4d83-bf2b-2454a27160e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:20.538779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b4e8caf8-efbc-4d83-bf2b-2454a27160e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:20.545430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4e8caf8-efbc-4d83-bf2b-2454a27160e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:20.545776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4e8caf8-efbc-4d83-bf2b-2454a27160e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:20.546527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4e8caf8-efbc-4d83-bf2b-2454a27160e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:20.546959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4e8caf8-efbc-4d83-bf2b-2454a27160e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:20.603074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4c4d4f61-b806-4948-9c28-bdee20e27341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:20.603676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4c4d4f61-b806-4948-9c28-bdee20e27341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:20.616221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4e8caf8-efbc-4d83-bf2b-2454a27160e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:20.616420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c4d4f61-b806-4948-9c28-bdee20e27341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:20.616420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c4d4f61-b806-4948-9c28-bdee20e27341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:20.616420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c4d4f61-b806-4948-9c28-bdee20e27341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:20.616420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c4d4f61-b806-4948-9c28-bdee20e27341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:20.619890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b4e8caf8-efbc-4d83-bf2b-2454a27160e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084924 May 23 14:01:20.619890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1523/3126] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:20 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:20.668000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:20.668621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:20.675307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:20.675758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:20.676590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:20.678121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:20.741545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:20.751033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:20.752596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:20.753749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1e675443-a553-4075-b6d6-fb788068ad87 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089739 May 23 14:01:20.754324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1524/3127] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:20 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:20.754556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4c4d4f61-b806-4948-9c28-bdee20e27341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:20.763049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4c4d4f61-b806-4948-9c28-bdee20e27341 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.163786 May 23 14:01:20.763625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1604/3128] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:20 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:21.135437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6b016f03-cd38-4882-8b66-78b36c67eb7f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:21.136054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6b016f03-cd38-4882-8b66-78b36c67eb7f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:21.142916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b016f03-cd38-4882-8b66-78b36c67eb7f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.143364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b016f03-cd38-4882-8b66-78b36c67eb7f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.144131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b016f03-cd38-4882-8b66-78b36c67eb7f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.144591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6b016f03-cd38-4882-8b66-78b36c67eb7f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.283718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6b016f03-cd38-4882-8b66-78b36c67eb7f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:21.292066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6b016f03-cd38-4882-8b66-78b36c67eb7f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160468 May 23 14:01:21.292854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1525/3129] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:21 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:21.312437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ea23eab4-86ce-47b7-a151-3540f5feed69 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:21.313104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ea23eab4-86ce-47b7-a151-3540f5feed69 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:21.319382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea23eab4-86ce-47b7-a151-3540f5feed69 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.319841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea23eab4-86ce-47b7-a151-3540f5feed69 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.320670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea23eab4-86ce-47b7-a151-3540f5feed69 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.321119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea23eab4-86ce-47b7-a151-3540f5feed69 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.457219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ea23eab4-86ce-47b7-a151-3540f5feed69 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:21.465567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ea23eab4-86ce-47b7-a151-3540f5feed69 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158028 May 23 14:01:21.466135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1605/3130] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:21 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:21.636715 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e61f98f3-b948-4afe-b5f5-583bdccd9ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:21.637486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e61f98f3-b948-4afe-b5f5-583bdccd9ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:21.644371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e61f98f3-b948-4afe-b5f5-583bdccd9ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.644976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e61f98f3-b948-4afe-b5f5-583bdccd9ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.645741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e61f98f3-b948-4afe-b5f5-583bdccd9ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.646179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e61f98f3-b948-4afe-b5f5-583bdccd9ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.711788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e61f98f3-b948-4afe-b5f5-583bdccd9ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:21.720113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e61f98f3-b948-4afe-b5f5-583bdccd9ef0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087445 May 23 14:01:21.720705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1526/3131] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:21 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:21.772717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:21.773336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:21.780326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.780817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.781234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ea6eb4fd-ffca-42ba-b595-10a8308f656c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:21.781586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.781855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ea6eb4fd-ffca-42ba-b595-10a8308f656c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:21.782016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.787991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea6eb4fd-ffca-42ba-b595-10a8308f656c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.788509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea6eb4fd-ffca-42ba-b595-10a8308f656c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.789299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea6eb4fd-ffca-42ba-b595-10a8308f656c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:21.789743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea6eb4fd-ffca-42ba-b595-10a8308f656c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:21.849533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:21.860383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:21.863118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:21.865308 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f2d49e3-15e1-4187-bcdd-afc9574de6d9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.096205 May 23 14:01:21.866425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1606/3132] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:21 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:21.942650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea6eb4fd-ffca-42ba-b595-10a8308f656c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:21.950973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ea6eb4fd-ffca-42ba-b595-10a8308f656c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.173575 May 23 14:01:21.951593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1527/3133] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:21 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:22.310009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-22505d76-ce2f-476e-8280-d30b578bf68f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:22.310552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-22505d76-ce2f-476e-8280-d30b578bf68f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:22.317171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22505d76-ce2f-476e-8280-d30b578bf68f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.317626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22505d76-ce2f-476e-8280-d30b578bf68f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.318404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22505d76-ce2f-476e-8280-d30b578bf68f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.318865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22505d76-ce2f-476e-8280-d30b578bf68f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.466034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-22505d76-ce2f-476e-8280-d30b578bf68f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:22.475077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-22505d76-ce2f-476e-8280-d30b578bf68f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.169295 May 23 14:01:22.475661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1607/3134] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:22 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:22.483854 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4a6305d0-0ee0-4aeb-b00a-198de4903762 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:22.484487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4a6305d0-0ee0-4aeb-b00a-198de4903762 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:22.490796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a6305d0-0ee0-4aeb-b00a-198de4903762 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.491251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a6305d0-0ee0-4aeb-b00a-198de4903762 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.492045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a6305d0-0ee0-4aeb-b00a-198de4903762 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.492459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a6305d0-0ee0-4aeb-b00a-198de4903762 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.626301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4a6305d0-0ee0-4aeb-b00a-198de4903762 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:22.634382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4a6305d0-0ee0-4aeb-b00a-198de4903762 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.155111 May 23 14:01:22.634949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1528/3135] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:22 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:22.737435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef2faaba-8c69-4d20-99f6-b97c5a9ca7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:22.738053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef2faaba-8c69-4d20-99f6-b97c5a9ca7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:22.744177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2faaba-8c69-4d20-99f6-b97c5a9ca7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.744653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2faaba-8c69-4d20-99f6-b97c5a9ca7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.745421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2faaba-8c69-4d20-99f6-b97c5a9ca7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.745854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef2faaba-8c69-4d20-99f6-b97c5a9ca7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.818293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef2faaba-8c69-4d20-99f6-b97c5a9ca7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:22.828615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef2faaba-8c69-4d20-99f6-b97c5a9ca7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094949 May 23 14:01:22.829125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1608/3136] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:22 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:22.894055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:22.894667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:22.901378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.901834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.902596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.903032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.970216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9813f237-7b86-46f3-8317-649672e5217d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:22.970867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9813f237-7b86-46f3-8317-649672e5217d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:22.978044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9813f237-7b86-46f3-8317-649672e5217d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.978501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9813f237-7b86-46f3-8317-649672e5217d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.979283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9813f237-7b86-46f3-8317-649672e5217d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:22.979566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:22.979738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9813f237-7b86-46f3-8317-649672e5217d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:22.988544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:22.990095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:22.991247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5b0ccc4-98da-4af6-96a7-b0ca181aa8d8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.102149 May 23 14:01:22.992029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1529/3137] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:22 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:23.118511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9813f237-7b86-46f3-8317-649672e5217d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:23.127842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9813f237-7b86-46f3-8317-649672e5217d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161575 May 23 14:01:23.128408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1609/3138] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:22 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:23.492673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-73865d82-8616-4d73-a42a-468a39ed3ef0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:23.493221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-73865d82-8616-4d73-a42a-468a39ed3ef0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:23.499820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73865d82-8616-4d73-a42a-468a39ed3ef0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:23.500290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73865d82-8616-4d73-a42a-468a39ed3ef0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:23.501084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73865d82-8616-4d73-a42a-468a39ed3ef0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:23.501525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73865d82-8616-4d73-a42a-468a39ed3ef0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:23.636170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-73865d82-8616-4d73-a42a-468a39ed3ef0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:23.642127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-73865d82-8616-4d73-a42a-468a39ed3ef0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.153158 May 23 14:01:23.642713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1530/3139] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:23 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:23.651516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-511d10c1-aa6f-40ff-bb67-be9ade9d096f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:23.652158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-511d10c1-aa6f-40ff-bb67-be9ade9d096f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:23.658882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-511d10c1-aa6f-40ff-bb67-be9ade9d096f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:23.659331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-511d10c1-aa6f-40ff-bb67-be9ade9d096f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:23.660103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-511d10c1-aa6f-40ff-bb67-be9ade9d096f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:23.660546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-511d10c1-aa6f-40ff-bb67-be9ade9d096f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:23.792879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-511d10c1-aa6f-40ff-bb67-be9ade9d096f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:23.796929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:23.801811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-511d10c1-aa6f-40ff-bb67-be9ade9d096f tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154215 May 23 14:01:23.802402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1610/3140] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:23 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:23.846069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7fcd41c8-584c-47ce-9c4f-c12038d80bf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:23.846684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7fcd41c8-584c-47ce-9c4f-c12038d80bf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:23.853209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fcd41c8-584c-47ce-9c4f-c12038d80bf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:23.853886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fcd41c8-584c-47ce-9c4f-c12038d80bf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:23.854782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fcd41c8-584c-47ce-9c4f-c12038d80bf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:23.855225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7fcd41c8-584c-47ce-9c4f-c12038d80bf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:23.925451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7fcd41c8-584c-47ce-9c4f-c12038d80bf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:23.933930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7fcd41c8-584c-47ce-9c4f-c12038d80bf5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092352 May 23 14:01:23.934505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1531/3141] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:23 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:24.011028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:24.011595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:24.018982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.019444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.020214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.020688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.084406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:24.094080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:24.095602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:24.096790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-38fdfa44-5693-49d3-bc26-accbab55002a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090178 May 23 14:01:24.097346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1611/3142] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:24 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:24.146405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0cce8fd4-d93e-43b6-b28a-3d4b655f047b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:24.147011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0cce8fd4-d93e-43b6-b28a-3d4b655f047b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:24.153136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cce8fd4-d93e-43b6-b28a-3d4b655f047b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.153581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cce8fd4-d93e-43b6-b28a-3d4b655f047b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.154941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cce8fd4-d93e-43b6-b28a-3d4b655f047b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.155488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cce8fd4-d93e-43b6-b28a-3d4b655f047b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.159718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:24.292316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0cce8fd4-d93e-43b6-b28a-3d4b655f047b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:24.300826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0cce8fd4-d93e-43b6-b28a-3d4b655f047b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158249 May 23 14:01:24.301412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1532/3143] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:24 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:24.660389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-870c2e18-5623-4de2-93e5-a4b5e13242a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:24.661148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-870c2e18-5623-4de2-93e5-a4b5e13242a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:24.667419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-870c2e18-5623-4de2-93e5-a4b5e13242a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.667885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-870c2e18-5623-4de2-93e5-a4b5e13242a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.668693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-870c2e18-5623-4de2-93e5-a4b5e13242a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.669137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-870c2e18-5623-4de2-93e5-a4b5e13242a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.809069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-870c2e18-5623-4de2-93e5-a4b5e13242a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:24.818124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-870c2e18-5623-4de2-93e5-a4b5e13242a0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.161632 May 23 14:01:24.818925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1612/3144] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:24 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:24.819354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-253e13f3-82f2-42a1-a5ff-92da09e12d5e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:24.819984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-253e13f3-82f2-42a1-a5ff-92da09e12d5e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:24.826253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-253e13f3-82f2-42a1-a5ff-92da09e12d5e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.827359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-253e13f3-82f2-42a1-a5ff-92da09e12d5e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.828139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-253e13f3-82f2-42a1-a5ff-92da09e12d5e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.828605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-253e13f3-82f2-42a1-a5ff-92da09e12d5e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.951755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cdd5dd49-a525-4fdd-8e49-48c4f381292c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:24.958976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cdd5dd49-a525-4fdd-8e49-48c4f381292c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:24.959769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd5dd49-a525-4fdd-8e49-48c4f381292c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.959891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd5dd49-a525-4fdd-8e49-48c4f381292c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.960753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd5dd49-a525-4fdd-8e49-48c4f381292c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:24.961338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd5dd49-a525-4fdd-8e49-48c4f381292c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:24.971927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-253e13f3-82f2-42a1-a5ff-92da09e12d5e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:24.980488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-253e13f3-82f2-42a1-a5ff-92da09e12d5e tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164949 May 23 14:01:24.981194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1533/3145] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:24 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:25.025225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cdd5dd49-a525-4fdd-8e49-48c4f381292c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:25.033755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cdd5dd49-a525-4fdd-8e49-48c4f381292c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085890 May 23 14:01:25.034319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1613/3146] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:24 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:25.115093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:25.115700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:25.121855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:25.122304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:25.123345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:25.123983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:25.193526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:25.202152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:25.203677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:25.204879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56b359e8-5ec1-4524-a6fa-73e691c356f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.093671 May 23 14:01:25.205467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1534/3147] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:25 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:25.319070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2d0e3bba-4e12-4b34-aff4-fb9d6cb89639 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:25.319687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2d0e3bba-4e12-4b34-aff4-fb9d6cb89639 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:25.325741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d0e3bba-4e12-4b34-aff4-fb9d6cb89639 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:25.326323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d0e3bba-4e12-4b34-aff4-fb9d6cb89639 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:25.327165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d0e3bba-4e12-4b34-aff4-fb9d6cb89639 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:25.327603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d0e3bba-4e12-4b34-aff4-fb9d6cb89639 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:25.472637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d0e3bba-4e12-4b34-aff4-fb9d6cb89639 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:25.480654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2d0e3bba-4e12-4b34-aff4-fb9d6cb89639 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.165422 May 23 14:01:25.481269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1614/3148] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:25 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:25.835538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e5ff2252-96f4-4153-be4a-31a934a389dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:25.836066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e5ff2252-96f4-4153-be4a-31a934a389dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:25.842279 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5ff2252-96f4-4153-be4a-31a934a389dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:25.842729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5ff2252-96f4-4153-be4a-31a934a389dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:25.843686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5ff2252-96f4-4153-be4a-31a934a389dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:25.844128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5ff2252-96f4-4153-be4a-31a934a389dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:25.977925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e5ff2252-96f4-4153-be4a-31a934a389dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:25.986522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e5ff2252-96f4-4153-be4a-31a934a389dc tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155042 May 23 14:01:25.987099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1535/3149] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:25 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:25.999038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31cb843f-6a8a-4c90-b301-3bb94cab7033 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:25.999681 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-31cb843f-6a8a-4c90-b301-3bb94cab7033 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:26.006298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31cb843f-6a8a-4c90-b301-3bb94cab7033 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:26.006744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31cb843f-6a8a-4c90-b301-3bb94cab7033 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:26.007505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31cb843f-6a8a-4c90-b301-3bb94cab7033 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:26.007948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31cb843f-6a8a-4c90-b301-3bb94cab7033 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:26.051449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c26395e-0835-4e70-a6d1-79b2252ad68e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:26.052059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c26395e-0835-4e70-a6d1-79b2252ad68e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:26.058480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c26395e-0835-4e70-a6d1-79b2252ad68e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:26.058925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c26395e-0835-4e70-a6d1-79b2252ad68e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:26.059682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c26395e-0835-4e70-a6d1-79b2252ad68e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:26.060114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c26395e-0835-4e70-a6d1-79b2252ad68e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:26.128113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3c26395e-0835-4e70-a6d1-79b2252ad68e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:26.136100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3c26395e-0835-4e70-a6d1-79b2252ad68e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088673 May 23 14:01:26.136841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1536/3150] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:26 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:26.145605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-31cb843f-6a8a-4c90-b301-3bb94cab7033 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:26.153541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31cb843f-6a8a-4c90-b301-3bb94cab7033 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159072 May 23 14:01:26.154099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1615/3151] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:25 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:26.223121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:26.223747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:26.229858 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:26.230301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:26.231089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:26.231515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:26.295527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:26.304128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:26.305635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:26.306771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f939a124-a0bf-4902-a94d-c5844eb0072f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.087815 May 23 14:01:26.307591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1537/3152] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:26 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:26.498893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-756d20a8-efb5-43ac-a9b0-8dde800680c3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:26.499513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-756d20a8-efb5-43ac-a9b0-8dde800680c3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:26.505593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-756d20a8-efb5-43ac-a9b0-8dde800680c3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:26.506047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-756d20a8-efb5-43ac-a9b0-8dde800680c3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:26.506808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-756d20a8-efb5-43ac-a9b0-8dde800680c3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:26.507276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-756d20a8-efb5-43ac-a9b0-8dde800680c3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:26.634284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-756d20a8-efb5-43ac-a9b0-8dde800680c3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:26.642344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-756d20a8-efb5-43ac-a9b0-8dde800680c3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.148125 May 23 14:01:26.642906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1616/3153] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:26 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:27.003734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-76f25172-ec9b-4d29-ac45-5a111117886a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:27.004338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-76f25172-ec9b-4d29-ac45-5a111117886a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:27.011027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76f25172-ec9b-4d29-ac45-5a111117886a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.011480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76f25172-ec9b-4d29-ac45-5a111117886a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.012247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76f25172-ec9b-4d29-ac45-5a111117886a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.012725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76f25172-ec9b-4d29-ac45-5a111117886a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.143194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-76f25172-ec9b-4d29-ac45-5a111117886a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:27.151677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-76f25172-ec9b-4d29-ac45-5a111117886a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.151775 May 23 14:01:27.152282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1538/3154] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:26 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:27.154236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45ad21c5-ebe8-4ed3-98ef-d1725178fa5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:27.155913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-45ad21c5-ebe8-4ed3-98ef-d1725178fa5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:27.163079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ad21c5-ebe8-4ed3-98ef-d1725178fa5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.163537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ad21c5-ebe8-4ed3-98ef-d1725178fa5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.164320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ad21c5-ebe8-4ed3-98ef-d1725178fa5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.164802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ad21c5-ebe8-4ed3-98ef-d1725178fa5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.170956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2108a190-fa57-4c09-9a1a-ccaf1b53421d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:27.171643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2108a190-fa57-4c09-9a1a-ccaf1b53421d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:27.178348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2108a190-fa57-4c09-9a1a-ccaf1b53421d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.178885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2108a190-fa57-4c09-9a1a-ccaf1b53421d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.179738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2108a190-fa57-4c09-9a1a-ccaf1b53421d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.180300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2108a190-fa57-4c09-9a1a-ccaf1b53421d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.239817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-45ad21c5-ebe8-4ed3-98ef-d1725178fa5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:27.248186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45ad21c5-ebe8-4ed3-98ef-d1725178fa5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.098013 May 23 14:01:27.248955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1617/3155] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:27 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:27.316218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2108a190-fa57-4c09-9a1a-ccaf1b53421d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:27.324290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2108a190-fa57-4c09-9a1a-ccaf1b53421d tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.157104 May 23 14:01:27.324894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1539/3156] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:27 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:27.326640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:27.327263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:27.333473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.334021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.334779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.335212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.395694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:27.403959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:27.405518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:27.406647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1d59ce57-1343-4b93-9686-155cce7dc3a7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.084760 May 23 14:01:27.407198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1618/3157] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:27 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:27.659406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff71cb97-d562-48bb-9b10-45de4f5171bf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:27.659983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff71cb97-d562-48bb-9b10-45de4f5171bf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:27.666189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff71cb97-d562-48bb-9b10-45de4f5171bf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.666640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff71cb97-d562-48bb-9b10-45de4f5171bf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.667397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff71cb97-d562-48bb-9b10-45de4f5171bf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:27.667833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff71cb97-d562-48bb-9b10-45de4f5171bf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:27.804124 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ff71cb97-d562-48bb-9b10-45de4f5171bf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:27.812920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff71cb97-d562-48bb-9b10-45de4f5171bf tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157371 May 23 14:01:27.813482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1540/3158] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:27 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:28.170041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a4b637f9-2154-44cc-97bf-841950b265ce tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:28.170661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a4b637f9-2154-44cc-97bf-841950b265ce tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:28.178143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4b637f9-2154-44cc-97bf-841950b265ce tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.178603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4b637f9-2154-44cc-97bf-841950b265ce tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.179373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4b637f9-2154-44cc-97bf-841950b265ce tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.179811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a4b637f9-2154-44cc-97bf-841950b265ce tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.265731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-68ced8b3-27b9-4ecf-af26-0880d7abac44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:28.266344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-68ced8b3-27b9-4ecf-af26-0880d7abac44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:28.272962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68ced8b3-27b9-4ecf-af26-0880d7abac44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.273407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68ced8b3-27b9-4ecf-af26-0880d7abac44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.274169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68ced8b3-27b9-4ecf-af26-0880d7abac44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.274598 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68ced8b3-27b9-4ecf-af26-0880d7abac44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.315725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a4b637f9-2154-44cc-97bf-841950b265ce tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:28.322074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a4b637f9-2154-44cc-97bf-841950b265ce tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155845 May 23 14:01:28.322660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1619/3159] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:28 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:28.339568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-68ced8b3-27b9-4ecf-af26-0880d7abac44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:28.341861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d6da968-9870-4b3b-a589-db1effd78d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:28.342482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d6da968-9870-4b3b-a589-db1effd78d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:28.348469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-68ced8b3-27b9-4ecf-af26-0880d7abac44 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086841 May 23 14:01:28.349088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1541/3160] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:28 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:28.349289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d6da968-9870-4b3b-a589-db1effd78d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.349743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d6da968-9870-4b3b-a589-db1effd78d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.350515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d6da968-9870-4b3b-a589-db1effd78d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.350946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d6da968-9870-4b3b-a589-db1effd78d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.425855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:28.426473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:28.433147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.433595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.434356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.434786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.484787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d6da968-9870-4b3b-a589-db1effd78d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:28.492893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d6da968-9870-4b3b-a589-db1effd78d58 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154747 May 23 14:01:28.493470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1620/3161] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:28 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:28.499178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:28.507626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:28.509159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:28.510341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2c79057-080d-4001-9423-72e6df0455f2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089846 May 23 14:01:28.510919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1542/3162] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:28 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:28.830943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a0ce438-6725-487b-af38-2e6a1534c602 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:28.831471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a0ce438-6725-487b-af38-2e6a1534c602 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:28.837474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a0ce438-6725-487b-af38-2e6a1534c602 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.837921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a0ce438-6725-487b-af38-2e6a1534c602 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.838669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a0ce438-6725-487b-af38-2e6a1534c602 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:28.839101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a0ce438-6725-487b-af38-2e6a1534c602 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:28.968975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a0ce438-6725-487b-af38-2e6a1534c602 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:28.977125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a0ce438-6725-487b-af38-2e6a1534c602 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.150759 May 23 14:01:28.977714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1621/3163] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:28 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:29.339674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb17a129-ce8e-4bed-9aec-708cdf6906ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:29.340263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb17a129-ce8e-4bed-9aec-708cdf6906ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:29.346904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb17a129-ce8e-4bed-9aec-708cdf6906ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:29.347355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb17a129-ce8e-4bed-9aec-708cdf6906ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:29.348118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb17a129-ce8e-4bed-9aec-708cdf6906ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:29.348556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb17a129-ce8e-4bed-9aec-708cdf6906ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:29.365198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c87a9658-a7c3-4693-90e0-59557eef17c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:29.365821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c87a9658-a7c3-4693-90e0-59557eef17c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:29.372262 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c87a9658-a7c3-4693-90e0-59557eef17c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:29.372753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c87a9658-a7c3-4693-90e0-59557eef17c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:29.373642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c87a9658-a7c3-4693-90e0-59557eef17c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:29.374685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c87a9658-a7c3-4693-90e0-59557eef17c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:29.450033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c87a9658-a7c3-4693-90e0-59557eef17c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:29.458691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c87a9658-a7c3-4693-90e0-59557eef17c1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.097338 May 23 14:01:29.459269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1622/3164] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:29 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:29.486933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb17a129-ce8e-4bed-9aec-708cdf6906ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:29.495127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb17a129-ce8e-4bed-9aec-708cdf6906ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.159352 May 23 14:01:29.495687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1543/3165] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:29 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:29.510443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02fd666c-923f-4dc1-88d5-e12ec4d47a20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:29.511095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02fd666c-923f-4dc1-88d5-e12ec4d47a20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:29.517780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fd666c-923f-4dc1-88d5-e12ec4d47a20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:29.518244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fd666c-923f-4dc1-88d5-e12ec4d47a20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:29.519009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fd666c-923f-4dc1-88d5-e12ec4d47a20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:29.519450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02fd666c-923f-4dc1-88d5-e12ec4d47a20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:29.528884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:29.529525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:29.536213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:29.536700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:29.537469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:29.537902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:29.603635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:29.613985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:29.615510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:29.616733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fc45245f-2b6c-4c5c-88ea-39742d57aff3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.091603 May 23 14:01:29.617296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1544/3166] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:29 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:29.657146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02fd666c-923f-4dc1-88d5-e12ec4d47a20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:29.665151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02fd666c-923f-4dc1-88d5-e12ec4d47a20 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.158606 May 23 14:01:29.665731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1623/3167] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:29 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:29.995642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-facc524d-a9af-4b79-8bdb-f792903c33dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:29.996247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-facc524d-a9af-4b79-8bdb-f792903c33dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:30.002286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-facc524d-a9af-4b79-8bdb-f792903c33dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.002734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-facc524d-a9af-4b79-8bdb-f792903c33dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.003486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-facc524d-a9af-4b79-8bdb-f792903c33dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.003920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-facc524d-a9af-4b79-8bdb-f792903c33dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.136087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-facc524d-a9af-4b79-8bdb-f792903c33dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:30.144825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-facc524d-a9af-4b79-8bdb-f792903c33dc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.153248 May 23 14:01:30.145423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1545/3168] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:29 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:30.475901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d4d4ec41-3169-48d0-b239-4a205e8a0c72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:30.476541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d4d4ec41-3169-48d0-b239-4a205e8a0c72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:30.483090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4d4ec41-3169-48d0-b239-4a205e8a0c72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.484152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4d4ec41-3169-48d0-b239-4a205e8a0c72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.484947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4d4ec41-3169-48d0-b239-4a205e8a0c72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.485386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4d4ec41-3169-48d0-b239-4a205e8a0c72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.512707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b54759e8-d4d3-41a7-b0ab-be832c424547 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:30.513327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b54759e8-d4d3-41a7-b0ab-be832c424547 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:30.519466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b54759e8-d4d3-41a7-b0ab-be832c424547 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.519929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b54759e8-d4d3-41a7-b0ab-be832c424547 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.520719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b54759e8-d4d3-41a7-b0ab-be832c424547 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.521158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b54759e8-d4d3-41a7-b0ab-be832c424547 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.548291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d4d4ec41-3169-48d0-b239-4a205e8a0c72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:30.556805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d4d4ec41-3169-48d0-b239-4a205e8a0c72 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084821 May 23 14:01:30.557633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1624/3169] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:30 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:30.636845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:30.642355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:30.644007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.644464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.645270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.645715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.657642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b54759e8-d4d3-41a7-b0ab-be832c424547 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:30.667241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b54759e8-d4d3-41a7-b0ab-be832c424547 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158320 May 23 14:01:30.667826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1546/3170] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:30 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:30.683014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-952e7edd-8ef2-47fd-bbd3-569f89e67c88 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:30.683674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-952e7edd-8ef2-47fd-bbd3-569f89e67c88 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:30.690077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-952e7edd-8ef2-47fd-bbd3-569f89e67c88 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.690530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-952e7edd-8ef2-47fd-bbd3-569f89e67c88 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.691296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-952e7edd-8ef2-47fd-bbd3-569f89e67c88 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:30.692117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-952e7edd-8ef2-47fd-bbd3-569f89e67c88 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:30.713737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:30.723089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:30.724459 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:30.725725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-088e96f9-431b-43c7-83ae-ee882719dc59 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092850 May 23 14:01:30.726348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1625/3171] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:30 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:30.821240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-952e7edd-8ef2-47fd-bbd3-569f89e67c88 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:30.830407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-952e7edd-8ef2-47fd-bbd3-569f89e67c88 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.151550 May 23 14:01:30.830977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1547/3172] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:30 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:31.162488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1669195-2abd-4f3a-80f9-d82ebf63c89b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:31.163117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e1669195-2abd-4f3a-80f9-d82ebf63c89b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:31.169176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1669195-2abd-4f3a-80f9-d82ebf63c89b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.169634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1669195-2abd-4f3a-80f9-d82ebf63c89b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.170401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1669195-2abd-4f3a-80f9-d82ebf63c89b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.171011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1669195-2abd-4f3a-80f9-d82ebf63c89b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.307677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1669195-2abd-4f3a-80f9-d82ebf63c89b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:31.316156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1669195-2abd-4f3a-80f9-d82ebf63c89b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157556 May 23 14:01:31.316764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1626/3173] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:31 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:31.574319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e80b761a-7bed-48dd-abd9-542915de9fb4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:31.574890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e80b761a-7bed-48dd-abd9-542915de9fb4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:31.581594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e80b761a-7bed-48dd-abd9-542915de9fb4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.582034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e80b761a-7bed-48dd-abd9-542915de9fb4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.582781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e80b761a-7bed-48dd-abd9-542915de9fb4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.583218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e80b761a-7bed-48dd-abd9-542915de9fb4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.649731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e80b761a-7bed-48dd-abd9-542915de9fb4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:31.653290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:31.658054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e80b761a-7bed-48dd-abd9-542915de9fb4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087651 May 23 14:01:31.658668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1548/3174] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:31 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:31.685127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2410292e-ce1f-4388-9afc-c1143952a3ac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:31.685752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2410292e-ce1f-4388-9afc-c1143952a3ac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:31.693255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2410292e-ce1f-4388-9afc-c1143952a3ac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.693712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2410292e-ce1f-4388-9afc-c1143952a3ac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.694478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2410292e-ce1f-4388-9afc-c1143952a3ac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.694918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2410292e-ce1f-4388-9afc-c1143952a3ac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.713145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:31.743676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:31.744330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:31.751864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.752317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.753121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.753560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.816444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:31.825003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:31.826515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:31.827360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2410292e-ce1f-4388-9afc-c1143952a3ac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:31.827929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a59f1f34-cb87-48ff-800d-aa187e95a684 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.088313 May 23 14:01:31.828487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1549/3175] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:31 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:31.835683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2410292e-ce1f-4388-9afc-c1143952a3ac tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.154529 May 23 14:01:31.836252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1627/3176] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:31 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:31.847593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-25428faf-ad83-4990-a34d-bc962bbfa977 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:31.848204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-25428faf-ad83-4990-a34d-bc962bbfa977 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:31.854232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25428faf-ad83-4990-a34d-bc962bbfa977 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.854673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25428faf-ad83-4990-a34d-bc962bbfa977 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.855427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25428faf-ad83-4990-a34d-bc962bbfa977 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:31.855859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25428faf-ad83-4990-a34d-bc962bbfa977 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:31.994946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25428faf-ad83-4990-a34d-bc962bbfa977 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:32.002905 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-25428faf-ad83-4990-a34d-bc962bbfa977 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159139 May 23 14:01:32.003483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1550/3177] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:31 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:32.334140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6760413a-80ab-416b-bbc2-94bde9d3e517 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:32.334787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6760413a-80ab-416b-bbc2-94bde9d3e517 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:32.341069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6760413a-80ab-416b-bbc2-94bde9d3e517 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:32.341651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6760413a-80ab-416b-bbc2-94bde9d3e517 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:32.342424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6760413a-80ab-416b-bbc2-94bde9d3e517 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:32.343444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6760413a-80ab-416b-bbc2-94bde9d3e517 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:32.471475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6760413a-80ab-416b-bbc2-94bde9d3e517 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:32.479729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6760413a-80ab-416b-bbc2-94bde9d3e517 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.149499 May 23 14:01:32.480312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1628/3178] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:32 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:32.679271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e0c79809-9ff2-417a-acff-ea5d4d695326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:32.679863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e0c79809-9ff2-417a-acff-ea5d4d695326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:32.687429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0c79809-9ff2-417a-acff-ea5d4d695326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:32.687609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0c79809-9ff2-417a-acff-ea5d4d695326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:32.688331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0c79809-9ff2-417a-acff-ea5d4d695326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:32.688806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0c79809-9ff2-417a-acff-ea5d4d695326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:32.751172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e0c79809-9ff2-417a-acff-ea5d4d695326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:32.759171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e0c79809-9ff2-417a-acff-ea5d4d695326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083709 May 23 14:01:32.759744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1551/3179] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:32 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:32.846093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:32.851016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:32.852164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-613acfd6-9f52-430c-841a-146409d3d34d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:32.852814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-613acfd6-9f52-430c-841a-146409d3d34d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:32.857884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:32.858782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:32.858998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-613acfd6-9f52-430c-841a-146409d3d34d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:32.859300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:32.859450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-613acfd6-9f52-430c-841a-146409d3d34d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:32.859739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:32.860206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-613acfd6-9f52-430c-841a-146409d3d34d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:32.860666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-613acfd6-9f52-430c-841a-146409d3d34d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:32.929027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:32.939194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:32.940754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:32.941923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d764486d-7c1a-4110-89d8-9dfeac9d1c04 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.100115 May 23 14:01:32.942490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1629/3180] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:32 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:33.005382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-613acfd6-9f52-430c-841a-146409d3d34d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:33.013447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-613acfd6-9f52-430c-841a-146409d3d34d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165026 May 23 14:01:33.014177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1552/3181] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:32 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:33.019156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b0f4eef3-b948-48ff-bf23-3d927d0c537a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:33.020135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b0f4eef3-b948-48ff-bf23-3d927d0c537a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:33.025878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0f4eef3-b948-48ff-bf23-3d927d0c537a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:33.026334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0f4eef3-b948-48ff-bf23-3d927d0c537a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:33.027089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0f4eef3-b948-48ff-bf23-3d927d0c537a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:33.027527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0f4eef3-b948-48ff-bf23-3d927d0c537a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:33.162918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b0f4eef3-b948-48ff-bf23-3d927d0c537a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:33.168089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b0f4eef3-b948-48ff-bf23-3d927d0c537a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.152804 May 23 14:01:33.168743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1630/3182] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:33 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:33.497638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a3ff6fbf-fb0c-4f22-90f9-69b889e527e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:33.498246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a3ff6fbf-fb0c-4f22-90f9-69b889e527e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:33.504609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3ff6fbf-fb0c-4f22-90f9-69b889e527e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:33.505069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3ff6fbf-fb0c-4f22-90f9-69b889e527e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:33.505823 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3ff6fbf-fb0c-4f22-90f9-69b889e527e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:33.506256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3ff6fbf-fb0c-4f22-90f9-69b889e527e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:33.638367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a3ff6fbf-fb0c-4f22-90f9-69b889e527e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:33.646414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a3ff6fbf-fb0c-4f22-90f9-69b889e527e8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.152626 May 23 14:01:33.646981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1553/3183] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:33 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:33.777220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3de409a8-3454-4631-8658-6fc43a829f14 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:33.777748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3de409a8-3454-4631-8658-6fc43a829f14 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:33.784647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3de409a8-3454-4631-8658-6fc43a829f14 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:33.785106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3de409a8-3454-4631-8658-6fc43a829f14 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:33.785929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3de409a8-3454-4631-8658-6fc43a829f14 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:33.786316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3de409a8-3454-4631-8658-6fc43a829f14 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:33.850432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3de409a8-3454-4631-8658-6fc43a829f14 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:33.858529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3de409a8-3454-4631-8658-6fc43a829f14 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085176 May 23 14:01:33.859088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1631/3184] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:33 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:33.963644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:33.964237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:33.971716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:33.972161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:33.973473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:33.973473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:34.031572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85fb9650-a191-459f-b2c0-2fc90e67f8d8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:34.032103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85fb9650-a191-459f-b2c0-2fc90e67f8d8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:34.037140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:34.039224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85fb9650-a191-459f-b2c0-2fc90e67f8d8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:34.039684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85fb9650-a191-459f-b2c0-2fc90e67f8d8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:34.040463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85fb9650-a191-459f-b2c0-2fc90e67f8d8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:34.040950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85fb9650-a191-459f-b2c0-2fc90e67f8d8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:34.045607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:34.047117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:34.048249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9ccbeb3-4490-488a-85de-e055bc535697 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090982 May 23 14:01:34.048835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1554/3185] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:33 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:34.173138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-85fb9650-a191-459f-b2c0-2fc90e67f8d8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:34.181233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85fb9650-a191-459f-b2c0-2fc90e67f8d8 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.154221 May 23 14:01:34.182102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1632/3186] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:34 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:34.186870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d57f521a-d54a-4d9b-9c3b-ba8c0fa0c224 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:34.187685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d57f521a-d54a-4d9b-9c3b-ba8c0fa0c224 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:34.193887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d57f521a-d54a-4d9b-9c3b-ba8c0fa0c224 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:34.194334 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d57f521a-d54a-4d9b-9c3b-ba8c0fa0c224 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:34.195078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d57f521a-d54a-4d9b-9c3b-ba8c0fa0c224 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:34.195503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d57f521a-d54a-4d9b-9c3b-ba8c0fa0c224 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:34.328464 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d57f521a-d54a-4d9b-9c3b-ba8c0fa0c224 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:34.336730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d57f521a-d54a-4d9b-9c3b-ba8c0fa0c224 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154554 May 23 14:01:34.337314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1555/3187] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:34 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:34.665074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e82c1e25-12fb-46da-8e57-b07f05a07e24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:34.665711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e82c1e25-12fb-46da-8e57-b07f05a07e24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:34.672345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e82c1e25-12fb-46da-8e57-b07f05a07e24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:34.672825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e82c1e25-12fb-46da-8e57-b07f05a07e24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:34.673596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e82c1e25-12fb-46da-8e57-b07f05a07e24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:34.674031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e82c1e25-12fb-46da-8e57-b07f05a07e24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:34.802972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e82c1e25-12fb-46da-8e57-b07f05a07e24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:34.811080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e82c1e25-12fb-46da-8e57-b07f05a07e24 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.149907 May 23 14:01:34.811831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1633/3188] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:34 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:34.875558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b0f54745-8851-4fdd-9abb-e7ed31e669a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:34.876155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b0f54745-8851-4fdd-9abb-e7ed31e669a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:34.882292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0f54745-8851-4fdd-9abb-e7ed31e669a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:34.882733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0f54745-8851-4fdd-9abb-e7ed31e669a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:34.883487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0f54745-8851-4fdd-9abb-e7ed31e669a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:34.883914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0f54745-8851-4fdd-9abb-e7ed31e669a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:34.952152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b0f54745-8851-4fdd-9abb-e7ed31e669a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:34.957915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b0f54745-8851-4fdd-9abb-e7ed31e669a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086098 May 23 14:01:34.958873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1556/3189] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:34 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:35.066404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:35.067026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:35.073563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.074016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:35.074781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.075222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:35.137813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:35.146394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:35.147917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:35.149097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1e142f51-6f59-4cb7-8815-0c26f62393c9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.086715 May 23 14:01:35.149660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1634/3190] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:35 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:35.198774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7d48cbb-b60a-43e4-8ec1-48d67123339c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:35.199335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7d48cbb-b60a-43e4-8ec1-48d67123339c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:35.206361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7d48cbb-b60a-43e4-8ec1-48d67123339c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.206793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7d48cbb-b60a-43e4-8ec1-48d67123339c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:35.207599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7d48cbb-b60a-43e4-8ec1-48d67123339c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.208030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7d48cbb-b60a-43e4-8ec1-48d67123339c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:35.343808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7d48cbb-b60a-43e4-8ec1-48d67123339c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:35.351784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7d48cbb-b60a-43e4-8ec1-48d67123339c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156907 May 23 14:01:35.352348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1557/3191] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:35 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:35.355043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2e1250b-36c5-4235-8c08-38bfe76cacd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:35.355665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c2e1250b-36c5-4235-8c08-38bfe76cacd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:35.362964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2e1250b-36c5-4235-8c08-38bfe76cacd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.363461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2e1250b-36c5-4235-8c08-38bfe76cacd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:35.364271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2e1250b-36c5-4235-8c08-38bfe76cacd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.364753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2e1250b-36c5-4235-8c08-38bfe76cacd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:35.499659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c2e1250b-36c5-4235-8c08-38bfe76cacd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:35.507679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2e1250b-36c5-4235-8c08-38bfe76cacd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156568 May 23 14:01:35.508245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1635/3192] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:35 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:35.828781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f2ac270-7ec0-402c-a61b-88d39b2c759b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:35.829374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f2ac270-7ec0-402c-a61b-88d39b2c759b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:35.835426 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f2ac270-7ec0-402c-a61b-88d39b2c759b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.835868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f2ac270-7ec0-402c-a61b-88d39b2c759b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:35.836636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f2ac270-7ec0-402c-a61b-88d39b2c759b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.837063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f2ac270-7ec0-402c-a61b-88d39b2c759b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:35.975327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8f2ac270-7ec0-402c-a61b-88d39b2c759b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:35.975531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12e339e1-796c-4d11-92ae-90f604ecc946 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:35.975999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12e339e1-796c-4d11-92ae-90f604ecc946 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:35.982038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12e339e1-796c-4d11-92ae-90f604ecc946 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.982490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12e339e1-796c-4d11-92ae-90f604ecc946 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:35.983760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f2ac270-7ec0-402c-a61b-88d39b2c759b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159320 May 23 14:01:35.983974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12e339e1-796c-4d11-92ae-90f604ecc946 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:35.984656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1558/3193] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:35 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:35.984799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12e339e1-796c-4d11-92ae-90f604ecc946 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:36.052097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12e339e1-796c-4d11-92ae-90f604ecc946 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:36.060451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12e339e1-796c-4d11-92ae-90f604ecc946 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089014 May 23 14:01:36.061756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1636/3194] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:35 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:36.167420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:36.168063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:36.175532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:36.176020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:36.176828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:36.177274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:36.241671 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:36.251550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:36.253077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:36.254215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-499db006-281e-44e7-853a-de4e32c18fc9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090764 May 23 14:01:36.254764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1559/3195] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:36 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:36.367911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-140608f8-fa0c-49b5-8efd-9d43c398eed2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:36.368532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-140608f8-fa0c-49b5-8efd-9d43c398eed2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:36.375790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-140608f8-fa0c-49b5-8efd-9d43c398eed2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:36.376242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-140608f8-fa0c-49b5-8efd-9d43c398eed2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:36.377037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-140608f8-fa0c-49b5-8efd-9d43c398eed2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:36.377482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-140608f8-fa0c-49b5-8efd-9d43c398eed2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:36.504891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-140608f8-fa0c-49b5-8efd-9d43c398eed2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:36.512726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-140608f8-fa0c-49b5-8efd-9d43c398eed2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.148667 May 23 14:01:36.513293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1637/3196] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:36 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:36.525704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aa6b8786-914e-482f-8f4f-f500eac9fbae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:36.526316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aa6b8786-914e-482f-8f4f-f500eac9fbae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:36.533311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa6b8786-914e-482f-8f4f-f500eac9fbae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:36.533762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa6b8786-914e-482f-8f4f-f500eac9fbae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:36.534555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa6b8786-914e-482f-8f4f-f500eac9fbae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:36.535007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa6b8786-914e-482f-8f4f-f500eac9fbae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:36.669978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aa6b8786-914e-482f-8f4f-f500eac9fbae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:36.679586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aa6b8786-914e-482f-8f4f-f500eac9fbae tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.157873 May 23 14:01:36.680177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1560/3197] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:36 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:37.001421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-de38dff1-111d-4730-a2c9-0f5143c2e5ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:37.002036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-de38dff1-111d-4730-a2c9-0f5143c2e5ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:37.008026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de38dff1-111d-4730-a2c9-0f5143c2e5ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.008499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de38dff1-111d-4730-a2c9-0f5143c2e5ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.009289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de38dff1-111d-4730-a2c9-0f5143c2e5ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.009729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de38dff1-111d-4730-a2c9-0f5143c2e5ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.078981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4c32588e-5d6e-44b2-8f81-de29118ef062 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:37.079595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4c32588e-5d6e-44b2-8f81-de29118ef062 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:37.085975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c32588e-5d6e-44b2-8f81-de29118ef062 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.086613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c32588e-5d6e-44b2-8f81-de29118ef062 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.087373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c32588e-5d6e-44b2-8f81-de29118ef062 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.087804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c32588e-5d6e-44b2-8f81-de29118ef062 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.146861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de38dff1-111d-4730-a2c9-0f5143c2e5ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:37.152310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4c32588e-5d6e-44b2-8f81-de29118ef062 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:37.155402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-de38dff1-111d-4730-a2c9-0f5143c2e5ba tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.157901 May 23 14:01:37.156002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1638/3198] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:36 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:37.161158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4c32588e-5d6e-44b2-8f81-de29118ef062 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086594 May 23 14:01:37.161733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1561/3199] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:37 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:37.273881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:37.274411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:37.284021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.284867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.286148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.286591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.352982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:37.362293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:37.363811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:37.365011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6085ab10-ad30-42e6-a83f-33ab54fea559 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.095143 May 23 14:01:37.365579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1639/3200] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:37 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:37.531944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e5cf139-cc00-42b8-8c30-2968b5e706fe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:37.532993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1e5cf139-cc00-42b8-8c30-2968b5e706fe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:37.543236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e5cf139-cc00-42b8-8c30-2968b5e706fe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.543673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e5cf139-cc00-42b8-8c30-2968b5e706fe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.544432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e5cf139-cc00-42b8-8c30-2968b5e706fe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.544993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e5cf139-cc00-42b8-8c30-2968b5e706fe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.680074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1e5cf139-cc00-42b8-8c30-2968b5e706fe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:37.689242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1e5cf139-cc00-42b8-8c30-2968b5e706fe tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.162126 May 23 14:01:37.689832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1562/3201] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:37 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:37.697621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9945ee1c-cb31-4617-8195-6b5574f88768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:37.698231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9945ee1c-cb31-4617-8195-6b5574f88768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:37.705649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9945ee1c-cb31-4617-8195-6b5574f88768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.706099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9945ee1c-cb31-4617-8195-6b5574f88768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.706857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9945ee1c-cb31-4617-8195-6b5574f88768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:37.707293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9945ee1c-cb31-4617-8195-6b5574f88768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:37.849299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9945ee1c-cb31-4617-8195-6b5574f88768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:37.858560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9945ee1c-cb31-4617-8195-6b5574f88768 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164722 May 23 14:01:37.859149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1640/3202] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:37 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:38.173521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-acd97722-8faf-4bc1-ae1f-b63199257c0e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:38.174121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-acd97722-8faf-4bc1-ae1f-b63199257c0e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:38.178143 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-62640b42-e82f-4ec2-8005-0f65c55f6647 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:38.178861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-62640b42-e82f-4ec2-8005-0f65c55f6647 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:38.180419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acd97722-8faf-4bc1-ae1f-b63199257c0e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.185527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acd97722-8faf-4bc1-ae1f-b63199257c0e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:38.185527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acd97722-8faf-4bc1-ae1f-b63199257c0e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.185527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acd97722-8faf-4bc1-ae1f-b63199257c0e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:38.185930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62640b42-e82f-4ec2-8005-0f65c55f6647 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.185930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62640b42-e82f-4ec2-8005-0f65c55f6647 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:38.186732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62640b42-e82f-4ec2-8005-0f65c55f6647 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.186974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62640b42-e82f-4ec2-8005-0f65c55f6647 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:38.274368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-62640b42-e82f-4ec2-8005-0f65c55f6647 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:38.283105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-62640b42-e82f-4ec2-8005-0f65c55f6647 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.108643 May 23 14:01:38.283690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1641/3203] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:38 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:38.331781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-acd97722-8faf-4bc1-ae1f-b63199257c0e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:38.340320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-acd97722-8faf-4bc1-ae1f-b63199257c0e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.171240 May 23 14:01:38.340941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1563/3204] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:38 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:38.385198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:38.385837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:38.392395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.392875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:38.393646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.394079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:38.458602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:38.467407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:38.468949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:38.470124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-54b56720-45bc-45a8-badd-ca4216a105ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089006 May 23 14:01:38.470690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1642/3205] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:38 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:38.706667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2b7434b8-9325-4203-a1c6-43794f76922f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:38.707247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2b7434b8-9325-4203-a1c6-43794f76922f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:38.713819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b7434b8-9325-4203-a1c6-43794f76922f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.714268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b7434b8-9325-4203-a1c6-43794f76922f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:38.715025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b7434b8-9325-4203-a1c6-43794f76922f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.715472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b7434b8-9325-4203-a1c6-43794f76922f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:38.847010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2b7434b8-9325-4203-a1c6-43794f76922f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:38.854887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2b7434b8-9325-4203-a1c6-43794f76922f tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.152298 May 23 14:01:38.855461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1564/3206] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:38 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:38.875312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f19816b-f724-439f-992b-8a0174a23c64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:38.876018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f19816b-f724-439f-992b-8a0174a23c64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:38.882435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f19816b-f724-439f-992b-8a0174a23c64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.882891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f19816b-f724-439f-992b-8a0174a23c64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:38.883657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f19816b-f724-439f-992b-8a0174a23c64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:38.884098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f19816b-f724-439f-992b-8a0174a23c64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:39.018331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2f19816b-f724-439f-992b-8a0174a23c64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:39.026396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f19816b-f724-439f-992b-8a0174a23c64 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154927 May 23 14:01:39.026969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1643/3207] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:38 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:39.300758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-12a92ca4-39af-49e3-8104-ee92240d4df0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:39.301289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-12a92ca4-39af-49e3-8104-ee92240d4df0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:39.307572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12a92ca4-39af-49e3-8104-ee92240d4df0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:39.308016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12a92ca4-39af-49e3-8104-ee92240d4df0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:39.308793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12a92ca4-39af-49e3-8104-ee92240d4df0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:39.309229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12a92ca4-39af-49e3-8104-ee92240d4df0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:39.329805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:39.358953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3134dd11-99d2-47f9-a318-472bb9dbd650 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:39.359647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3134dd11-99d2-47f9-a318-472bb9dbd650 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:39.365778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3134dd11-99d2-47f9-a318-472bb9dbd650 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:39.366301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3134dd11-99d2-47f9-a318-472bb9dbd650 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:39.367071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3134dd11-99d2-47f9-a318-472bb9dbd650 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:39.367590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3134dd11-99d2-47f9-a318-472bb9dbd650 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:39.372872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:39.373778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-12a92ca4-39af-49e3-8104-ee92240d4df0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:39.382533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-12a92ca4-39af-49e3-8104-ee92240d4df0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085853 May 23 14:01:39.383135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1565/3208] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:39 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:39.488264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:39.488909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:39.495252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:39.495708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:39.496481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:39.496946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:39.511509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3134dd11-99d2-47f9-a318-472bb9dbd650 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:39.524407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3134dd11-99d2-47f9-a318-472bb9dbd650 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.170033 May 23 14:01:39.525443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1644/3209] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:39 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:39.578249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:39.587335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:39.588910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:39.590094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c4b90a9e-eb7b-42f2-87c4-1b1e8510dc62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.105807 May 23 14:01:39.590814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1566/3210] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:39 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:39.873029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b859b20-4323-43c5-b55e-6c85c39bdfc9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:39.873648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b859b20-4323-43c5-b55e-6c85c39bdfc9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:39.880036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b859b20-4323-43c5-b55e-6c85c39bdfc9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:39.880641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b859b20-4323-43c5-b55e-6c85c39bdfc9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:39.881256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b859b20-4323-43c5-b55e-6c85c39bdfc9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:39.881692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b859b20-4323-43c5-b55e-6c85c39bdfc9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:40.016151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b859b20-4323-43c5-b55e-6c85c39bdfc9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:40.024423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b859b20-4323-43c5-b55e-6c85c39bdfc9 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155244 May 23 14:01:40.025229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1645/3211] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:39 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:40.044284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1b4f21e-2ad6-4d7d-aa57-10f63468b264 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:40.044957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1b4f21e-2ad6-4d7d-aa57-10f63468b264 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:40.047887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:40.052805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1b4f21e-2ad6-4d7d-aa57-10f63468b264 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:40.053261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1b4f21e-2ad6-4d7d-aa57-10f63468b264 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:40.054021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1b4f21e-2ad6-4d7d-aa57-10f63468b264 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:40.054460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1b4f21e-2ad6-4d7d-aa57-10f63468b264 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:40.188763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1b4f21e-2ad6-4d7d-aa57-10f63468b264 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:40.196930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1b4f21e-2ad6-4d7d-aa57-10f63468b264 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.156435 May 23 14:01:40.197511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1567/3212] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:40 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:40.399811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d9467c7-81aa-4d82-bb1b-4cb0bd3f6afe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:40.400346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d9467c7-81aa-4d82-bb1b-4cb0bd3f6afe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:40.406664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d9467c7-81aa-4d82-bb1b-4cb0bd3f6afe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:40.407121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d9467c7-81aa-4d82-bb1b-4cb0bd3f6afe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:40.407894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d9467c7-81aa-4d82-bb1b-4cb0bd3f6afe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:40.408340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d9467c7-81aa-4d82-bb1b-4cb0bd3f6afe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:40.471136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7d9467c7-81aa-4d82-bb1b-4cb0bd3f6afe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:40.479088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d9467c7-81aa-4d82-bb1b-4cb0bd3f6afe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083206 May 23 14:01:40.479659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1646/3213] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:40 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:40.550508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e6901de7-e617-44ed-a61f-8a12c4a94d96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:40.551123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e6901de7-e617-44ed-a61f-8a12c4a94d96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:40.557596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6901de7-e617-44ed-a61f-8a12c4a94d96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:40.558054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6901de7-e617-44ed-a61f-8a12c4a94d96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:40.558851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6901de7-e617-44ed-a61f-8a12c4a94d96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:40.559292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6901de7-e617-44ed-a61f-8a12c4a94d96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:40.610619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:40.614335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:40.619494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:40.619959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:40.620773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:40.621220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:40.701479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:40.711099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:40.712827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:40.712993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6901de7-e617-44ed-a61f-8a12c4a94d96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:40.714132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae6789ef-e0c1-43c6-ae9c-aba6a543030f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.108679 May 23 14:01:40.714847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1647/3214] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:40 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:40.722917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e6901de7-e617-44ed-a61f-8a12c4a94d96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.176206 May 23 14:01:40.723842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1568/3215] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:40 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:41.042536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9180e11a-b8c5-429d-a673-bd8a2bfae8e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:41.043145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9180e11a-b8c5-429d-a673-bd8a2bfae8e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:41.050455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9180e11a-b8c5-429d-a673-bd8a2bfae8e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.050937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9180e11a-b8c5-429d-a673-bd8a2bfae8e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.051735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9180e11a-b8c5-429d-a673-bd8a2bfae8e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.052178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9180e11a-b8c5-429d-a673-bd8a2bfae8e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.186564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9180e11a-b8c5-429d-a673-bd8a2bfae8e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:41.194798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9180e11a-b8c5-429d-a673-bd8a2bfae8e1 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.156306 May 23 14:01:41.195369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1648/3216] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:41 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:41.215543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1db2739b-4022-4202-8ff2-eb610522ebf9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:41.216164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1db2739b-4022-4202-8ff2-eb610522ebf9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:41.224107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1db2739b-4022-4202-8ff2-eb610522ebf9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.224558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1db2739b-4022-4202-8ff2-eb610522ebf9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.225360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1db2739b-4022-4202-8ff2-eb610522ebf9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.225796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1db2739b-4022-4202-8ff2-eb610522ebf9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.366300 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1db2739b-4022-4202-8ff2-eb610522ebf9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:41.374402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1db2739b-4022-4202-8ff2-eb610522ebf9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.162889 May 23 14:01:41.375057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1569/3217] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:41 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:41.497934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d82b76ca-e552-4f3f-b28d-5819e5f85a36 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:41.498558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d82b76ca-e552-4f3f-b28d-5819e5f85a36 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:41.505304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d82b76ca-e552-4f3f-b28d-5819e5f85a36 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.505758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d82b76ca-e552-4f3f-b28d-5819e5f85a36 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.506523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d82b76ca-e552-4f3f-b28d-5819e5f85a36 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.506965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d82b76ca-e552-4f3f-b28d-5819e5f85a36 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.568761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d82b76ca-e552-4f3f-b28d-5819e5f85a36 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:41.576643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d82b76ca-e552-4f3f-b28d-5819e5f85a36 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.082694 May 23 14:01:41.577207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1649/3218] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:41 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:41.733063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:41.733674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:41.740826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.741118 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a0020c28-d2c1-4a10-ae88-d9265d21b42d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:41.741270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.741732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a0020c28-d2c1-4a10-ae88-d9265d21b42d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:41.742032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.742475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.747715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0020c28-d2c1-4a10-ae88-d9265d21b42d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.748170 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0020c28-d2c1-4a10-ae88-d9265d21b42d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.748962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0020c28-d2c1-4a10-ae88-d9265d21b42d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:41.749403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0020c28-d2c1-4a10-ae88-d9265d21b42d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:41.811076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:41.821140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:41.822610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:41.823762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ec277727-715c-4014-b15b-ba6ea36b8e7d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094653 May 23 14:01:41.824712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1570/3219] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:41 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:41.887006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a0020c28-d2c1-4a10-ae88-d9265d21b42d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:41.895977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a0020c28-d2c1-4a10-ae88-d9265d21b42d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.158627 May 23 14:01:41.896557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1650/3220] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:41 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:42.213094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ed21de1-dd3d-4ee5-b7d8-47058f4a2b0b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:42.213696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ed21de1-dd3d-4ee5-b7d8-47058f4a2b0b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:42.221015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ed21de1-dd3d-4ee5-b7d8-47058f4a2b0b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.221635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ed21de1-dd3d-4ee5-b7d8-47058f4a2b0b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.222206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ed21de1-dd3d-4ee5-b7d8-47058f4a2b0b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.222639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ed21de1-dd3d-4ee5-b7d8-47058f4a2b0b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.366331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ed21de1-dd3d-4ee5-b7d8-47058f4a2b0b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:42.374693 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ed21de1-dd3d-4ee5-b7d8-47058f4a2b0b tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.165299 May 23 14:01:42.375244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1571/3221] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:42 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:42.391207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-38bb68aa-eec5-4e35-b79e-ca7c55a2efee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:42.391852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-38bb68aa-eec5-4e35-b79e-ca7c55a2efee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:42.398528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38bb68aa-eec5-4e35-b79e-ca7c55a2efee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.398983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38bb68aa-eec5-4e35-b79e-ca7c55a2efee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.399749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38bb68aa-eec5-4e35-b79e-ca7c55a2efee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.400222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-38bb68aa-eec5-4e35-b79e-ca7c55a2efee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.507210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:01:42.507484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:01:42.533518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-38bb68aa-eec5-4e35-b79e-ca7c55a2efee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:42.541664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-38bb68aa-eec5-4e35-b79e-ca7c55a2efee tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.154315 May 23 14:01:42.542236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1651/3222] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:42 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:42.595869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a99e7d4e-b94b-4240-8d2d-dd7e319ded74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:42.596505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a99e7d4e-b94b-4240-8d2d-dd7e319ded74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:42.602938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a99e7d4e-b94b-4240-8d2d-dd7e319ded74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.603418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a99e7d4e-b94b-4240-8d2d-dd7e319ded74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.604195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a99e7d4e-b94b-4240-8d2d-dd7e319ded74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.604667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a99e7d4e-b94b-4240-8d2d-dd7e319ded74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.672788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a99e7d4e-b94b-4240-8d2d-dd7e319ded74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:42.680998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a99e7d4e-b94b-4240-8d2d-dd7e319ded74 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090600 May 23 14:01:42.681835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1572/3223] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:42 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:42.842287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:42.842814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:42.849116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.849546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.850298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.850736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.912500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:42.913154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d16350d-56f1-40aa-833c-c034f0a79423 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:42.913770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6d16350d-56f1-40aa-833c-c034f0a79423 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:42.920045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d16350d-56f1-40aa-833c-c034f0a79423 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.920490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d16350d-56f1-40aa-833c-c034f0a79423 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.921173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:42.921388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d16350d-56f1-40aa-833c-c034f0a79423 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:42.921881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6d16350d-56f1-40aa-833c-c034f0a79423 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:42.922835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:42.924013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dca45bce-1ee5-484b-bb8e-b971f88f7e78 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.085763 May 23 14:01:42.924811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1652/3224] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:42 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:43.053083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6d16350d-56f1-40aa-833c-c034f0a79423 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:43.061555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d16350d-56f1-40aa-833c-c034f0a79423 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.152190 May 23 14:01:43.062685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1573/3225] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:42 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:43.392898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c4a75e3-798b-4f20-84c9-63f90bf545ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:43.393506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c4a75e3-798b-4f20-84c9-63f90bf545ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:43.395958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:43.401145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4a75e3-798b-4f20-84c9-63f90bf545ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:43.401529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4a75e3-798b-4f20-84c9-63f90bf545ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:43.402338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4a75e3-798b-4f20-84c9-63f90bf545ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:43.402787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c4a75e3-798b-4f20-84c9-63f90bf545ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:43.537600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c4a75e3-798b-4f20-84c9-63f90bf545ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:43.545495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c4a75e3-798b-4f20-84c9-63f90bf545ee tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.157260 May 23 14:01:43.546054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1653/3226] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:43 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:43.559427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b092b986-8910-4122-8d73-2c3042863668 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:43.560079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b092b986-8910-4122-8d73-2c3042863668 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:43.567536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b092b986-8910-4122-8d73-2c3042863668 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:43.567985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b092b986-8910-4122-8d73-2c3042863668 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:43.568818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b092b986-8910-4122-8d73-2c3042863668 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:43.569259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b092b986-8910-4122-8d73-2c3042863668 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:43.699355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a51e6fad-fe6a-490d-a2c5-b5dbd07441c3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:43.699969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a51e6fad-fe6a-490d-a2c5-b5dbd07441c3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:43.706361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a51e6fad-fe6a-490d-a2c5-b5dbd07441c3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:43.706817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a51e6fad-fe6a-490d-a2c5-b5dbd07441c3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:43.707440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b092b986-8910-4122-8d73-2c3042863668 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:43.707593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a51e6fad-fe6a-490d-a2c5-b5dbd07441c3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:43.708006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a51e6fad-fe6a-490d-a2c5-b5dbd07441c3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:43.715511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b092b986-8910-4122-8d73-2c3042863668 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160034 May 23 14:01:43.715974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1574/3227] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:43 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:43.770895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a51e6fad-fe6a-490d-a2c5-b5dbd07441c3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:43.779183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a51e6fad-fe6a-490d-a2c5-b5dbd07441c3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083697 May 23 14:01:43.779753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1654/3228] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:43 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:43.942529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:43.943131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:43.950106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:43.950565 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:43.951323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:43.951756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:44.018070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:44.026691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:44.028141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:44.029314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9d57e2ba-9fb4-4b6b-a6c7-80785547bd34 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.090737 May 23 14:01:44.029947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1575/3229] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:43 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:44.078998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-46a48b45-649a-4151-996a-ec60b7784924 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:44.079610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-46a48b45-649a-4151-996a-ec60b7784924 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:44.085741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46a48b45-649a-4151-996a-ec60b7784924 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:44.086197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46a48b45-649a-4151-996a-ec60b7784924 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:44.086957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46a48b45-649a-4151-996a-ec60b7784924 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:44.087397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46a48b45-649a-4151-996a-ec60b7784924 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:44.220131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-46a48b45-649a-4151-996a-ec60b7784924 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:44.228056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-46a48b45-649a-4151-996a-ec60b7784924 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.153124 May 23 14:01:44.228649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1655/3230] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:44 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:44.565108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-12d855be-8b4e-4ee9-a77e-4111527c2c1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:44.565722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-12d855be-8b4e-4ee9-a77e-4111527c2c1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:44.572680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12d855be-8b4e-4ee9-a77e-4111527c2c1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:44.573130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12d855be-8b4e-4ee9-a77e-4111527c2c1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:44.573884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12d855be-8b4e-4ee9-a77e-4111527c2c1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:44.574316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12d855be-8b4e-4ee9-a77e-4111527c2c1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:44.707733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-12d855be-8b4e-4ee9-a77e-4111527c2c1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:44.715810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-12d855be-8b4e-4ee9-a77e-4111527c2c1a tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.155245 May 23 14:01:44.716378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1576/3231] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:44 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:44.732591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fc026413-7769-4168-8c95-e06cdff54b21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:44.733252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fc026413-7769-4168-8c95-e06cdff54b21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:44.739932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc026413-7769-4168-8c95-e06cdff54b21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:44.740329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc026413-7769-4168-8c95-e06cdff54b21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:44.741123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc026413-7769-4168-8c95-e06cdff54b21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:44.741561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc026413-7769-4168-8c95-e06cdff54b21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:44.796838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-12c2113a-c578-4851-9bf4-63532a7fa1c8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:44.797459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-12c2113a-c578-4851-9bf4-63532a7fa1c8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:44.804237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12c2113a-c578-4851-9bf4-63532a7fa1c8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:44.804798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12c2113a-c578-4851-9bf4-63532a7fa1c8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:44.805576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12c2113a-c578-4851-9bf4-63532a7fa1c8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:44.806016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12c2113a-c578-4851-9bf4-63532a7fa1c8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:44.882569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fc026413-7769-4168-8c95-e06cdff54b21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:44.891186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fc026413-7769-4168-8c95-e06cdff54b21 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.161933 May 23 14:01:44.892134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1656/3232] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:44 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:44.894651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-12c2113a-c578-4851-9bf4-63532a7fa1c8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:44.902678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-12c2113a-c578-4851-9bf4-63532a7fa1c8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.109817 May 23 14:01:44.903244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1577/3233] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:44 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:45.053033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:45.053556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:45.059982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.060429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:45.061221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.061652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:45.123847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:45.133221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:45.134725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:45.135871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae3f7601-3c83-4608-9ad3-aab8e807a671 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.086981 May 23 14:01:45.136416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1657/3234] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:45 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:45.245057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-089a8a2c-dab3-4d87-a377-3acd1f47729b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:45.245707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-089a8a2c-dab3-4d87-a377-3acd1f47729b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:45.253110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089a8a2c-dab3-4d87-a377-3acd1f47729b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.253563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089a8a2c-dab3-4d87-a377-3acd1f47729b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:45.254327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089a8a2c-dab3-4d87-a377-3acd1f47729b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.254768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089a8a2c-dab3-4d87-a377-3acd1f47729b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:45.389169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-089a8a2c-dab3-4d87-a377-3acd1f47729b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:45.397930 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-089a8a2c-dab3-4d87-a377-3acd1f47729b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.156676 May 23 14:01:45.398537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1578/3235] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:45 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:45.734804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66d83759-52e8-4024-856c-7ac21b88324d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:45.736153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-66d83759-52e8-4024-856c-7ac21b88324d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:45.746034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66d83759-52e8-4024-856c-7ac21b88324d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.746504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66d83759-52e8-4024-856c-7ac21b88324d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:45.747481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66d83759-52e8-4024-856c-7ac21b88324d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.747929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66d83759-52e8-4024-856c-7ac21b88324d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:45.903071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-66d83759-52e8-4024-856c-7ac21b88324d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:45.910877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8b9db82-3e87-4a3d-a650-b025879a6ea1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:45.911898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8b9db82-3e87-4a3d-a650-b025879a6ea1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:45.913406 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-66d83759-52e8-4024-856c-7ac21b88324d tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.183970 May 23 14:01:45.914100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1658/3236] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:45 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:45.923825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df4b9091-b6be-46ed-a136-0bc6e3fb4bfe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:45.923825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df4b9091-b6be-46ed-a136-0bc6e3fb4bfe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:45.925408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8b9db82-3e87-4a3d-a650-b025879a6ea1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.926000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8b9db82-3e87-4a3d-a650-b025879a6ea1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:45.927467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8b9db82-3e87-4a3d-a650-b025879a6ea1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.928265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8b9db82-3e87-4a3d-a650-b025879a6ea1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:45.930533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df4b9091-b6be-46ed-a136-0bc6e3fb4bfe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.930979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df4b9091-b6be-46ed-a136-0bc6e3fb4bfe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:45.932027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df4b9091-b6be-46ed-a136-0bc6e3fb4bfe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:45.932722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df4b9091-b6be-46ed-a136-0bc6e3fb4bfe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:46.027618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df4b9091-b6be-46ed-a136-0bc6e3fb4bfe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:46.037284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df4b9091-b6be-46ed-a136-0bc6e3fb4bfe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.118585 May 23 14:01:46.037996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1659/3237] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:45 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:46.115529 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a8b9db82-3e87-4a3d-a650-b025879a6ea1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:46.126408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8b9db82-3e87-4a3d-a650-b025879a6ea1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.221332 May 23 14:01:46.127434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1579/3238] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:45 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:46.156104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:46.157150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:46.164152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:46.164648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:46.165447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:46.165892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:46.245585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:46.249904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:46.256753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:46.262255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:46.262255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2e6fe5d8-ffd6-48db-b228-843226e793aa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.108589 May 23 14:01:46.262255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1660/3239] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:46 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:46.416932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4f442fb3-8e68-469a-9fa7-46fa2b37d72d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:46.417556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4f442fb3-8e68-469a-9fa7-46fa2b37d72d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:46.424335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f442fb3-8e68-469a-9fa7-46fa2b37d72d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:46.424839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f442fb3-8e68-469a-9fa7-46fa2b37d72d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:46.425611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f442fb3-8e68-469a-9fa7-46fa2b37d72d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:46.426053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f442fb3-8e68-469a-9fa7-46fa2b37d72d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:46.564816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4f442fb3-8e68-469a-9fa7-46fa2b37d72d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:46.573434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4f442fb3-8e68-469a-9fa7-46fa2b37d72d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.160438 May 23 14:01:46.574017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1580/3240] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:46 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:46.945232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-05efd79f-d6ae-4046-b9f4-4d3d8c0cdfb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:46.945840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-05efd79f-d6ae-4046-b9f4-4d3d8c0cdfb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:46.954545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-05efd79f-d6ae-4046-b9f4-4d3d8c0cdfb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:46.954914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-05efd79f-d6ae-4046-b9f4-4d3d8c0cdfb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:46.955720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-05efd79f-d6ae-4046-b9f4-4d3d8c0cdfb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:46.956508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-05efd79f-d6ae-4046-b9f4-4d3d8c0cdfb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:47.057346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba6594e3-5eab-43f8-91fb-30d9e56175c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:47.057962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba6594e3-5eab-43f8-91fb-30d9e56175c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:47.065234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba6594e3-5eab-43f8-91fb-30d9e56175c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:47.065695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba6594e3-5eab-43f8-91fb-30d9e56175c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:47.066468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba6594e3-5eab-43f8-91fb-30d9e56175c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:47.066907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba6594e3-5eab-43f8-91fb-30d9e56175c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:47.103792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-05efd79f-d6ae-4046-b9f4-4d3d8c0cdfb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:47.113322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-05efd79f-d6ae-4046-b9f4-4d3d8c0cdfb2 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.173238 May 23 14:01:47.113909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1661/3241] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:46 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:47.131657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba6594e3-5eab-43f8-91fb-30d9e56175c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:47.140733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba6594e3-5eab-43f8-91fb-30d9e56175c5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086851 May 23 14:01:47.141471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1581/3242] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:47 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:47.144842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9e59ddd-2bdf-4619-bc68-5a933e24c4f9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:47.145501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9e59ddd-2bdf-4619-bc68-5a933e24c4f9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:47.151886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9e59ddd-2bdf-4619-bc68-5a933e24c4f9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:47.152349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9e59ddd-2bdf-4619-bc68-5a933e24c4f9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:47.153165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9e59ddd-2bdf-4619-bc68-5a933e24c4f9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:47.153611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9e59ddd-2bdf-4619-bc68-5a933e24c4f9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:47.279333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:47.279945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:47.286140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:47.286584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:47.287340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:47.287775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:47.291900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:47.296709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9e59ddd-2bdf-4619-bc68-5a933e24c4f9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:47.304984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9e59ddd-2bdf-4619-bc68-5a933e24c4f9 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.165018 May 23 14:01:47.308807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1662/3243] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:47 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:47.357630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:47.367009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:47.368372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:47.369627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e60d0027-511b-4f9d-8a1d-aae6cb205dba tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.094301 May 23 14:01:47.370189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1582/3244] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:47 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:47.591460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10a58046-c033-4669-9374-6f72c77ea975 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:47.591991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10a58046-c033-4669-9374-6f72c77ea975 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:47.598213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10a58046-c033-4669-9374-6f72c77ea975 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:47.598667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10a58046-c033-4669-9374-6f72c77ea975 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:47.599438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10a58046-c033-4669-9374-6f72c77ea975 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:47.599882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10a58046-c033-4669-9374-6f72c77ea975 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:47.733245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10a58046-c033-4669-9374-6f72c77ea975 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:47.742276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10a58046-c033-4669-9374-6f72c77ea975 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.154662 May 23 14:01:47.742862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1663/3245] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:47 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:48.131582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9829a6c9-b533-4613-beb1-75cfdc4ba802 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:48.132185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9829a6c9-b533-4613-beb1-75cfdc4ba802 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:48.141549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9829a6c9-b533-4613-beb1-75cfdc4ba802 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.141996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9829a6c9-b533-4613-beb1-75cfdc4ba802 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.142765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9829a6c9-b533-4613-beb1-75cfdc4ba802 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.143197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9829a6c9-b533-4613-beb1-75cfdc4ba802 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.157671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aa2125c1-56cc-40de-ac85-390a60db1afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:48.158293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aa2125c1-56cc-40de-ac85-390a60db1afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:48.164734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa2125c1-56cc-40de-ac85-390a60db1afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.165186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa2125c1-56cc-40de-ac85-390a60db1afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.165953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa2125c1-56cc-40de-ac85-390a60db1afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.166386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa2125c1-56cc-40de-ac85-390a60db1afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.234689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa2125c1-56cc-40de-ac85-390a60db1afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:48.243235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aa2125c1-56cc-40de-ac85-390a60db1afb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089506 May 23 14:01:48.243811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1664/3246] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:48.279900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9829a6c9-b533-4613-beb1-75cfdc4ba802 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:48.288472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9829a6c9-b533-4613-beb1-75cfdc4ba802 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160774 May 23 14:01:48.289088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1583/3247] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:48 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:48.324068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1758569f-38b4-4181-91cf-b21d552885a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:48.324736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1758569f-38b4-4181-91cf-b21d552885a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:48.333418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1758569f-38b4-4181-91cf-b21d552885a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.333907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1758569f-38b4-4181-91cf-b21d552885a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.334708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1758569f-38b4-4181-91cf-b21d552885a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.335158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1758569f-38b4-4181-91cf-b21d552885a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.388302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:48.389290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:48.395745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.396188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.396977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.397404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.461212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:48.470636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:48.472171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:48.477552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3ce6eef2-fa54-41f1-b5d8-0eb6b079ae0d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.089488 May 23 14:01:48.477552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1584/3248] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:48 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:48.480482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1758569f-38b4-4181-91cf-b21d552885a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:48.489436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1758569f-38b4-4181-91cf-b21d552885a6 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.169180 May 23 14:01:48.490009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1665/3249] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:48 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:48.760674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04a55f4a-52d1-41c3-9189-fd6df9e5b7a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:48.761209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04a55f4a-52d1-41c3-9189-fd6df9e5b7a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:48.767911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04a55f4a-52d1-41c3-9189-fd6df9e5b7a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.768364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04a55f4a-52d1-41c3-9189-fd6df9e5b7a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.769159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04a55f4a-52d1-41c3-9189-fd6df9e5b7a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:48.769599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04a55f4a-52d1-41c3-9189-fd6df9e5b7a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:48.899155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04a55f4a-52d1-41c3-9189-fd6df9e5b7a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:48.907767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04a55f4a-52d1-41c3-9189-fd6df9e5b7a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.151022 May 23 14:01:48.908338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1585/3250] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:48 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:49.261109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e27291fd-fdc0-45df-8c63-2141d06cdd53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:49.261754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e27291fd-fdc0-45df-8c63-2141d06cdd53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:49.268782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e27291fd-fdc0-45df-8c63-2141d06cdd53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.269238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e27291fd-fdc0-45df-8c63-2141d06cdd53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:49.269999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e27291fd-fdc0-45df-8c63-2141d06cdd53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.270440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e27291fd-fdc0-45df-8c63-2141d06cdd53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:49.306645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a54151f-e421-490b-99e8-d94449b6aae0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:49.307271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a54151f-e421-490b-99e8-d94449b6aae0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:49.315225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a54151f-e421-490b-99e8-d94449b6aae0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.315673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a54151f-e421-490b-99e8-d94449b6aae0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:49.316471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a54151f-e421-490b-99e8-d94449b6aae0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.316968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a54151f-e421-490b-99e8-d94449b6aae0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:49.335068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e27291fd-fdc0-45df-8c63-2141d06cdd53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:49.341921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e27291fd-fdc0-45df-8c63-2141d06cdd53 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084671 May 23 14:01:49.343018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1666/3251] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:49 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:49.448594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a54151f-e421-490b-99e8-d94449b6aae0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:49.456836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a54151f-e421-490b-99e8-d94449b6aae0 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.154333 May 23 14:01:49.457402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1586/3252] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:49 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:49.494901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:49.495527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:49.503201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.503658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:49.504439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.504923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:49.507459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-63903bf0-7b6a-4e0c-b2c3-1bc5ebea0f09 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:49.508085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-63903bf0-7b6a-4e0c-b2c3-1bc5ebea0f09 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:49.514343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63903bf0-7b6a-4e0c-b2c3-1bc5ebea0f09 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.515150 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63903bf0-7b6a-4e0c-b2c3-1bc5ebea0f09 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:49.515920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63903bf0-7b6a-4e0c-b2c3-1bc5ebea0f09 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.516384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63903bf0-7b6a-4e0c-b2c3-1bc5ebea0f09 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:49.570629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:49.579970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:49.581654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:49.582845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c0e0c86a-6f31-4bc9-85f9-c5fbaed10f10 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.092226 May 23 14:01:49.583418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1667/3253] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:49 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:49.653607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-63903bf0-7b6a-4e0c-b2c3-1bc5ebea0f09 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:49.662169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-63903bf0-7b6a-4e0c-b2c3-1bc5ebea0f09 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159364 May 23 14:01:49.662738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1587/3254] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:49 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:49.925094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d60e397b-900a-4ebc-beba-28acc324d97b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:49.925707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d60e397b-900a-4ebc-beba-28acc324d97b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:49.932042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d60e397b-900a-4ebc-beba-28acc324d97b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.932493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d60e397b-900a-4ebc-beba-28acc324d97b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:49.933282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d60e397b-900a-4ebc-beba-28acc324d97b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:49.933718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d60e397b-900a-4ebc-beba-28acc324d97b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:50.074510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d60e397b-900a-4ebc-beba-28acc324d97b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:50.082947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d60e397b-900a-4ebc-beba-28acc324d97b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.162468 May 23 14:01:50.083511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1668/3255] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:49 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:50.359869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e891e8b-c54c-41cd-af52-7675c7a2885b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:50.360450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e891e8b-c54c-41cd-af52-7675c7a2885b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:50.367113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e891e8b-c54c-41cd-af52-7675c7a2885b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:50.367563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e891e8b-c54c-41cd-af52-7675c7a2885b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:50.368327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e891e8b-c54c-41cd-af52-7675c7a2885b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:50.368816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e891e8b-c54c-41cd-af52-7675c7a2885b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:50.431798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e891e8b-c54c-41cd-af52-7675c7a2885b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:50.440241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e891e8b-c54c-41cd-af52-7675c7a2885b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084109 May 23 14:01:50.440619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1588/3256] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:50.474446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b7db9df2-19fb-478f-9c48-c68643b36923 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:50.475119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b7db9df2-19fb-478f-9c48-c68643b36923 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:50.481762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7db9df2-19fb-478f-9c48-c68643b36923 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:50.482220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7db9df2-19fb-478f-9c48-c68643b36923 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:50.483004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7db9df2-19fb-478f-9c48-c68643b36923 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:50.483503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7db9df2-19fb-478f-9c48-c68643b36923 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:50.601005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:50.602176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:50.614039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:50.614862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:50.616304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:50.617115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:50.621329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b7db9df2-19fb-478f-9c48-c68643b36923 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:50.630896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b7db9df2-19fb-478f-9c48-c68643b36923 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.160220 May 23 14:01:50.633179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1669/3257] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:50 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:50.680019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7b26165-978d-458d-b534-05813ead611a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:50.680799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7b26165-978d-458d-b534-05813ead611a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:50.688823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7b26165-978d-458d-b534-05813ead611a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:50.692220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7b26165-978d-458d-b534-05813ead611a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:50.692220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7b26165-978d-458d-b534-05813ead611a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:50.692220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7b26165-978d-458d-b534-05813ead611a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:50.700758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:50.711948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:50.713518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:50.714677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a5405289-c55e-48c8-8567-4961cad2748b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.117570 May 23 14:01:50.715632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1589/3258] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:50 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:50.836086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7b26165-978d-458d-b534-05813ead611a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:50.844868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7b26165-978d-458d-b534-05813ead611a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.168672 May 23 14:01:50.845451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1670/3259] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:50 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:51.102697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d8f60a36-d124-495d-a5e1-0309990996ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:51.103310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d8f60a36-d124-495d-a5e1-0309990996ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:51.110609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8f60a36-d124-495d-a5e1-0309990996ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.111064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8f60a36-d124-495d-a5e1-0309990996ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:51.111832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8f60a36-d124-495d-a5e1-0309990996ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.112269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8f60a36-d124-495d-a5e1-0309990996ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:51.243276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d8f60a36-d124-495d-a5e1-0309990996ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:51.252237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d8f60a36-d124-495d-a5e1-0309990996ee tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.153322 May 23 14:01:51.252780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1590/3260] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:51 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:51.456865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-47aaee99-a6cf-4379-8ee8-90eb831fad30 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:51.457482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-47aaee99-a6cf-4379-8ee8-90eb831fad30 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:51.463795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47aaee99-a6cf-4379-8ee8-90eb831fad30 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.464250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47aaee99-a6cf-4379-8ee8-90eb831fad30 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:51.465068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47aaee99-a6cf-4379-8ee8-90eb831fad30 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.465510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-47aaee99-a6cf-4379-8ee8-90eb831fad30 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:51.529815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-47aaee99-a6cf-4379-8ee8-90eb831fad30 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:51.538555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-47aaee99-a6cf-4379-8ee8-90eb831fad30 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085631 May 23 14:01:51.539135 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1671/3261] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:51 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:51.650742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd0ee3dc-5b5c-4723-9595-d656897bb515 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:51.651355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd0ee3dc-5b5c-4723-9595-d656897bb515 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:51.658774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd0ee3dc-5b5c-4723-9595-d656897bb515 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.659253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd0ee3dc-5b5c-4723-9595-d656897bb515 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:51.660023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd0ee3dc-5b5c-4723-9595-d656897bb515 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.660463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd0ee3dc-5b5c-4723-9595-d656897bb515 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:51.732315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:51.732957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:51.739205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.739664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:51.740411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.740874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:51.803910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:51.820322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:51.822247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:51.823634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a24d9aa-46ea-4a59-9a46-0e980778220a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.095222 May 23 14:01:51.824205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1672/3262] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:51 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:01:51.850143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd0ee3dc-5b5c-4723-9595-d656897bb515 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:51.859815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd0ee3dc-5b5c-4723-9595-d656897bb515 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.212764 May 23 14:01:51.860456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1591/3263] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:51 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:51.865477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-646b34f6-e89e-4504-9572-0aa62ab70c9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:51.866103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-646b34f6-e89e-4504-9572-0aa62ab70c9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:51.872360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-646b34f6-e89e-4504-9572-0aa62ab70c9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.872846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-646b34f6-e89e-4504-9572-0aa62ab70c9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:51.873621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-646b34f6-e89e-4504-9572-0aa62ab70c9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:51.874063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-646b34f6-e89e-4504-9572-0aa62ab70c9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:52.015104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-646b34f6-e89e-4504-9572-0aa62ab70c9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:52.024024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-646b34f6-e89e-4504-9572-0aa62ab70c9b tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.163820 May 23 14:01:52.024623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1673/3264] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:51 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:52.322881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-14eb0d59-977d-4da7-a967-97492163ba11 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:52.323818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-14eb0d59-977d-4da7-a967-97492163ba11 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:52.330793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14eb0d59-977d-4da7-a967-97492163ba11 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:52.331227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14eb0d59-977d-4da7-a967-97492163ba11 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:52.331992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14eb0d59-977d-4da7-a967-97492163ba11 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:52.332444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14eb0d59-977d-4da7-a967-97492163ba11 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:52.474238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-14eb0d59-977d-4da7-a967-97492163ba11 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:52.482231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-14eb0d59-977d-4da7-a967-97492163ba11 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.215060 May 23 14:01:52.482788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1592/3265] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:52 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:52.505763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:01:52.505963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:01:52.556265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-871a2e0b-4385-41ff-aad1-8c0edd35388a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:52.556925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-871a2e0b-4385-41ff-aad1-8c0edd35388a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:52.565212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871a2e0b-4385-41ff-aad1-8c0edd35388a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:52.565722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871a2e0b-4385-41ff-aad1-8c0edd35388a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:52.566671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871a2e0b-4385-41ff-aad1-8c0edd35388a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:52.567164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-871a2e0b-4385-41ff-aad1-8c0edd35388a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:52.642959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-871a2e0b-4385-41ff-aad1-8c0edd35388a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:52.651447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-871a2e0b-4385-41ff-aad1-8c0edd35388a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.099457 May 23 14:01:52.652031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1674/3266] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:52 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:52.844252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:52.844878 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:52.851055 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:52.851498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:52.852258 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:52.852717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:52.877488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e3d25f54-797d-4521-86f7-67ef0b212248 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:52.878363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e3d25f54-797d-4521-86f7-67ef0b212248 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:52.885332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3d25f54-797d-4521-86f7-67ef0b212248 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:52.885917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3d25f54-797d-4521-86f7-67ef0b212248 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:52.886801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3d25f54-797d-4521-86f7-67ef0b212248 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:52.887321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3d25f54-797d-4521-86f7-67ef0b212248 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:53.080909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:53.090240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:53.091765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:53.092971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c917d66-3342-4ff2-81ce-6136c88c2f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.253355 May 23 14:01:53.094133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1593/3267] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:52 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:53.098824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b0c8d3f4-801a-4a8c-9bd1-dd26c1cbe29a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:53.099436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b0c8d3f4-801a-4a8c-9bd1-dd26c1cbe29a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:53.106888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0c8d3f4-801a-4a8c-9bd1-dd26c1cbe29a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:53.107453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0c8d3f4-801a-4a8c-9bd1-dd26c1cbe29a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:53.108224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0c8d3f4-801a-4a8c-9bd1-dd26c1cbe29a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:53.108725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0c8d3f4-801a-4a8c-9bd1-dd26c1cbe29a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:53.148011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e3d25f54-797d-4521-86f7-67ef0b212248 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:53.156916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e3d25f54-797d-4521-86f7-67ef0b212248 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.283370 May 23 14:01:53.165752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1675/3268] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:52 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:53.244961 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b0c8d3f4-801a-4a8c-9bd1-dd26c1cbe29a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:53.254384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b0c8d3f4-801a-4a8c-9bd1-dd26c1cbe29a tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.159172 May 23 14:01:53.255063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1594/3269] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:53 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:53.500177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12ab2d8b-ab62-45c5-92f5-527fb85b2ab0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:53.501558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12ab2d8b-ab62-45c5-92f5-527fb85b2ab0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:53.507500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12ab2d8b-ab62-45c5-92f5-527fb85b2ab0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:53.508052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12ab2d8b-ab62-45c5-92f5-527fb85b2ab0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:53.508883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12ab2d8b-ab62-45c5-92f5-527fb85b2ab0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:53.509326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12ab2d8b-ab62-45c5-92f5-527fb85b2ab0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:53.657420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12ab2d8b-ab62-45c5-92f5-527fb85b2ab0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:53.666358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12ab2d8b-ab62-45c5-92f5-527fb85b2ab0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.170665 May 23 14:01:53.669526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1676/3270] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:53 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:53.669672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fb707aca-44b8-46d6-90c1-202124d53362 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:53.669672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fb707aca-44b8-46d6-90c1-202124d53362 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:53.676638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb707aca-44b8-46d6-90c1-202124d53362 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:53.677134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb707aca-44b8-46d6-90c1-202124d53362 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:53.677951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb707aca-44b8-46d6-90c1-202124d53362 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:53.678314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb707aca-44b8-46d6-90c1-202124d53362 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:53.748257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb707aca-44b8-46d6-90c1-202124d53362 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:53.758384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fb707aca-44b8-46d6-90c1-202124d53362 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.093673 May 23 14:01:53.759108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1595/3271] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:53 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:54.114214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:54.115437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:54.122255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.122698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.123502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.123915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.147839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:54.174147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae587415-6a88-4ebb-a1b9-f371ae33708c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:54.174783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae587415-6a88-4ebb-a1b9-f371ae33708c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:54.182912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae587415-6a88-4ebb-a1b9-f371ae33708c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.182912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae587415-6a88-4ebb-a1b9-f371ae33708c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.183667 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae587415-6a88-4ebb-a1b9-f371ae33708c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.184113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae587415-6a88-4ebb-a1b9-f371ae33708c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.199065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:54.209067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:54.210496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:54.211743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf0d9885-626e-40e4-b08f-b72b976a5ab7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.102260 May 23 14:01:54.212309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1677/3272] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:54 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:54.273076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c09015d1-b230-4463-82ca-81805b8fa867 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:54.273723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c09015d1-b230-4463-82ca-81805b8fa867 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:54.280257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c09015d1-b230-4463-82ca-81805b8fa867 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.280908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c09015d1-b230-4463-82ca-81805b8fa867 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.283531 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c09015d1-b230-4463-82ca-81805b8fa867 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.283986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c09015d1-b230-4463-82ca-81805b8fa867 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.319241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae587415-6a88-4ebb-a1b9-f371ae33708c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:54.329401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae587415-6a88-4ebb-a1b9-f371ae33708c tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.158466 May 23 14:01:54.329401 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1596/3273] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:54 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:54.417585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c09015d1-b230-4463-82ca-81805b8fa867 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:54.430547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c09015d1-b230-4463-82ca-81805b8fa867 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.160995 May 23 14:01:54.431676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1678/3274] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:54 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:54.690833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-722b8510-1b1d-4823-be6b-413ab4ff5f57 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:54.691091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-722b8510-1b1d-4823-be6b-413ab4ff5f57 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:54.697066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-722b8510-1b1d-4823-be6b-413ab4ff5f57 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.697516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-722b8510-1b1d-4823-be6b-413ab4ff5f57 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.698296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-722b8510-1b1d-4823-be6b-413ab4ff5f57 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.698730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-722b8510-1b1d-4823-be6b-413ab4ff5f57 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.775694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37d59d5c-6d70-46dd-8b83-b4c1bb0580d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:54.776551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37d59d5c-6d70-46dd-8b83-b4c1bb0580d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:54.783747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d59d5c-6d70-46dd-8b83-b4c1bb0580d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.784202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d59d5c-6d70-46dd-8b83-b4c1bb0580d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.785036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d59d5c-6d70-46dd-8b83-b4c1bb0580d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:54.785473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37d59d5c-6d70-46dd-8b83-b4c1bb0580d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:54.836040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-722b8510-1b1d-4823-be6b-413ab4ff5f57 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:54.844896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-722b8510-1b1d-4823-be6b-413ab4ff5f57 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.159456 May 23 14:01:54.849371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37d59d5c-6d70-46dd-8b83-b4c1bb0580d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:54.851388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1597/3275] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:54 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:54.858779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37d59d5c-6d70-46dd-8b83-b4c1bb0580d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086912 May 23 14:01:54.863145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1679/3276] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:54 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:55.230407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:55.231044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:55.238712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:55.239164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:55.239929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:55.240363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:55.311389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:55.315623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:01:55.320875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:55.327633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:55.327633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-84355f63-6b27-4dc1-8273-cef898afaa9f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 200 len: 1445 microversion: 2.20 time: 0.097117 May 23 14:01:55.327633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1598/3277] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:01:55 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:01:55.341315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9339dbd-5701-4431-be5c-78ed4a806fd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '.version_select at 0x7effb1ee6dc0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:55.344755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e9339dbd-5701-4431-be5c-78ed4a806fd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [944ebdab-e670-49a7-b706-57ccb837b21a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 14:01:55.346084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4c78496e-3fc0-43c5-a7f0-0286ff2a5489 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:55.346689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4c78496e-3fc0-43c5-a7f0-0286ff2a5489 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:55.353119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c78496e-3fc0-43c5-a7f0-0286ff2a5489 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:55.353568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c78496e-3fc0-43c5-a7f0-0286ff2a5489 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:55.354316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c78496e-3fc0-43c5-a7f0-0286ff2a5489 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:55.354748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c78496e-3fc0-43c5-a7f0-0286ff2a5489 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:55.496194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4c78496e-3fc0-43c5-a7f0-0286ff2a5489 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:55.508446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4c78496e-3fc0-43c5-a7f0-0286ff2a5489 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.162142 May 23 14:01:55.508446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1599/3278] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:55 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:55.511649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e09c8a0-a368-4063-8f54-59f06b563c02 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:55.511649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e09c8a0-a368-4063-8f54-59f06b563c02 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:55.520229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e09c8a0-a368-4063-8f54-59f06b563c02 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:55.520824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e09c8a0-a368-4063-8f54-59f06b563c02 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:55.521595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e09c8a0-a368-4063-8f54-59f06b563c02 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:55.522021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e09c8a0-a368-4063-8f54-59f06b563c02 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:55.662273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e09c8a0-a368-4063-8f54-59f06b563c02 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:55.670302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e09c8a0-a368-4063-8f54-59f06b563c02 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.164135 May 23 14:01:55.670870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1600/3279] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:55 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:55.861034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a000952-2473-4784-86a2-0c2cf3d3984a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:55.861644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a000952-2473-4784-86a2-0c2cf3d3984a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:55.868066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a000952-2473-4784-86a2-0c2cf3d3984a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:55.868684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a000952-2473-4784-86a2-0c2cf3d3984a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:55.869980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a000952-2473-4784-86a2-0c2cf3d3984a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:55.870716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a000952-2473-4784-86a2-0c2cf3d3984a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:56.009696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a000952-2473-4784-86a2-0c2cf3d3984a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:56.019030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a000952-2473-4784-86a2-0c2cf3d3984a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 200 len: 1729 microversion: 2.1 time: 0.161865 May 23 14:01:56.019609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1601/3280] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:55 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:56.024160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57726519-1821-45ed-82ec-29ae3b3b3b3d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:56.024799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57726519-1821-45ed-82ec-29ae3b3b3b3d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:56.030949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57726519-1821-45ed-82ec-29ae3b3b3b3d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:56.032594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57726519-1821-45ed-82ec-29ae3b3b3b3d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:56.033241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57726519-1821-45ed-82ec-29ae3b3b3b3d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:56.033827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57726519-1821-45ed-82ec-29ae3b3b3b3d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:56.099345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57726519-1821-45ed-82ec-29ae3b3b3b3d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:56.107902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57726519-1821-45ed-82ec-29ae3b3b3b3d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087248 May 23 14:01:56.109314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1602/3281] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:56 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:56.115421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-39ba46aa-88a9-44fa-8408-29b7bd5732f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '.version_select at 0x7effb25d4670>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:56.262001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-39ba46aa-88a9-44fa-8408-29b7bd5732f5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917221040" status: 202 len: 0 microversion: 2.1 time: 0.150426 May 23 14:01:56.262708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1603/3282] 10.222.0.70 () {58 vars in 1220 bytes} [Mon May 23 14:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917221040 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:01:56.354436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [None req-e9339dbd-5701-4431-be5c-78ed4a806fd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [944ebdab-e670-49a7-b706-57ccb837b21a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 40748. May 23 14:01:56.523893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c05b55a9-ce90-4f90-b039-4ea442f8d771 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:56.524543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c05b55a9-ce90-4f90-b039-4ea442f8d771 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] [instance: 05ddd2ac-4582-4472-a43f-e3a8b4944ed2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:56.530623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05b55a9-ce90-4f90-b039-4ea442f8d771 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:56.531080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05b55a9-ce90-4f90-b039-4ea442f8d771 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:56.532530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05b55a9-ce90-4f90-b039-4ea442f8d771 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:56.532991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c05b55a9-ce90-4f90-b039-4ea442f8d771 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:56.537012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9339dbd-5701-4431-be5c-78ed4a806fd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977509464" status: 204 len: 0 microversion: 2.20 time: 1.199491 May 23 14:01:56.537600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1680/3283] 10.222.0.70 () {60 vars in 1261 bytes} [Mon May 23 14:01:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977509464 => generated 0 bytes in 1201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 14:01:56.688171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04d08dc8-a750-44eb-aef9-7025e0948dd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:56.688740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-04d08dc8-a750-44eb-aef9-7025e0948dd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] [instance: 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:56.696407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04d08dc8-a750-44eb-aef9-7025e0948dd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:56.696983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04d08dc8-a750-44eb-aef9-7025e0948dd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:56.698146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04d08dc8-a750-44eb-aef9-7025e0948dd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:56.698560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04d08dc8-a750-44eb-aef9-7025e0948dd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:56.773533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c05b55a9-ce90-4f90-b039-4ea442f8d771 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701b374f2fcf437dad87cec756232547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407c9665e0448e18fd87ec20b0843e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:56.790257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c05b55a9-ce90-4f90-b039-4ea442f8d771 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2" status: 200 len: 1600 microversion: 2.1 time: 0.270272 May 23 14:01:56.791482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1604/3284] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:56 2022] GET /compute/v2.1/servers/05ddd2ac-4582-4472-a43f-e3a8b4944ed2 => generated 1600 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:56.826743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-96ef7e04-6c28-40ea-b04a-176a8879c2b5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] Calling method '.version_select at 0x7effb2596820>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:56.930348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-96ef7e04-6c28-40ea-b04a-176a8879c2b5 tempest-TestMinimumBasicScenario-874674570 tempest-TestMinimumBasicScenario-874674570-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-406872192" status: 202 len: 0 microversion: 2.1 time: 0.120825 May 23 14:01:56.931235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1605/3285] 10.222.0.70 () {58 vars in 1268 bytes} [Mon May 23 14:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-406872192 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:01:56.961385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-04d08dc8-a750-44eb-aef9-7025e0948dd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659caf32fa614f64bcd780a264674e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a3f075cb64d668a76838fd4f9c8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:56.971977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-04d08dc8-a750-44eb-aef9-7025e0948dd1 tempest-VolumesSnapshotTestJSON-1699784808 tempest-VolumesSnapshotTestJSON-1699784808-project] 10.222.0.70 "GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55" status: 200 len: 1558 microversion: 2.1 time: 0.286778 May 23 14:01:56.973266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1681/3286] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:56 2022] GET /compute/v2.1/servers/72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 => generated 1558 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:01:57.135801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2c7ad642-5a70-468c-acf7-172da7d0b586 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:57.136605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2c7ad642-5a70-468c-acf7-172da7d0b586 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:57.148291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c7ad642-5a70-468c-acf7-172da7d0b586 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:57.151986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c7ad642-5a70-468c-acf7-172da7d0b586 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:57.153190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c7ad642-5a70-468c-acf7-172da7d0b586 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:57.155039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c7ad642-5a70-468c-acf7-172da7d0b586 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:57.297203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2c7ad642-5a70-468c-acf7-172da7d0b586 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:57.305404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2c7ad642-5a70-468c-acf7-172da7d0b586 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.173712 May 23 14:01:57.306255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1606/3287] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:57 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:57.613808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8f6a433e-344b-4707-b32d-967751172c49 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'create', calling method: .version_select at 0x7effb1ee68b0>, body: {"keypair": {"name": "tempest-keypair-479736767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSTBjlxb824J4r4rk/YspVw6GbCASIfOkFkLWKhK7myC00wc4aKorZ31YxjLODUEGjY2seuxVsQxlHDp4/3v+FolPuhu3ETiyDU2XJOMRGHUj7icTHkr8sceS0d6LIKmQ=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:01:57.642106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-8f6a433e-344b-4707-b32d-967751172c49 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Getting quotas for project 611e3a80618d4d4dbfb150456f0d3502. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:01:57.646856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-8f6a433e-344b-4707-b32d-967751172c49 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Getting quotas for user b3eae736c69843ceadc6cbdb258b7195 and project 611e3a80618d4d4dbfb150456f0d3502. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:01:57.801045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8f6a433e-344b-4707-b32d-967751172c49 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.200151 May 23 14:01:57.801729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1682/3288] 10.222.0.70 () {62 vars in 1199 bytes} [Mon May 23 14:01:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 202 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 14:01:57.947466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-13d661f1-b02d-4c6e-aa8a-b7931e9abc38 req-ffa1bf6c-4e22-48c1-9e66-aaf5165bcedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f051b3-679a-43af-909b-a4edda1984fa", "tag": "134a119a-a4cc-402e-a0e6-6aa02c073149"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:01:57.966174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-13d661f1-b02d-4c6e-aa8a-b7931e9abc38 req-ffa1bf6c-4e22-48c1-9e66-aaf5165bcedc service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:57.967079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-13d661f1-b02d-4c6e-aa8a-b7931e9abc38 req-ffa1bf6c-4e22-48c1-9e66-aaf5165bcedc service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:58.013686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-16f7858a-e59f-4fdc-a150-841a9b67b0b7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: .version_select at 0x7effb1c97ee0>, body: {"keypair": {"name": "tempest-keypair-1240932084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4YUGmpxbAXTjrUF0WsIJ7JHczXlZvNLY2YBypWNiV0NCijJgUlLg8K2MWlnASZcljYmbdSk89BrFD7SxRlZUMSEaSQOnXLTHo5zJ4qL0i3OkbnWyvYRbuYk8geMy+uKg=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:01:58.022892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-13d661f1-b02d-4c6e-aa8a-b7931e9abc38 req-ffa1bf6c-4e22-48c1-9e66-aaf5165bcedc service nova] Creating event network-changed:134a119a-a4cc-402e-a0e6-6aa02c073149 for instance 81f051b3-679a-43af-909b-a4edda1984fa on hv-cinder-82549 May 23 14:01:58.030365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-13d661f1-b02d-4c6e-aa8a-b7931e9abc38 req-ffa1bf6c-4e22-48c1-9e66-aaf5165bcedc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171696 May 23 14:01:58.031305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1607/3289] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:01:58.044217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-16f7858a-e59f-4fdc-a150-841a9b67b0b7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for project 7649fa9a0ae4411aabf060f99e691520. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:01:58.050801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-16f7858a-e59f-4fdc-a150-841a9b67b0b7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for user cf30fa512142489a8dea40ce426a5f36 and project 7649fa9a0ae4411aabf060f99e691520. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:01:58.206561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-16f7858a-e59f-4fdc-a150-841a9b67b0b7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.198928 May 23 14:01:58.207807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1683/3290] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 14:01:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:01:58.324443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9cf4456b-4ed3-4226-870f-a1da4e07242a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:58.325763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9cf4456b-4ed3-4226-870f-a1da4e07242a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:58.339964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cf4456b-4ed3-4226-870f-a1da4e07242a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:58.340413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cf4456b-4ed3-4226-870f-a1da4e07242a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:58.341405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cf4456b-4ed3-4226-870f-a1da4e07242a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:58.342079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cf4456b-4ed3-4226-870f-a1da4e07242a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:58.438974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9cf4456b-4ed3-4226-870f-a1da4e07242a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:58.455952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9cf4456b-4ed3-4226-870f-a1da4e07242a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.135388 May 23 14:01:58.456557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1608/3291] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:58 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:01:59.474160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c4d8daf-03b6-4608-a4d8-4b555ff6eab6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:01:59.475602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8c4d8daf-03b6-4608-a4d8-4b555ff6eab6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:01:59.482084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c4d8daf-03b6-4608-a4d8-4b555ff6eab6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:59.482634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c4d8daf-03b6-4608-a4d8-4b555ff6eab6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:59.483493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c4d8daf-03b6-4608-a4d8-4b555ff6eab6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:01:59.484123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c4d8daf-03b6-4608-a4d8-4b555ff6eab6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:01:59.567994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8c4d8daf-03b6-4608-a4d8-4b555ff6eab6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:01:59.579906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8c4d8daf-03b6-4608-a4d8-4b555ff6eab6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.110691 May 23 14:01:59.580675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1684/3292] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:01:59 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:00.601965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f16cca4-2d6b-49ce-8b24-71f56a155464 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:00.603353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f16cca4-2d6b-49ce-8b24-71f56a155464 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:00.612022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f16cca4-2d6b-49ce-8b24-71f56a155464 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:00.612532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f16cca4-2d6b-49ce-8b24-71f56a155464 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:00.613601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f16cca4-2d6b-49ce-8b24-71f56a155464 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:00.614049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f16cca4-2d6b-49ce-8b24-71f56a155464 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:00.710540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8f16cca4-2d6b-49ce-8b24-71f56a155464 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:00.723915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f16cca4-2d6b-49ce-8b24-71f56a155464 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.126437 May 23 14:02:00.725867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1609/3293] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:00 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:00.771195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1302095704", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cae33ea1-a43b-4cf1-9bf1-7b749b634f6c"}], "security_groups": [{"name": "tempest-securitygroup--2043331839"}], "key_name": "tempest-keypair-479736767", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:02:00.891027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] validate_networks() for [('cae33ea1-a43b-4cf1-9bf1-7b749b634f6c', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 14:02:01.373454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 14:02:01.374008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 14:02:01.374520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 14:02:01.374987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 14:02:01.376099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 14:02:01.386824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:01.387276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:01.388087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:01.388656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:01.407169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Getting quotas for project 611e3a80618d4d4dbfb150456f0d3502. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:02:01.412145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Getting quotas for user b3eae736c69843ceadc6cbdb258b7195 and project 611e3a80618d4d4dbfb150456f0d3502. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:02:01.427326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 14:02:01.428390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 14:02:01.451888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:01.608512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [2f6b8222-4b99-44c3-9fac-b7d190930e2b] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 14:02:01.731834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1259462674", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ebb3f7b-57db-46b5-ba41-00b71beb6e1e"}], "security_groups": [{"name": "tempest-securitygroup--2063870941"}], "key_name": "tempest-keypair-1240932084", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:02:01.854294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] validate_networks() for [('2ebb3f7b-57db-46b5-ba41-00b71beb6e1e', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 14:02:02.380754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 14:02:02.381209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 14:02:02.381670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 14:02:02.382341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 14:02:02.382755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 14:02:02.392535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:02.393049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:02.393850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:02.394283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:02.413005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for project 7649fa9a0ae4411aabf060f99e691520. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:02:02.417053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for user cf30fa512142489a8dea40ce426a5f36 and project 7649fa9a0ae4411aabf060f99e691520. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:02:02.419719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:02.430006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 14:02:02.432531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 14:02:02.594896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-74227158-1c64-4269-9a6b-96a5e680deb4 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.871385 May 23 14:02:02.595656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1610/3294] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 14:02:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 14:02:02.600555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31182e24-79c3-47c7-bc5e-4689f9838b2a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:02.601476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31182e24-79c3-47c7-bc5e-4689f9838b2a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:02.610110 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31182e24-79c3-47c7-bc5e-4689f9838b2a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:02.615475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31182e24-79c3-47c7-bc5e-4689f9838b2a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:02.615475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31182e24-79c3-47c7-bc5e-4689f9838b2a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:02.615475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31182e24-79c3-47c7-bc5e-4689f9838b2a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:02.618594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [2f6b8222-4b99-44c3-9fac-b7d190930e2b] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 40882. May 23 14:02:02.624053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85f60a2e-76c0-44b2-a806-e8736d397059 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.858227 May 23 14:02:02.630618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1685/3295] 10.222.0.70 () {62 vars in 1187 bytes} [Mon May 23 14:02:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 14:02:02.643552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e98fff9-8563-44ce-b9f1-017e2267f4be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:02.647883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1e98fff9-8563-44ce-b9f1-017e2267f4be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:02.698721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31182e24-79c3-47c7-bc5e-4689f9838b2a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:02.709122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31182e24-79c3-47c7-bc5e-4689f9838b2a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.112188 May 23 14:02:02.709920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1611/3296] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:02 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:02.730609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19d2b476-fb09-413a-8f99-ecd2148508ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:02.731229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19d2b476-fb09-413a-8f99-ecd2148508ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:02.763364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1e98fff9-8563-44ce-b9f1-017e2267f4be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:02.774358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1e98fff9-8563-44ce-b9f1-017e2267f4be tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1242 microversion: 2.1 time: 0.141983 May 23 14:02:02.775305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1686/3297] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:02 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1242 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:02.797860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19d2b476-fb09-413a-8f99-ecd2148508ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:02.806625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19d2b476-fb09-413a-8f99-ecd2148508ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:02.808466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19d2b476-fb09-413a-8f99-ecd2148508ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:02.810640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19d2b476-fb09-413a-8f99-ecd2148508ed tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1281 microversion: 2.20 time: 0.096075 May 23 14:02:02.811210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1612/3298] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:02 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:03.727123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b4457cce-6504-47e1-a7f0-50343587a1e0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:03.727732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b4457cce-6504-47e1-a7f0-50343587a1e0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:03.734447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4457cce-6504-47e1-a7f0-50343587a1e0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:03.735415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4457cce-6504-47e1-a7f0-50343587a1e0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:03.736202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4457cce-6504-47e1-a7f0-50343587a1e0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:03.736675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4457cce-6504-47e1-a7f0-50343587a1e0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:03.792528 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b69628b-7ac3-4687-9b5d-48b094a8be21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:03.793176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b69628b-7ac3-4687-9b5d-48b094a8be21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:03.801443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b4457cce-6504-47e1-a7f0-50343587a1e0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:03.810021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b4457cce-6504-47e1-a7f0-50343587a1e0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086715 May 23 14:02:03.810591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1687/3299] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:03 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:03.829674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12994d94-f6ff-4a3e-8c33-ba27990b5e8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:03.830296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12994d94-f6ff-4a3e-8c33-ba27990b5e8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:03.867103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b69628b-7ac3-4687-9b5d-48b094a8be21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:03.880859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b69628b-7ac3-4687-9b5d-48b094a8be21 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1242 microversion: 2.1 time: 0.085725 May 23 14:02:03.880859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1613/3300] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:03 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:03.894682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12994d94-f6ff-4a3e-8c33-ba27990b5e8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:03.902530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12994d94-f6ff-4a3e-8c33-ba27990b5e8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:03.904484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12994d94-f6ff-4a3e-8c33-ba27990b5e8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:03.905685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12994d94-f6ff-4a3e-8c33-ba27990b5e8c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1281 microversion: 2.20 time: 0.080797 May 23 14:02:03.906893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1688/3301] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:03 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:02:04.828538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5492eb90-84c3-47d9-9020-7ca06143db21 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:04.829169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5492eb90-84c3-47d9-9020-7ca06143db21 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:04.835785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5492eb90-84c3-47d9-9020-7ca06143db21 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:04.836240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5492eb90-84c3-47d9-9020-7ca06143db21 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:04.837061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5492eb90-84c3-47d9-9020-7ca06143db21 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:04.837502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5492eb90-84c3-47d9-9020-7ca06143db21 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:04.896026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1caf75be-e18c-46b0-a5a4-297115c5fff1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:04.896749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1caf75be-e18c-46b0-a5a4-297115c5fff1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:04.901272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5492eb90-84c3-47d9-9020-7ca06143db21 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:04.903586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1caf75be-e18c-46b0-a5a4-297115c5fff1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:04.904052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1caf75be-e18c-46b0-a5a4-297115c5fff1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:04.904854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1caf75be-e18c-46b0-a5a4-297115c5fff1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:04.905293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1caf75be-e18c-46b0-a5a4-297115c5fff1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:04.909835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5492eb90-84c3-47d9-9020-7ca06143db21 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085654 May 23 14:02:04.910402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1614/3302] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:04 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:04.924783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2162595-497d-4185-a2cc-e47f2c1199d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:04.925316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2162595-497d-4185-a2cc-e47f2c1199d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:04.969288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1caf75be-e18c-46b0-a5a4-297115c5fff1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:04.977333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1caf75be-e18c-46b0-a5a4-297115c5fff1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1246 microversion: 2.1 time: 0.085100 May 23 14:02:04.978957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1689/3303] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:04 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:04.981584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2162595-497d-4185-a2cc-e47f2c1199d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:04.988764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2162595-497d-4185-a2cc-e47f2c1199d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:04.990246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2162595-497d-4185-a2cc-e47f2c1199d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:04.991357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2162595-497d-4185-a2cc-e47f2c1199d0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1281 microversion: 2.20 time: 0.071133 May 23 14:02:04.991914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1615/3304] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:04 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:05.927772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3f225381-f7fe-4b1b-b8c7-32cd48c7d5cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:05.928394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3f225381-f7fe-4b1b-b8c7-32cd48c7d5cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:05.935224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f225381-f7fe-4b1b-b8c7-32cd48c7d5cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:05.935683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f225381-f7fe-4b1b-b8c7-32cd48c7d5cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:05.936450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f225381-f7fe-4b1b-b8c7-32cd48c7d5cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:05.936967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f225381-f7fe-4b1b-b8c7-32cd48c7d5cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:05.995739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e1324ddd-5455-411b-85be-89b03b91e298 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:05.996376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e1324ddd-5455-411b-85be-89b03b91e298 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:06.003815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1324ddd-5455-411b-85be-89b03b91e298 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:06.005852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1324ddd-5455-411b-85be-89b03b91e298 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:06.005852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1324ddd-5455-411b-85be-89b03b91e298 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:06.006056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3f225381-f7fe-4b1b-b8c7-32cd48c7d5cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:06.006200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1324ddd-5455-411b-85be-89b03b91e298 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:06.013911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3f225381-f7fe-4b1b-b8c7-32cd48c7d5cd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089841 May 23 14:02:06.014348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1690/3305] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:05 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:06.020080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:06.020717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:06.027156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:06.027875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:06.028853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:06.029458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:06.083539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e1324ddd-5455-411b-85be-89b03b91e298 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:06.091463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e1324ddd-5455-411b-85be-89b03b91e298 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1246 microversion: 2.1 time: 0.099668 May 23 14:02:06.100881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1616/3306] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:05 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:06.101203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:06.106661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:06.108301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:06.111785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2d4f4aa3-9957-4507-ae2f-9dec49c3bf60 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1285 microversion: 2.20 time: 0.096442 May 23 14:02:06.112356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1691/3307] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:06 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:07.033175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46c04302-b451-4ea2-9adb-edc30f6b2175 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:07.108948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46c04302-b451-4ea2-9adb-edc30f6b2175 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:07.108948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46c04302-b451-4ea2-9adb-edc30f6b2175 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:07.108948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46c04302-b451-4ea2-9adb-edc30f6b2175 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:07.108948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46c04302-b451-4ea2-9adb-edc30f6b2175 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:07.109876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46c04302-b451-4ea2-9adb-edc30f6b2175 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:07.113612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1d439bce-5cfa-40f3-aae5-9ffc6364f749 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:07.117092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1d439bce-5cfa-40f3-aae5-9ffc6364f749 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:07.122472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d439bce-5cfa-40f3-aae5-9ffc6364f749 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:07.122940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d439bce-5cfa-40f3-aae5-9ffc6364f749 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:07.123721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d439bce-5cfa-40f3-aae5-9ffc6364f749 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:07.124162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d439bce-5cfa-40f3-aae5-9ffc6364f749 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:07.200291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d439bce-5cfa-40f3-aae5-9ffc6364f749 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:07.210148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1d439bce-5cfa-40f3-aae5-9ffc6364f749 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1294 microversion: 2.1 time: 0.100641 May 23 14:02:07.210742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1692/3308] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:07 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:07.225740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:07.226377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:07.232920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:07.233501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:07.234482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:07.234972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:07.331752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:07.340994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:07.342585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:07.345291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c0fbac20-fb17-4eb3-bd09-5aa5b751ab3f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1333 microversion: 2.20 time: 0.123636 May 23 14:02:07.346117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1693/3309] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:07 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1333 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:07.381205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46c04302-b451-4ea2-9adb-edc30f6b2175 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:07.392368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46c04302-b451-4ea2-9adb-edc30f6b2175 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.364388 May 23 14:02:07.393187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1617/3310] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:07 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:08.228903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-74454fa1-a8b2-4c19-92d1-77a21f9ab8df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:08.229718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-74454fa1-a8b2-4c19-92d1-77a21f9ab8df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:08.237823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74454fa1-a8b2-4c19-92d1-77a21f9ab8df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:08.238481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74454fa1-a8b2-4c19-92d1-77a21f9ab8df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:08.239701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74454fa1-a8b2-4c19-92d1-77a21f9ab8df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:08.240524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74454fa1-a8b2-4c19-92d1-77a21f9ab8df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:08.366193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:08.367510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:08.376192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:08.377135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:08.378163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:08.378776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:08.469252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:08.479368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:08.482328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:08.483514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3ad20c27-f614-4c71-8ce3-0821ec37952c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1339 microversion: 2.20 time: 0.123371 May 23 14:02:08.484802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1618/3311] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:08 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1339 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:02:08.490289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b9e659d9-c0ea-4043-97fc-94d410d93fd6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:08.491491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b9e659d9-c0ea-4043-97fc-94d410d93fd6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:08.501627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9e659d9-c0ea-4043-97fc-94d410d93fd6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:08.504035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9e659d9-c0ea-4043-97fc-94d410d93fd6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:08.504035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9e659d9-c0ea-4043-97fc-94d410d93fd6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:08.504035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9e659d9-c0ea-4043-97fc-94d410d93fd6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:08.622497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b9e659d9-c0ea-4043-97fc-94d410d93fd6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:08.637141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b9e659d9-c0ea-4043-97fc-94d410d93fd6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.150441 May 23 14:02:08.647129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1619/3312] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:08 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:08.710902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-74454fa1-a8b2-4c19-92d1-77a21f9ab8df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:08.719069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-74454fa1-a8b2-4c19-92d1-77a21f9ab8df tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.494021 May 23 14:02:08.719612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1694/3313] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:08 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:09.513352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:09.514906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:09.527293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:09.528072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:09.529122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:09.529732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:09.657834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2096e2cf-2834-4ba0-ab0b-f5d220e13a1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:09.658475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2096e2cf-2834-4ba0-ab0b-f5d220e13a1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:09.667335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2096e2cf-2834-4ba0-ab0b-f5d220e13a1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:09.667796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2096e2cf-2834-4ba0-ab0b-f5d220e13a1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:09.669422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2096e2cf-2834-4ba0-ab0b-f5d220e13a1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:09.669864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2096e2cf-2834-4ba0-ab0b-f5d220e13a1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:09.776973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:09.788993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:09.791052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:09.792520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36619a6c-6e23-4784-8f98-bcb0fa859314 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.284594 May 23 14:02:09.797176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2096e2cf-2834-4ba0-ab0b-f5d220e13a1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:09.816689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2096e2cf-2834-4ba0-ab0b-f5d220e13a1d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.164639 May 23 14:02:09.820626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1695/3315] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:09 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:09.820881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1620/3315] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:09 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:09.826863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-593a5cf2-8493-4b36-8ffd-fe557c67b962 req-b99f55e9-5556-46b8-bbad-4a77ba0f09cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce6a8553-8450-4844-96db-c1e6124148f7", "tag": "fb68c5de-2cf4-41d5-9537-632b1b17098e"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:02:09.829972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aec9e104-4a47-424a-9e12-4b04f1d88667 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:09.830890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aec9e104-4a47-424a-9e12-4b04f1d88667 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:09.842104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-593a5cf2-8493-4b36-8ffd-fe557c67b962 req-b99f55e9-5556-46b8-bbad-4a77ba0f09cc service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:09.842552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-593a5cf2-8493-4b36-8ffd-fe557c67b962 req-b99f55e9-5556-46b8-bbad-4a77ba0f09cc service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:09.851155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aec9e104-4a47-424a-9e12-4b04f1d88667 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:09.851586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aec9e104-4a47-424a-9e12-4b04f1d88667 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:09.852365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aec9e104-4a47-424a-9e12-4b04f1d88667 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:09.852843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aec9e104-4a47-424a-9e12-4b04f1d88667 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:09.869290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-593a5cf2-8493-4b36-8ffd-fe557c67b962 req-b99f55e9-5556-46b8-bbad-4a77ba0f09cc service nova] Creating event network-changed:fb68c5de-2cf4-41d5-9537-632b1b17098e for instance ce6a8553-8450-4844-96db-c1e6124148f7 on hv-cinder-82549 May 23 14:02:09.883712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-593a5cf2-8493-4b36-8ffd-fe557c67b962 req-b99f55e9-5556-46b8-bbad-4a77ba0f09cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063238 May 23 14:02:09.888631 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1696/3316] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:02:09.904416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-5e4cb00b-dec0-4b00-aae8-356fb26438f1 req-76269a00-bf8e-4831-9e37-351d412ed51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90125c19-518a-4c0d-a38d-49062d11796e", "tag": "20f9d7dd-294d-470d-a93d-2e0a58b960e2"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:02:09.931971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5e4cb00b-dec0-4b00-aae8-356fb26438f1 req-76269a00-bf8e-4831-9e37-351d412ed51a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:09.931971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5e4cb00b-dec0-4b00-aae8-356fb26438f1 req-76269a00-bf8e-4831-9e37-351d412ed51a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:09.942165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-5e4cb00b-dec0-4b00-aae8-356fb26438f1 req-76269a00-bf8e-4831-9e37-351d412ed51a service nova] Creating event network-changed:20f9d7dd-294d-470d-a93d-2e0a58b960e2 for instance 90125c19-518a-4c0d-a38d-49062d11796e on hv-cinder-82549 May 23 14:02:09.960257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-5e4cb00b-dec0-4b00-aae8-356fb26438f1 req-76269a00-bf8e-4831-9e37-351d412ed51a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070074 May 23 14:02:09.963486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1697/3317] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:02:10.083719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aec9e104-4a47-424a-9e12-4b04f1d88667 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:10.087410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:10.094935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aec9e104-4a47-424a-9e12-4b04f1d88667 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.273040 May 23 14:02:10.095627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1621/3318] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:09 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:10.813271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:10.814015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:10.820519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:10.821004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:10.821782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:10.822224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:10.850732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d1404934-782d-4d2a-8227-fc68db19a987 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:10.851339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d1404934-782d-4d2a-8227-fc68db19a987 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:10.859416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1404934-782d-4d2a-8227-fc68db19a987 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:10.859851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1404934-782d-4d2a-8227-fc68db19a987 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:10.860655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1404934-782d-4d2a-8227-fc68db19a987 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:10.861116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1404934-782d-4d2a-8227-fc68db19a987 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:10.927391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d1404934-782d-4d2a-8227-fc68db19a987 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:10.935983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d1404934-782d-4d2a-8227-fc68db19a987 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092575 May 23 14:02:10.936533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1622/3319] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:10 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:10.972794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:10.980508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:10.982167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:10.984738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c9ab9285-2a89-4d5f-bc07-68f4b20f1d12 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.174957 May 23 14:02:10.984738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1698/3320] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:10 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:11.111423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95b345a6-7179-4829-af45-ca90907a853b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:11.112014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95b345a6-7179-4829-af45-ca90907a853b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:11.118345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95b345a6-7179-4829-af45-ca90907a853b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:11.118798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95b345a6-7179-4829-af45-ca90907a853b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:11.119564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95b345a6-7179-4829-af45-ca90907a853b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:11.120001 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95b345a6-7179-4829-af45-ca90907a853b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:11.285160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95b345a6-7179-4829-af45-ca90907a853b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:11.296521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95b345a6-7179-4829-af45-ca90907a853b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.188743 May 23 14:02:11.297225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1623/3321] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:11 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:11.953660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5f48db54-be92-4b3b-947b-2b72ba54ad91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:11.954423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5f48db54-be92-4b3b-947b-2b72ba54ad91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:11.956305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:11.961755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f48db54-be92-4b3b-947b-2b72ba54ad91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:11.962202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f48db54-be92-4b3b-947b-2b72ba54ad91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:11.962970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f48db54-be92-4b3b-947b-2b72ba54ad91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:11.963407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5f48db54-be92-4b3b-947b-2b72ba54ad91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:12.002188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:12.002788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:12.009505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:12.009938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:12.010751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:12.011446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:12.027858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5f48db54-be92-4b3b-947b-2b72ba54ad91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:12.036835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5f48db54-be92-4b3b-947b-2b72ba54ad91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086988 May 23 14:02:12.037421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1699/3322] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:11 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:12.148390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:12.156544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:12.158202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:12.159176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90fedf26-3a78-45a1-b5e0-b95783108e79 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.161162 May 23 14:02:12.159844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1624/3323] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:11 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:02:12.315502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-068b4fd5-4e6c-4ffd-b3f3-2a728646df22 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:12.316041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-068b4fd5-4e6c-4ffd-b3f3-2a728646df22 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:12.322097 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-068b4fd5-4e6c-4ffd-b3f3-2a728646df22 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:12.322553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-068b4fd5-4e6c-4ffd-b3f3-2a728646df22 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:12.323329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-068b4fd5-4e6c-4ffd-b3f3-2a728646df22 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:12.323771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-068b4fd5-4e6c-4ffd-b3f3-2a728646df22 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:12.457962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-068b4fd5-4e6c-4ffd-b3f3-2a728646df22 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:12.465426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-068b4fd5-4e6c-4ffd-b3f3-2a728646df22 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.155290 May 23 14:02:12.465992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1700/3324] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:12 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:13.055846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da5e3805-60a2-48e8-97a4-b2892b6d79fc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:13.056408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da5e3805-60a2-48e8-97a4-b2892b6d79fc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:13.058256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:13.064283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da5e3805-60a2-48e8-97a4-b2892b6d79fc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:13.070254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da5e3805-60a2-48e8-97a4-b2892b6d79fc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:13.070254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da5e3805-60a2-48e8-97a4-b2892b6d79fc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:13.070254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da5e3805-60a2-48e8-97a4-b2892b6d79fc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:13.129935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da5e3805-60a2-48e8-97a4-b2892b6d79fc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:13.138174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da5e3805-60a2-48e8-97a4-b2892b6d79fc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086504 May 23 14:02:13.138751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1625/3325] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:13 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:13.177785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:13.178409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:13.187536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:13.188453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:13.189726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:13.190374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:13.197620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:13.330244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:13.338258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:13.345023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:13.345023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-975f6e5b-cc02-43f8-afd4-0df209214558 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.167175 May 23 14:02:13.345023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1701/3326] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:13 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:13.483095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9f5efe7-0baf-412e-bb9f-d9fe03c3fbe8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:13.483709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9f5efe7-0baf-412e-bb9f-d9fe03c3fbe8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:13.489688 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9f5efe7-0baf-412e-bb9f-d9fe03c3fbe8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:13.490137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9f5efe7-0baf-412e-bb9f-d9fe03c3fbe8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:13.490893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9f5efe7-0baf-412e-bb9f-d9fe03c3fbe8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:13.491336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9f5efe7-0baf-412e-bb9f-d9fe03c3fbe8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:13.635522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9f5efe7-0baf-412e-bb9f-d9fe03c3fbe8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:13.646903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9f5efe7-0baf-412e-bb9f-d9fe03c3fbe8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.167513 May 23 14:02:13.647490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1626/3327] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:13 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:14.156113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d3fe0c2-5690-4642-93f4-d724ad642435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:14.156787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d3fe0c2-5690-4642-93f4-d724ad642435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:14.158657 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=18 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:14.163480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d3fe0c2-5690-4642-93f4-d724ad642435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:14.163929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d3fe0c2-5690-4642-93f4-d724ad642435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:14.164708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d3fe0c2-5690-4642-93f4-d724ad642435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:14.165141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d3fe0c2-5690-4642-93f4-d724ad642435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:14.227805 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d3fe0c2-5690-4642-93f4-d724ad642435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:14.236518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d3fe0c2-5690-4642-93f4-d724ad642435 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085123 May 23 14:02:14.237122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1702/3328] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:14 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:14.359317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:14.359925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:14.366397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:14.366846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:14.367628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:14.368064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:14.497842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:14.506803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:14.508286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:14.509421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b7c1f0f7-2d74-4af3-92a9-ac52b0535306 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.154003 May 23 14:02:14.509971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1627/3329] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:14 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:14.664514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d348b19-a656-46c1-b40a-2d83b93e23f0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:14.665156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d348b19-a656-46c1-b40a-2d83b93e23f0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:14.671176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d348b19-a656-46c1-b40a-2d83b93e23f0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:14.671678 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d348b19-a656-46c1-b40a-2d83b93e23f0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:14.672385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d348b19-a656-46c1-b40a-2d83b93e23f0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:14.672853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d348b19-a656-46c1-b40a-2d83b93e23f0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:14.805442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d348b19-a656-46c1-b40a-2d83b93e23f0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:14.812990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d348b19-a656-46c1-b40a-2d83b93e23f0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.152374 May 23 14:02:14.813559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1703/3330] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:14 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:15.253448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36c63827-c4e9-4ef6-90e5-9e58b749c073 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:15.254067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36c63827-c4e9-4ef6-90e5-9e58b749c073 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:15.255969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=12 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:15.260929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36c63827-c4e9-4ef6-90e5-9e58b749c073 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:15.261383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36c63827-c4e9-4ef6-90e5-9e58b749c073 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:15.262155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36c63827-c4e9-4ef6-90e5-9e58b749c073 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:15.262606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36c63827-c4e9-4ef6-90e5-9e58b749c073 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:15.353779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36c63827-c4e9-4ef6-90e5-9e58b749c073 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:15.364166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36c63827-c4e9-4ef6-90e5-9e58b749c073 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.114968 May 23 14:02:15.365989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1628/3331] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:15 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:15.527900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:15.528702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:15.535843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:15.536400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:15.537854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:15.538028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:15.684583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:15.693295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:15.694810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:15.695906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-de5b6a6c-199c-4932-83b5-b15fd2985ad2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.172559 May 23 14:02:15.696461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1704/3332] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:15 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:15.830490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3293b2c8-5760-4416-b7b2-5f2c47f8e327 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:15.831113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3293b2c8-5760-4416-b7b2-5f2c47f8e327 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:15.837738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3293b2c8-5760-4416-b7b2-5f2c47f8e327 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:15.838192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3293b2c8-5760-4416-b7b2-5f2c47f8e327 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:15.838959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3293b2c8-5760-4416-b7b2-5f2c47f8e327 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:15.839399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3293b2c8-5760-4416-b7b2-5f2c47f8e327 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:15.970970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3293b2c8-5760-4416-b7b2-5f2c47f8e327 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:15.978766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3293b2c8-5760-4416-b7b2-5f2c47f8e327 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.152681 May 23 14:02:15.979354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1629/3333] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:15 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:16.381431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5053faf4-6509-462d-8031-4e23a67d1727 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:16.382043 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5053faf4-6509-462d-8031-4e23a67d1727 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:16.388154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5053faf4-6509-462d-8031-4e23a67d1727 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:16.388642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5053faf4-6509-462d-8031-4e23a67d1727 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:16.389412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5053faf4-6509-462d-8031-4e23a67d1727 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:16.390664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5053faf4-6509-462d-8031-4e23a67d1727 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:16.451864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5053faf4-6509-462d-8031-4e23a67d1727 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:16.460447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5053faf4-6509-462d-8031-4e23a67d1727 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.082823 May 23 14:02:16.461038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1705/3334] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:16 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:16.714270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:16.714829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:16.721434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:16.721908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:16.722658 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:16.723090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:16.856458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:16.865402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:16.866908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:16.868010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-76c53c97-6fbc-4458-9234-302c569567cc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.157749 May 23 14:02:16.868590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1630/3335] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:16 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:16.996462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e1a7262-f192-45c2-831c-dc65d79a8485 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:16.997673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e1a7262-f192-45c2-831c-dc65d79a8485 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:17.004375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e1a7262-f192-45c2-831c-dc65d79a8485 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:17.004857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e1a7262-f192-45c2-831c-dc65d79a8485 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:17.005619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e1a7262-f192-45c2-831c-dc65d79a8485 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:17.006049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e1a7262-f192-45c2-831c-dc65d79a8485 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:17.143510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e1a7262-f192-45c2-831c-dc65d79a8485 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:17.151220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e1a7262-f192-45c2-831c-dc65d79a8485 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.158653 May 23 14:02:17.151796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1706/3336] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:16 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:17.478349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b93c5149-b7d5-4153-9035-508bfc337dc1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:17.478966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b93c5149-b7d5-4153-9035-508bfc337dc1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:17.485798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b93c5149-b7d5-4153-9035-508bfc337dc1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:17.486248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b93c5149-b7d5-4153-9035-508bfc337dc1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:17.487024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b93c5149-b7d5-4153-9035-508bfc337dc1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:17.487460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b93c5149-b7d5-4153-9035-508bfc337dc1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:17.550367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b93c5149-b7d5-4153-9035-508bfc337dc1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:17.558592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b93c5149-b7d5-4153-9035-508bfc337dc1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084222 May 23 14:02:17.559159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1631/3337] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:17 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:17.886300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:17.886917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:17.893392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:17.893847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:17.894643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:17.895086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:18.037229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:18.047019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:18.048903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:18.050474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4eae7206-b24b-45f7-a720-8ae6eb4ad4e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.168102 May 23 14:02:18.051299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1707/3338] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:17 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:18.099319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-07b1d5f2-77b1-430c-9947-3bb81e797f3c req-b0487196-570e-464d-b0cf-aecc0d510483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6a8553-8450-4844-96db-c1e6124148f7", "name": "network-vif-plugged", "status": "completed", "tag": "fb68c5de-2cf4-41d5-9537-632b1b17098e"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:02:18.107774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-07b1d5f2-77b1-430c-9947-3bb81e797f3c req-b0487196-570e-464d-b0cf-aecc0d510483 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:18.109004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-07b1d5f2-77b1-430c-9947-3bb81e797f3c req-b0487196-570e-464d-b0cf-aecc0d510483 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:18.121322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-07b1d5f2-77b1-430c-9947-3bb81e797f3c req-b0487196-570e-464d-b0cf-aecc0d510483 service nova] Creating event network-vif-plugged:fb68c5de-2cf4-41d5-9537-632b1b17098e for instance ce6a8553-8450-4844-96db-c1e6124148f7 on hv-cinder-82549 May 23 14:02:18.127130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-07b1d5f2-77b1-430c-9947-3bb81e797f3c req-b0487196-570e-464d-b0cf-aecc0d510483 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104758 May 23 14:02:18.127768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1632/3339] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:02:18.169343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49152ee6-7a5f-456a-aad5-a927b986075c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:18.169971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49152ee6-7a5f-456a-aad5-a927b986075c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:18.177957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49152ee6-7a5f-456a-aad5-a927b986075c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:18.178499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49152ee6-7a5f-456a-aad5-a927b986075c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:18.179289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49152ee6-7a5f-456a-aad5-a927b986075c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:18.180112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49152ee6-7a5f-456a-aad5-a927b986075c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:18.325973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49152ee6-7a5f-456a-aad5-a927b986075c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:18.345223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49152ee6-7a5f-456a-aad5-a927b986075c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.179525 May 23 14:02:18.346094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1708/3340] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:18 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:18.578054 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a2ec96a5-f380-427e-905f-a5ecee1e37cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:18.578766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a2ec96a5-f380-427e-905f-a5ecee1e37cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:18.586033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2ec96a5-f380-427e-905f-a5ecee1e37cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:18.586575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2ec96a5-f380-427e-905f-a5ecee1e37cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:18.587441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2ec96a5-f380-427e-905f-a5ecee1e37cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:18.587952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2ec96a5-f380-427e-905f-a5ecee1e37cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:18.679294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a2ec96a5-f380-427e-905f-a5ecee1e37cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:18.691587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a2ec96a5-f380-427e-905f-a5ecee1e37cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.117873 May 23 14:02:18.692929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1633/3341] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:18 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:19.069034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:19.069642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:19.076061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:19.076509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:19.077833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:19.078266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:19.222833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:19.223364 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:19.224933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:19.226054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8057cf4f-cbf5-47a4-b437-4ba518ac8041 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.161012 May 23 14:02:19.226617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1709/3342] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:19 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:19.362430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-be4437e5-3101-4058-aae2-ff3ddad384d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:19.363695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-be4437e5-3101-4058-aae2-ff3ddad384d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:19.369574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be4437e5-3101-4058-aae2-ff3ddad384d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:19.370026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be4437e5-3101-4058-aae2-ff3ddad384d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:19.370828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be4437e5-3101-4058-aae2-ff3ddad384d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:19.371259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be4437e5-3101-4058-aae2-ff3ddad384d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:19.502056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-be4437e5-3101-4058-aae2-ff3ddad384d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:19.509491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-be4437e5-3101-4058-aae2-ff3ddad384d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.151408 May 23 14:02:19.510057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1634/3343] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:19 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:19.710396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56a40589-0748-4c24-82b0-7e8aa90bb296 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:19.711178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56a40589-0748-4c24-82b0-7e8aa90bb296 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:19.717336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56a40589-0748-4c24-82b0-7e8aa90bb296 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:19.717947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56a40589-0748-4c24-82b0-7e8aa90bb296 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:19.718804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56a40589-0748-4c24-82b0-7e8aa90bb296 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:19.719251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56a40589-0748-4c24-82b0-7e8aa90bb296 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:19.786855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56a40589-0748-4c24-82b0-7e8aa90bb296 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:19.794953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56a40589-0748-4c24-82b0-7e8aa90bb296 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089381 May 23 14:02:19.795528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1710/3344] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:19 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:20.151458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-38726a3a-4c45-44c2-b1f9-6b1f200305ae req-4626988f-48e9-4875-9c28-214dca7e86e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90125c19-518a-4c0d-a38d-49062d11796e", "name": "network-vif-plugged", "status": "completed", "tag": "20f9d7dd-294d-470d-a93d-2e0a58b960e2"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:02:20.159713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-38726a3a-4c45-44c2-b1f9-6b1f200305ae req-4626988f-48e9-4875-9c28-214dca7e86e6 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:20.160149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-38726a3a-4c45-44c2-b1f9-6b1f200305ae req-4626988f-48e9-4875-9c28-214dca7e86e6 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:20.171233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-38726a3a-4c45-44c2-b1f9-6b1f200305ae req-4626988f-48e9-4875-9c28-214dca7e86e6 service nova] Creating event network-vif-plugged:20f9d7dd-294d-470d-a93d-2e0a58b960e2 for instance 90125c19-518a-4c0d-a38d-49062d11796e on hv-cinder-82549 May 23 14:02:20.176041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-38726a3a-4c45-44c2-b1f9-6b1f200305ae req-4626988f-48e9-4875-9c28-214dca7e86e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028999 May 23 14:02:20.176652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1635/3345] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:02:20.244812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:20.245361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:20.252481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:20.252952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:20.253711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:20.254150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:20.389916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:20.398306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:20.399829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:20.401023 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb2b8cb3-32f9-432b-a60a-c76ffe85b305 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1407 microversion: 2.20 time: 0.160193 May 23 14:02:20.401586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1711/3346] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:20 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:20.528358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d2d959d-e83f-4f55-977d-148750ec8883 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:20.529007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d2d959d-e83f-4f55-977d-148750ec8883 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:20.535867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d2d959d-e83f-4f55-977d-148750ec8883 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:20.536314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d2d959d-e83f-4f55-977d-148750ec8883 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:20.537098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d2d959d-e83f-4f55-977d-148750ec8883 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:20.537534 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d2d959d-e83f-4f55-977d-148750ec8883 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:20.668257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d2d959d-e83f-4f55-977d-148750ec8883 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:20.676424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d2d959d-e83f-4f55-977d-148750ec8883 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.152784 May 23 14:02:20.677095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1636/3347] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:20 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:20.813320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-271426d7-3c0a-4f43-addd-e9bec46f8def tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:20.813887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-271426d7-3c0a-4f43-addd-e9bec46f8def tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:20.820014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-271426d7-3c0a-4f43-addd-e9bec46f8def tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:20.820458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-271426d7-3c0a-4f43-addd-e9bec46f8def tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:20.821293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-271426d7-3c0a-4f43-addd-e9bec46f8def tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:20.821741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-271426d7-3c0a-4f43-addd-e9bec46f8def tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:20.887781 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-271426d7-3c0a-4f43-addd-e9bec46f8def tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:20.896991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-271426d7-3c0a-4f43-addd-e9bec46f8def tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087565 May 23 14:02:20.897367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1712/3348] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:20 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:21.419647 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:21.420176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:21.427278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:21.427870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:21.428804 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:21.429235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:21.561039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:21.570201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:21.571692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:21.572887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f558c1d-ae64-4f58-bf7d-de3f355a8ddc tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1599 microversion: 2.20 time: 0.157254 May 23 14:02:21.573479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1637/3349] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:02:21 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:02:21.590377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2d9c52d-d1c8-4cd3-be87-3ca84d0748f5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:21.590960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f2d9c52d-d1c8-4cd3-be87-3ca84d0748f5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:21.597948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d9c52d-d1c8-4cd3-be87-3ca84d0748f5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:21.598399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d9c52d-d1c8-4cd3-be87-3ca84d0748f5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:21.599163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d9c52d-d1c8-4cd3-be87-3ca84d0748f5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:21.599604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d9c52d-d1c8-4cd3-be87-3ca84d0748f5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:21.678343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2d9c52d-d1c8-4cd3-be87-3ca84d0748f5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091900 May 23 14:02:21.678944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1713/3350] 10.222.0.70 () {60 vars in 1315 bytes} [Mon May 23 14:02:21 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 14:02:21.692917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1a8a8e47-bda5-49ca-a988-d315cb355725 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:21.693546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1a8a8e47-bda5-49ca-a988-d315cb355725 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:21.699575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a8a8e47-bda5-49ca-a988-d315cb355725 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:21.700035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a8a8e47-bda5-49ca-a988-d315cb355725 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:21.700833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a8a8e47-bda5-49ca-a988-d315cb355725 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:21.701277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a8a8e47-bda5-49ca-a988-d315cb355725 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:21.861202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1a8a8e47-bda5-49ca-a988-d315cb355725 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:21.869171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1a8a8e47-bda5-49ca-a988-d315cb355725 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1368 microversion: 2.1 time: 0.180033 May 23 14:02:21.869746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1638/3351] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:21 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:21.913537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4c36b46f-2322-468b-bd25-defca59ddea0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:21.914160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4c36b46f-2322-468b-bd25-defca59ddea0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:21.920244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c36b46f-2322-468b-bd25-defca59ddea0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:21.921428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c36b46f-2322-468b-bd25-defca59ddea0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:21.922356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c36b46f-2322-468b-bd25-defca59ddea0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:21.922796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4c36b46f-2322-468b-bd25-defca59ddea0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:22.017926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4c36b46f-2322-468b-bd25-defca59ddea0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:22.025866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4c36b46f-2322-468b-bd25-defca59ddea0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.116194 May 23 14:02:22.026445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1714/3352] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:21 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:22.741586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-1d59666c-b353-4ef4-a84f-e3a9127a0483 req-2dcf2023-21d5-4d13-bbdb-8c8837ee97af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce6a8553-8450-4844-96db-c1e6124148f7", "tag": "fb68c5de-2cf4-41d5-9537-632b1b17098e"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:02:22.751384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-1d59666c-b353-4ef4-a84f-e3a9127a0483 req-2dcf2023-21d5-4d13-bbdb-8c8837ee97af service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:22.751825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-1d59666c-b353-4ef4-a84f-e3a9127a0483 req-2dcf2023-21d5-4d13-bbdb-8c8837ee97af service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:22.763755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-1d59666c-b353-4ef4-a84f-e3a9127a0483 req-2dcf2023-21d5-4d13-bbdb-8c8837ee97af service nova] Creating event network-changed:fb68c5de-2cf4-41d5-9537-632b1b17098e for instance ce6a8553-8450-4844-96db-c1e6124148f7 on hv-cinder-82549 May 23 14:02:22.769934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-1d59666c-b353-4ef4-a84f-e3a9127a0483 req-2dcf2023-21d5-4d13-bbdb-8c8837ee97af service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031960 May 23 14:02:22.770724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1639/3353] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:02:22.885766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a2e2c5f5-dfab-49ff-ae84-ef1e23cbc88d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:22.886431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a2e2c5f5-dfab-49ff-ae84-ef1e23cbc88d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:22.893335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2e2c5f5-dfab-49ff-ae84-ef1e23cbc88d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:22.893793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2e2c5f5-dfab-49ff-ae84-ef1e23cbc88d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:22.894573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2e2c5f5-dfab-49ff-ae84-ef1e23cbc88d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:22.895015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2e2c5f5-dfab-49ff-ae84-ef1e23cbc88d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:23.033727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a2e2c5f5-dfab-49ff-ae84-ef1e23cbc88d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:23.041363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a2e2c5f5-dfab-49ff-ae84-ef1e23cbc88d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1557 microversion: 2.1 time: 0.159385 May 23 14:02:23.041907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1715/3354] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:22 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:23.062038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a1bed71-8972-4750-87cd-a31c397b0895 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:23.062772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a1bed71-8972-4750-87cd-a31c397b0895 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:23.069229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a1bed71-8972-4750-87cd-a31c397b0895 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:23.069682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a1bed71-8972-4750-87cd-a31c397b0895 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:23.070735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a1bed71-8972-4750-87cd-a31c397b0895 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:23.070883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a1bed71-8972-4750-87cd-a31c397b0895 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:23.076429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85d2c82c-3265-442a-aad1-6fb302be0ec5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:23.077390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85d2c82c-3265-442a-aad1-6fb302be0ec5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:23.085403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85d2c82c-3265-442a-aad1-6fb302be0ec5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:23.086166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85d2c82c-3265-442a-aad1-6fb302be0ec5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:23.087001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85d2c82c-3265-442a-aad1-6fb302be0ec5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:23.087482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85d2c82c-3265-442a-aad1-6fb302be0ec5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:23.090792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:23.160730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-85d2c82c-3265-442a-aad1-6fb302be0ec5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:23.167358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a1bed71-8972-4750-87cd-a31c397b0895 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110402 May 23 14:02:23.168801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1640/3355] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 23 14:02:23 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:02:23.174817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85d2c82c-3265-442a-aad1-6fb302be0ec5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.102346 May 23 14:02:23.176138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1716/3356] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:23 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:24.193796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3e56b9e0-38e1-4230-a7a6-b3c3cc6ec41d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:24.194558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3e56b9e0-38e1-4230-a7a6-b3c3cc6ec41d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:24.200776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e56b9e0-38e1-4230-a7a6-b3c3cc6ec41d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:24.201229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e56b9e0-38e1-4230-a7a6-b3c3cc6ec41d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:24.202812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e56b9e0-38e1-4230-a7a6-b3c3cc6ec41d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:24.203297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e56b9e0-38e1-4230-a7a6-b3c3cc6ec41d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:24.267316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e56b9e0-38e1-4230-a7a6-b3c3cc6ec41d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:24.275352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3e56b9e0-38e1-4230-a7a6-b3c3cc6ec41d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085953 May 23 14:02:24.275922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1641/3357] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:24 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:24.784887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-a8a8e7e1-ea2a-49bb-b49e-b2747f48ff81 req-249db8be-abec-4bbf-ba39-b4c4585a41a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90125c19-518a-4c0d-a38d-49062d11796e", "tag": "20f9d7dd-294d-470d-a93d-2e0a58b960e2"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:02:24.793475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a8a8e7e1-ea2a-49bb-b49e-b2747f48ff81 req-249db8be-abec-4bbf-ba39-b4c4585a41a5 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:24.793916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-a8a8e7e1-ea2a-49bb-b49e-b2747f48ff81 req-249db8be-abec-4bbf-ba39-b4c4585a41a5 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:24.806373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-a8a8e7e1-ea2a-49bb-b49e-b2747f48ff81 req-249db8be-abec-4bbf-ba39-b4c4585a41a5 service nova] Creating event network-changed:20f9d7dd-294d-470d-a93d-2e0a58b960e2 for instance 90125c19-518a-4c0d-a38d-49062d11796e on hv-cinder-82549 May 23 14:02:24.812644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-a8a8e7e1-ea2a-49bb-b49e-b2747f48ff81 req-249db8be-abec-4bbf-ba39-b4c4585a41a5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031597 May 23 14:02:24.813379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1717/3358] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:02:25.293122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2fa50c72-c3a8-43c1-8db0-8f2054a7f513 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:25.293741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2fa50c72-c3a8-43c1-8db0-8f2054a7f513 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:25.301003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fa50c72-c3a8-43c1-8db0-8f2054a7f513 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:25.301486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fa50c72-c3a8-43c1-8db0-8f2054a7f513 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:25.302264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fa50c72-c3a8-43c1-8db0-8f2054a7f513 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:25.302702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fa50c72-c3a8-43c1-8db0-8f2054a7f513 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:25.378243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2fa50c72-c3a8-43c1-8db0-8f2054a7f513 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:25.387006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2fa50c72-c3a8-43c1-8db0-8f2054a7f513 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.097705 May 23 14:02:25.394147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1642/3359] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:25 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:26.406145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3474f642-3e79-474d-8f01-f1bba22b3862 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:26.406996 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3474f642-3e79-474d-8f01-f1bba22b3862 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:26.413381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3474f642-3e79-474d-8f01-f1bba22b3862 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:26.413831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3474f642-3e79-474d-8f01-f1bba22b3862 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:26.414592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3474f642-3e79-474d-8f01-f1bba22b3862 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:26.415030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3474f642-3e79-474d-8f01-f1bba22b3862 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:26.495469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3474f642-3e79-474d-8f01-f1bba22b3862 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:26.499013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:26.505158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3474f642-3e79-474d-8f01-f1bba22b3862 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.103703 May 23 14:02:26.505729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1718/3360] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:26 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:27.523151 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd8c8ca6-4242-4f9d-a413-960985904487 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:27.523742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd8c8ca6-4242-4f9d-a413-960985904487 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:27.530354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd8c8ca6-4242-4f9d-a413-960985904487 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:27.530801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd8c8ca6-4242-4f9d-a413-960985904487 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:27.531554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd8c8ca6-4242-4f9d-a413-960985904487 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:27.531985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd8c8ca6-4242-4f9d-a413-960985904487 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:27.594431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd8c8ca6-4242-4f9d-a413-960985904487 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:27.603866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd8c8ca6-4242-4f9d-a413-960985904487 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084506 May 23 14:02:27.604656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1643/3361] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:27 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:28.621337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cdf3a443-efa3-42fa-8ef4-1db28530e9dc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:28.622061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cdf3a443-efa3-42fa-8ef4-1db28530e9dc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:28.629620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdf3a443-efa3-42fa-8ef4-1db28530e9dc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:28.630074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdf3a443-efa3-42fa-8ef4-1db28530e9dc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:28.630846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdf3a443-efa3-42fa-8ef4-1db28530e9dc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:28.631285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdf3a443-efa3-42fa-8ef4-1db28530e9dc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:28.696400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cdf3a443-efa3-42fa-8ef4-1db28530e9dc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:28.704385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cdf3a443-efa3-42fa-8ef4-1db28530e9dc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086959 May 23 14:02:28.705551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1719/3362] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:28 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:29.722413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a3f86b9d-b3c9-4118-a6f2-25a73b6062ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:29.723020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a3f86b9d-b3c9-4118-a6f2-25a73b6062ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:29.729156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3f86b9d-b3c9-4118-a6f2-25a73b6062ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:29.729605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3f86b9d-b3c9-4118-a6f2-25a73b6062ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:29.730364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3f86b9d-b3c9-4118-a6f2-25a73b6062ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:29.730796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3f86b9d-b3c9-4118-a6f2-25a73b6062ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:29.792829 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a3f86b9d-b3c9-4118-a6f2-25a73b6062ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:29.802030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a3f86b9d-b3c9-4118-a6f2-25a73b6062ca tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083843 May 23 14:02:29.802587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1644/3363] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:29 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:30.819522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6760910c-d634-418c-9598-fe2dc8570bb6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:30.820147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6760910c-d634-418c-9598-fe2dc8570bb6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:30.826790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6760910c-d634-418c-9598-fe2dc8570bb6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:30.827189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6760910c-d634-418c-9598-fe2dc8570bb6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:30.827957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6760910c-d634-418c-9598-fe2dc8570bb6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:30.828404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6760910c-d634-418c-9598-fe2dc8570bb6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:30.890955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6760910c-d634-418c-9598-fe2dc8570bb6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:30.899989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6760910c-d634-418c-9598-fe2dc8570bb6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084359 May 23 14:02:30.900588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1720/3364] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:30 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:31.917722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bd902e0e-46a9-4ea2-b540-7fdfb0d2e470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:31.918275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd902e0e-46a9-4ea2-b540-7fdfb0d2e470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:31.925520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd902e0e-46a9-4ea2-b540-7fdfb0d2e470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:31.925972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd902e0e-46a9-4ea2-b540-7fdfb0d2e470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:31.926754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd902e0e-46a9-4ea2-b540-7fdfb0d2e470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:31.927192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd902e0e-46a9-4ea2-b540-7fdfb0d2e470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:31.992806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bd902e0e-46a9-4ea2-b540-7fdfb0d2e470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:32.002026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bd902e0e-46a9-4ea2-b540-7fdfb0d2e470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087623 May 23 14:02:32.002584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1645/3365] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:31 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:33.019922 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3f9b3e80-919d-4f3f-be90-14e2f43a602e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:33.020827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3f9b3e80-919d-4f3f-be90-14e2f43a602e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:33.023015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=75 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:33.027876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f9b3e80-919d-4f3f-be90-14e2f43a602e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:33.028331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f9b3e80-919d-4f3f-be90-14e2f43a602e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:33.029141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f9b3e80-919d-4f3f-be90-14e2f43a602e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:33.029583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3f9b3e80-919d-4f3f-be90-14e2f43a602e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:33.092455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3f9b3e80-919d-4f3f-be90-14e2f43a602e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:33.100852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3f9b3e80-919d-4f3f-be90-14e2f43a602e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085808 May 23 14:02:33.101414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1721/3366] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:33 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:34.122921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0975bdb0-f8d1-4a27-a982-5b29b8a620c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:34.123943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0975bdb0-f8d1-4a27-a982-5b29b8a620c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:34.131987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:34.138067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0975bdb0-f8d1-4a27-a982-5b29b8a620c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:34.138868 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0975bdb0-f8d1-4a27-a982-5b29b8a620c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:34.139776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0975bdb0-f8d1-4a27-a982-5b29b8a620c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:34.140336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0975bdb0-f8d1-4a27-a982-5b29b8a620c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:34.210778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0975bdb0-f8d1-4a27-a982-5b29b8a620c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:34.219712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0975bdb0-f8d1-4a27-a982-5b29b8a620c2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.104249 May 23 14:02:34.230282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1646/3367] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:34 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:34.314035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7b67526c-379c-47a2-a563-a7d50b4f402a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:34.314865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7b67526c-379c-47a2-a563-a7d50b4f402a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:34.323659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b67526c-379c-47a2-a563-a7d50b4f402a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:34.324111 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b67526c-379c-47a2-a563-a7d50b4f402a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:34.324997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b67526c-379c-47a2-a563-a7d50b4f402a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:34.325438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b67526c-379c-47a2-a563-a7d50b4f402a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:34.353360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7b67526c-379c-47a2-a563-a7d50b4f402a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:02:34.693433 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7b67526c-379c-47a2-a563-a7d50b4f402a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 204 len: 0 microversion: 2.1 time: 0.383139 May 23 14:02:34.694052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1722/3368] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:02:34 2022] DELETE /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 14:02:34.703394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-74ae4977-15d2-42d8-b0bc-f1ce01bd5113 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:34.704009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-74ae4977-15d2-42d8-b0bc-f1ce01bd5113 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:34.711779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74ae4977-15d2-42d8-b0bc-f1ce01bd5113 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:34.712230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74ae4977-15d2-42d8-b0bc-f1ce01bd5113 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:34.713022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74ae4977-15d2-42d8-b0bc-f1ce01bd5113 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:34.713455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-74ae4977-15d2-42d8-b0bc-f1ce01bd5113 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:34.851721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-74ae4977-15d2-42d8-b0bc-f1ce01bd5113 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:34.859689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-74ae4977-15d2-42d8-b0bc-f1ce01bd5113 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161475 May 23 14:02:34.860257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1647/3369] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:35.238282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f86c63c-63a1-4bf8-9a7c-733d3bb9fd40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:35.238992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f86c63c-63a1-4bf8-9a7c-733d3bb9fd40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:35.245586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f86c63c-63a1-4bf8-9a7c-733d3bb9fd40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:35.246037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f86c63c-63a1-4bf8-9a7c-733d3bb9fd40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:35.247080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f86c63c-63a1-4bf8-9a7c-733d3bb9fd40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:35.247257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f86c63c-63a1-4bf8-9a7c-733d3bb9fd40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:35.320242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f86c63c-63a1-4bf8-9a7c-733d3bb9fd40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:35.328731 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f86c63c-63a1-4bf8-9a7c-733d3bb9fd40 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094781 May 23 14:02:35.329302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1723/3370] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:35 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:35.876333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-88be0b5b-34df-4f31-8a6a-b57b8979ca2b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:35.877240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-88be0b5b-34df-4f31-8a6a-b57b8979ca2b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:35.884032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88be0b5b-34df-4f31-8a6a-b57b8979ca2b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:35.884482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88be0b5b-34df-4f31-8a6a-b57b8979ca2b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:35.885267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88be0b5b-34df-4f31-8a6a-b57b8979ca2b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:35.885704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88be0b5b-34df-4f31-8a6a-b57b8979ca2b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:36.027186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-88be0b5b-34df-4f31-8a6a-b57b8979ca2b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:36.036407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-88be0b5b-34df-4f31-8a6a-b57b8979ca2b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.163917 May 23 14:02:36.037040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1648/3371] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:36.346809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-af5fbe20-c089-438b-a9f3-881e574b7e9c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:36.347347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-af5fbe20-c089-438b-a9f3-881e574b7e9c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:36.354151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af5fbe20-c089-438b-a9f3-881e574b7e9c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:36.354594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af5fbe20-c089-438b-a9f3-881e574b7e9c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:36.355356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af5fbe20-c089-438b-a9f3-881e574b7e9c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:36.355790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af5fbe20-c089-438b-a9f3-881e574b7e9c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:36.418693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-af5fbe20-c089-438b-a9f3-881e574b7e9c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:36.430574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-af5fbe20-c089-438b-a9f3-881e574b7e9c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087873 May 23 14:02:36.431151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1724/3372] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:36 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:37.054283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a0a26a45-4678-4994-a180-c37bb55970cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:37.054844 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a0a26a45-4678-4994-a180-c37bb55970cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:37.061314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0a26a45-4678-4994-a180-c37bb55970cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:37.061760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0a26a45-4678-4994-a180-c37bb55970cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:37.062518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0a26a45-4678-4994-a180-c37bb55970cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:37.062951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0a26a45-4678-4994-a180-c37bb55970cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:37.202273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a0a26a45-4678-4994-a180-c37bb55970cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:37.211070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a0a26a45-4678-4994-a180-c37bb55970cb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160950 May 23 14:02:37.211644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1649/3373] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:37.448449 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a895f7d-7e02-4b26-a76f-1b08c1815d5f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:37.449119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a895f7d-7e02-4b26-a76f-1b08c1815d5f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:37.456666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a895f7d-7e02-4b26-a76f-1b08c1815d5f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:37.457124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a895f7d-7e02-4b26-a76f-1b08c1815d5f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:37.457902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a895f7d-7e02-4b26-a76f-1b08c1815d5f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:37.458348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a895f7d-7e02-4b26-a76f-1b08c1815d5f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:37.524499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a895f7d-7e02-4b26-a76f-1b08c1815d5f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:37.533647 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a895f7d-7e02-4b26-a76f-1b08c1815d5f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088332 May 23 14:02:37.534340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1725/3374] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:37 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:38.229208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aff5f444-0561-477a-8c23-84a312024b7b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:38.229812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aff5f444-0561-477a-8c23-84a312024b7b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:38.238205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aff5f444-0561-477a-8c23-84a312024b7b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:38.238668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aff5f444-0561-477a-8c23-84a312024b7b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:38.239482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aff5f444-0561-477a-8c23-84a312024b7b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:38.239965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aff5f444-0561-477a-8c23-84a312024b7b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:38.389870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aff5f444-0561-477a-8c23-84a312024b7b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:38.399188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aff5f444-0561-477a-8c23-84a312024b7b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.173911 May 23 14:02:38.399756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1650/3375] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:38.551680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3186b1a8-390e-4302-ae5d-34e4e77f15ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:38.552315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3186b1a8-390e-4302-ae5d-34e4e77f15ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:38.559158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3186b1a8-390e-4302-ae5d-34e4e77f15ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:38.559612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3186b1a8-390e-4302-ae5d-34e4e77f15ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:38.560389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3186b1a8-390e-4302-ae5d-34e4e77f15ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:38.560870 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3186b1a8-390e-4302-ae5d-34e4e77f15ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:38.627025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3186b1a8-390e-4302-ae5d-34e4e77f15ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:38.635103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3186b1a8-390e-4302-ae5d-34e4e77f15ba tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087963 May 23 14:02:38.635670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1726/3376] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:38 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:39.417677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04762f48-0c48-4223-852e-188879ecf8c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:39.420812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04762f48-0c48-4223-852e-188879ecf8c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:39.425948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04762f48-0c48-4223-852e-188879ecf8c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:39.426424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04762f48-0c48-4223-852e-188879ecf8c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:39.427275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04762f48-0c48-4223-852e-188879ecf8c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:39.427720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04762f48-0c48-4223-852e-188879ecf8c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:39.574147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04762f48-0c48-4223-852e-188879ecf8c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:39.583628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04762f48-0c48-4223-852e-188879ecf8c4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.169940 May 23 14:02:39.584201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1651/3377] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:39.653202 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-13ca8175-173e-4544-b883-b9cb7d8d8b86 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:39.653813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-13ca8175-173e-4544-b883-b9cb7d8d8b86 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:39.661094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ca8175-173e-4544-b883-b9cb7d8d8b86 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:39.661541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ca8175-173e-4544-b883-b9cb7d8d8b86 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:39.662323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ca8175-173e-4544-b883-b9cb7d8d8b86 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:39.663621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ca8175-173e-4544-b883-b9cb7d8d8b86 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:39.732855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-13ca8175-173e-4544-b883-b9cb7d8d8b86 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:39.743232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-13ca8175-173e-4544-b883-b9cb7d8d8b86 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094008 May 23 14:02:39.743823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1727/3378] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:39 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:40.600939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7efb5870-0cf0-451e-8935-890570271738 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:40.601559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7efb5870-0cf0-451e-8935-890570271738 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:40.608212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7efb5870-0cf0-451e-8935-890570271738 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:40.608706 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7efb5870-0cf0-451e-8935-890570271738 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:40.609484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7efb5870-0cf0-451e-8935-890570271738 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:40.610213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7efb5870-0cf0-451e-8935-890570271738 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:40.749873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7efb5870-0cf0-451e-8935-890570271738 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:40.758967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7efb5870-0cf0-451e-8935-890570271738 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161907 May 23 14:02:40.759553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1652/3379] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:40.769206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e1c6742-2f9e-4a02-8cc8-e90992e602a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:40.769206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e1c6742-2f9e-4a02-8cc8-e90992e602a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:40.769206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e1c6742-2f9e-4a02-8cc8-e90992e602a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:40.769206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e1c6742-2f9e-4a02-8cc8-e90992e602a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:40.770072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e1c6742-2f9e-4a02-8cc8-e90992e602a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:40.770072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e1c6742-2f9e-4a02-8cc8-e90992e602a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:40.836369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e1c6742-2f9e-4a02-8cc8-e90992e602a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:40.844683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e1c6742-2f9e-4a02-8cc8-e90992e602a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087765 May 23 14:02:40.845256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1728/3380] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:40 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:41.777132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ddc437f0-4778-4850-9ed3-6757c2f88183 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:41.777749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ddc437f0-4778-4850-9ed3-6757c2f88183 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:41.785075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc437f0-4778-4850-9ed3-6757c2f88183 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:41.785525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc437f0-4778-4850-9ed3-6757c2f88183 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:41.786293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc437f0-4778-4850-9ed3-6757c2f88183 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:41.786729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ddc437f0-4778-4850-9ed3-6757c2f88183 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:41.862380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-29714f33-3199-431d-bd3f-c378cef1d7d1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:41.863009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-29714f33-3199-431d-bd3f-c378cef1d7d1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:41.869545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29714f33-3199-431d-bd3f-c378cef1d7d1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:41.869981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29714f33-3199-431d-bd3f-c378cef1d7d1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:41.870749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29714f33-3199-431d-bd3f-c378cef1d7d1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:41.871179 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-29714f33-3199-431d-bd3f-c378cef1d7d1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:41.931381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ddc437f0-4778-4850-9ed3-6757c2f88183 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:41.937066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-29714f33-3199-431d-bd3f-c378cef1d7d1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:41.939346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ddc437f0-4778-4850-9ed3-6757c2f88183 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165551 May 23 14:02:41.940195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1653/3381] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:41.947461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-29714f33-3199-431d-bd3f-c378cef1d7d1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089422 May 23 14:02:41.948195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1729/3382] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:41 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:42.956945 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e0c2b3f7-9be3-405d-aa58-e9a60c1952e8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:42.957622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e0c2b3f7-9be3-405d-aa58-e9a60c1952e8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:42.964335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0c2b3f7-9be3-405d-aa58-e9a60c1952e8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:42.964798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0c2b3f7-9be3-405d-aa58-e9a60c1952e8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:42.965094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-918f1243-814c-4f01-9665-ae54047e2894 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:42.965564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0c2b3f7-9be3-405d-aa58-e9a60c1952e8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:42.965723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-918f1243-814c-4f01-9665-ae54047e2894 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:42.965988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0c2b3f7-9be3-405d-aa58-e9a60c1952e8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:42.974756 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-918f1243-814c-4f01-9665-ae54047e2894 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:42.975428 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-918f1243-814c-4f01-9665-ae54047e2894 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:42.976554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-918f1243-814c-4f01-9665-ae54047e2894 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:42.977290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-918f1243-814c-4f01-9665-ae54047e2894 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:43.043602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-918f1243-814c-4f01-9665-ae54047e2894 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:43.053582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-918f1243-814c-4f01-9665-ae54047e2894 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092135 May 23 14:02:43.054163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1730/3383] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:42 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:43.099417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e0c2b3f7-9be3-405d-aa58-e9a60c1952e8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:43.107604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e0c2b3f7-9be3-405d-aa58-e9a60c1952e8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154857 May 23 14:02:43.108174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1654/3384] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:44.070988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8983d8c2-8222-4500-ae91-9b9dd207784d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:44.071620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8983d8c2-8222-4500-ae91-9b9dd207784d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:44.078193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8983d8c2-8222-4500-ae91-9b9dd207784d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:44.078650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8983d8c2-8222-4500-ae91-9b9dd207784d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:44.080167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8983d8c2-8222-4500-ae91-9b9dd207784d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:44.080639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8983d8c2-8222-4500-ae91-9b9dd207784d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:44.125448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0cd98858-696e-4a95-be18-e03f76dce3af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:44.126614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0cd98858-696e-4a95-be18-e03f76dce3af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:44.133799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cd98858-696e-4a95-be18-e03f76dce3af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:44.134264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cd98858-696e-4a95-be18-e03f76dce3af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:44.135036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cd98858-696e-4a95-be18-e03f76dce3af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:44.135480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0cd98858-696e-4a95-be18-e03f76dce3af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:44.147825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8983d8c2-8222-4500-ae91-9b9dd207784d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:44.156257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8983d8c2-8222-4500-ae91-9b9dd207784d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089095 May 23 14:02:44.156869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1731/3385] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:44 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:44.277646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0cd98858-696e-4a95-be18-e03f76dce3af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:44.286475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0cd98858-696e-4a95-be18-e03f76dce3af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164947 May 23 14:02:44.287056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1655/3386] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:45.174014 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7cef7f96-84a0-411f-aaba-e7f5d9161a03 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:45.174644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7cef7f96-84a0-411f-aaba-e7f5d9161a03 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:45.181924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cef7f96-84a0-411f-aaba-e7f5d9161a03 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:45.182393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cef7f96-84a0-411f-aaba-e7f5d9161a03 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:45.183181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cef7f96-84a0-411f-aaba-e7f5d9161a03 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:45.183620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cef7f96-84a0-411f-aaba-e7f5d9161a03 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:45.249943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7cef7f96-84a0-411f-aaba-e7f5d9161a03 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:45.259393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7cef7f96-84a0-411f-aaba-e7f5d9161a03 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089553 May 23 14:02:45.259985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1732/3387] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:45 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:45.304126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0d6602c9-680e-4e7b-8d85-a854587d39d5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:45.305045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0d6602c9-680e-4e7b-8d85-a854587d39d5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:45.311404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d6602c9-680e-4e7b-8d85-a854587d39d5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:45.311848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d6602c9-680e-4e7b-8d85-a854587d39d5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:45.312644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d6602c9-680e-4e7b-8d85-a854587d39d5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:45.313078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0d6602c9-680e-4e7b-8d85-a854587d39d5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:45.453264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0d6602c9-680e-4e7b-8d85-a854587d39d5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:45.461295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0d6602c9-680e-4e7b-8d85-a854587d39d5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161312 May 23 14:02:45.461865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1656/3388] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:46.277891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-351b8339-08cd-4947-a65f-5aecdb4c85a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:46.278445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-351b8339-08cd-4947-a65f-5aecdb4c85a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:46.284742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-351b8339-08cd-4947-a65f-5aecdb4c85a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:46.285198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-351b8339-08cd-4947-a65f-5aecdb4c85a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:46.285976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-351b8339-08cd-4947-a65f-5aecdb4c85a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:46.286416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-351b8339-08cd-4947-a65f-5aecdb4c85a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:46.350200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-351b8339-08cd-4947-a65f-5aecdb4c85a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:46.353772 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:46.358539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-351b8339-08cd-4947-a65f-5aecdb4c85a1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085316 May 23 14:02:46.359114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1733/3389] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:46 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:46.479370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-813c6165-576b-42f9-b779-fdda1b81c430 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:46.480009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-813c6165-576b-42f9-b779-fdda1b81c430 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:46.487928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-813c6165-576b-42f9-b779-fdda1b81c430 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:46.488370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-813c6165-576b-42f9-b779-fdda1b81c430 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:46.489183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-813c6165-576b-42f9-b779-fdda1b81c430 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:46.489616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-813c6165-576b-42f9-b779-fdda1b81c430 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:46.513299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:02:46.711717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-813c6165-576b-42f9-b779-fdda1b81c430 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:46.720060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-813c6165-576b-42f9-b779-fdda1b81c430 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.244946 May 23 14:02:46.720668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1657/3390] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:47.375692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4fe70b43-28de-47dd-8667-071eb2177f9e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:47.376352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4fe70b43-28de-47dd-8667-071eb2177f9e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:47.383232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fe70b43-28de-47dd-8667-071eb2177f9e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:47.383683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fe70b43-28de-47dd-8667-071eb2177f9e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:47.384455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fe70b43-28de-47dd-8667-071eb2177f9e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:47.384914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fe70b43-28de-47dd-8667-071eb2177f9e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:47.447341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4fe70b43-28de-47dd-8667-071eb2177f9e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:47.456266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4fe70b43-28de-47dd-8667-071eb2177f9e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084850 May 23 14:02:47.456878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1734/3391] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:47 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:47.738645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-adc21dd7-cd7f-470d-8714-a4d5b97b0fa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:47.739224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-adc21dd7-cd7f-470d-8714-a4d5b97b0fa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:47.745836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adc21dd7-cd7f-470d-8714-a4d5b97b0fa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:47.746283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adc21dd7-cd7f-470d-8714-a4d5b97b0fa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:47.747046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adc21dd7-cd7f-470d-8714-a4d5b97b0fa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:47.747480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adc21dd7-cd7f-470d-8714-a4d5b97b0fa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:47.887779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-adc21dd7-cd7f-470d-8714-a4d5b97b0fa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:47.896305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-adc21dd7-cd7f-470d-8714-a4d5b97b0fa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161745 May 23 14:02:47.896899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1658/3392] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:48.473570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8429948d-df9e-494e-92f7-11c42cc543a8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:48.474204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8429948d-df9e-494e-92f7-11c42cc543a8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:48.481232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8429948d-df9e-494e-92f7-11c42cc543a8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:48.481685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8429948d-df9e-494e-92f7-11c42cc543a8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:48.482455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8429948d-df9e-494e-92f7-11c42cc543a8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:48.482896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8429948d-df9e-494e-92f7-11c42cc543a8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:48.551300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8429948d-df9e-494e-92f7-11c42cc543a8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:48.560661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8429948d-df9e-494e-92f7-11c42cc543a8 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090990 May 23 14:02:48.561240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1735/3393] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:48.913179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-51eefd7b-25de-48a9-b9df-5a2e741cd9eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:48.913787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-51eefd7b-25de-48a9-b9df-5a2e741cd9eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:48.920315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51eefd7b-25de-48a9-b9df-5a2e741cd9eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:48.920925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51eefd7b-25de-48a9-b9df-5a2e741cd9eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:48.921676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51eefd7b-25de-48a9-b9df-5a2e741cd9eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:48.922024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-51eefd7b-25de-48a9-b9df-5a2e741cd9eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:49.057060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-51eefd7b-25de-48a9-b9df-5a2e741cd9eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:49.065447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-51eefd7b-25de-48a9-b9df-5a2e741cd9eb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156088 May 23 14:02:49.066024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1659/3394] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:49.578137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-41b7f69b-bfad-417b-9289-760ee6897826 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:49.578760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-41b7f69b-bfad-417b-9289-760ee6897826 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:49.585673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41b7f69b-bfad-417b-9289-760ee6897826 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:49.586250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41b7f69b-bfad-417b-9289-760ee6897826 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:49.586929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41b7f69b-bfad-417b-9289-760ee6897826 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:49.587355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-41b7f69b-bfad-417b-9289-760ee6897826 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:49.651636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-41b7f69b-bfad-417b-9289-760ee6897826 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:49.660679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-41b7f69b-bfad-417b-9289-760ee6897826 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086505 May 23 14:02:49.661254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1736/3395] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:49 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:50.089254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-baabc1a0-91f0-4241-90fe-cd04599deea3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:50.089913 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-baabc1a0-91f0-4241-90fe-cd04599deea3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:50.098602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baabc1a0-91f0-4241-90fe-cd04599deea3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:50.099052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baabc1a0-91f0-4241-90fe-cd04599deea3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:50.099846 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baabc1a0-91f0-4241-90fe-cd04599deea3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:50.100289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-baabc1a0-91f0-4241-90fe-cd04599deea3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:50.250100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-baabc1a0-91f0-4241-90fe-cd04599deea3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:50.259247 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-baabc1a0-91f0-4241-90fe-cd04599deea3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.173965 May 23 14:02:50.259746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1660/3396] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:50.680920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fa6b1828-6593-4fe6-a33b-5e141ed9e326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:50.681616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fa6b1828-6593-4fe6-a33b-5e141ed9e326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:50.692216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa6b1828-6593-4fe6-a33b-5e141ed9e326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:50.693069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa6b1828-6593-4fe6-a33b-5e141ed9e326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:50.694645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa6b1828-6593-4fe6-a33b-5e141ed9e326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:50.695287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa6b1828-6593-4fe6-a33b-5e141ed9e326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:50.763407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fa6b1828-6593-4fe6-a33b-5e141ed9e326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:50.771910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fa6b1828-6593-4fe6-a33b-5e141ed9e326 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.097200 May 23 14:02:50.772513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1737/3397] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:51.278775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5a44efde-129d-4daa-8d4e-eb0278b07969 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:51.289771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5a44efde-129d-4daa-8d4e-eb0278b07969 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:51.289771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a44efde-129d-4daa-8d4e-eb0278b07969 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:51.289771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a44efde-129d-4daa-8d4e-eb0278b07969 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:51.289771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a44efde-129d-4daa-8d4e-eb0278b07969 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:51.290267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a44efde-129d-4daa-8d4e-eb0278b07969 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:51.427657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5a44efde-129d-4daa-8d4e-eb0278b07969 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:51.435889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5a44efde-129d-4daa-8d4e-eb0278b07969 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161150 May 23 14:02:51.436454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1661/3398] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:51.789057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc58702e-f51f-44ce-a6f5-6d8c176fe585 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:51.789596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc58702e-f51f-44ce-a6f5-6d8c176fe585 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:51.796246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc58702e-f51f-44ce-a6f5-6d8c176fe585 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:51.796746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc58702e-f51f-44ce-a6f5-6d8c176fe585 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:51.797524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc58702e-f51f-44ce-a6f5-6d8c176fe585 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:51.798026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc58702e-f51f-44ce-a6f5-6d8c176fe585 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:51.865365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc58702e-f51f-44ce-a6f5-6d8c176fe585 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:51.873361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc58702e-f51f-44ce-a6f5-6d8c176fe585 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088358 May 23 14:02:51.873923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1738/3399] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:51 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:52.457797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7a217e64-72bf-4183-8084-28eafea01e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:52.458341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7a217e64-72bf-4183-8084-28eafea01e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:52.465145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a217e64-72bf-4183-8084-28eafea01e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:52.465599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a217e64-72bf-4183-8084-28eafea01e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:52.466374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a217e64-72bf-4183-8084-28eafea01e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:52.466813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a217e64-72bf-4183-8084-28eafea01e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:52.614542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7a217e64-72bf-4183-8084-28eafea01e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:52.622914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7a217e64-72bf-4183-8084-28eafea01e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.169738 May 23 14:02:52.623486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1662/3400] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:52.891642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cdd308a4-6e0d-41fe-886c-abf9ab2995e1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:52.892252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cdd308a4-6e0d-41fe-886c-abf9ab2995e1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:52.899396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd308a4-6e0d-41fe-886c-abf9ab2995e1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:52.899840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd308a4-6e0d-41fe-886c-abf9ab2995e1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:52.900633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd308a4-6e0d-41fe-886c-abf9ab2995e1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:52.901075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdd308a4-6e0d-41fe-886c-abf9ab2995e1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:52.967721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cdd308a4-6e0d-41fe-886c-abf9ab2995e1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:52.977306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cdd308a4-6e0d-41fe-886c-abf9ab2995e1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089753 May 23 14:02:52.977942 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1739/3401] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:52 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:53.640345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-984b4bbf-3422-477a-a949-aed8736b2e64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:53.640957 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-984b4bbf-3422-477a-a949-aed8736b2e64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:53.647997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-984b4bbf-3422-477a-a949-aed8736b2e64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:53.648453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-984b4bbf-3422-477a-a949-aed8736b2e64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:53.649227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-984b4bbf-3422-477a-a949-aed8736b2e64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:53.649653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-984b4bbf-3422-477a-a949-aed8736b2e64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:53.786625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-984b4bbf-3422-477a-a949-aed8736b2e64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:53.794519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-984b4bbf-3422-477a-a949-aed8736b2e64 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158031 May 23 14:02:53.806978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1663/3402] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:53.995423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-568af153-84ed-4f83-b13a-d67d051485ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:53.995967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-568af153-84ed-4f83-b13a-d67d051485ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:54.003837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-568af153-84ed-4f83-b13a-d67d051485ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:54.004294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-568af153-84ed-4f83-b13a-d67d051485ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:54.005098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-568af153-84ed-4f83-b13a-d67d051485ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:54.005548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-568af153-84ed-4f83-b13a-d67d051485ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:54.070475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-568af153-84ed-4f83-b13a-d67d051485ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:54.079472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-568af153-84ed-4f83-b13a-d67d051485ae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087291 May 23 14:02:54.080582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1740/3403] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:53 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:54.811152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1da007b0-a3ce-49d3-a15a-b42e0e7cd7c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:54.811761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1da007b0-a3ce-49d3-a15a-b42e0e7cd7c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:54.818575 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1da007b0-a3ce-49d3-a15a-b42e0e7cd7c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:54.819020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1da007b0-a3ce-49d3-a15a-b42e0e7cd7c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:54.819767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1da007b0-a3ce-49d3-a15a-b42e0e7cd7c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:54.820192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1da007b0-a3ce-49d3-a15a-b42e0e7cd7c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:54.956056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1da007b0-a3ce-49d3-a15a-b42e0e7cd7c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:54.964191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1da007b0-a3ce-49d3-a15a-b42e0e7cd7c0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156839 May 23 14:02:54.964824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1664/3404] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:55.099964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ea95fba1-d0ac-4ca8-88d6-dd031a64a772 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:55.100654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ea95fba1-d0ac-4ca8-88d6-dd031a64a772 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:55.108191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea95fba1-d0ac-4ca8-88d6-dd031a64a772 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:55.108674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea95fba1-d0ac-4ca8-88d6-dd031a64a772 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:55.109442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea95fba1-d0ac-4ca8-88d6-dd031a64a772 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:55.109887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea95fba1-d0ac-4ca8-88d6-dd031a64a772 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:55.175243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ea95fba1-d0ac-4ca8-88d6-dd031a64a772 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:55.183775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ea95fba1-d0ac-4ca8-88d6-dd031a64a772 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090058 May 23 14:02:55.184420 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1741/3405] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:55 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:56.049326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a04d76bc-dbbc-4308-be3c-eca89fb3a18f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:56.049981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a04d76bc-dbbc-4308-be3c-eca89fb3a18f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:56.056278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a04d76bc-dbbc-4308-be3c-eca89fb3a18f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:56.056774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a04d76bc-dbbc-4308-be3c-eca89fb3a18f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:56.057567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a04d76bc-dbbc-4308-be3c-eca89fb3a18f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:56.058002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a04d76bc-dbbc-4308-be3c-eca89fb3a18f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:56.192130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a04d76bc-dbbc-4308-be3c-eca89fb3a18f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:56.202017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a04d76bc-dbbc-4308-be3c-eca89fb3a18f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.224288 May 23 14:02:56.202478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-94ca596d-5cd5-46d3-939d-8d1e49525d5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:56.211856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1665/3406] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:56.211994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-94ca596d-5cd5-46d3-939d-8d1e49525d5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:56.215502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94ca596d-5cd5-46d3-939d-8d1e49525d5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:56.215951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94ca596d-5cd5-46d3-939d-8d1e49525d5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:56.216783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94ca596d-5cd5-46d3-939d-8d1e49525d5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:56.217276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94ca596d-5cd5-46d3-939d-8d1e49525d5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:56.280802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94ca596d-5cd5-46d3-939d-8d1e49525d5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:56.289581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-94ca596d-5cd5-46d3-939d-8d1e49525d5b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092755 May 23 14:02:56.290760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1742/3407] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:56 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:57.221100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-25b2840b-0d73-4e47-aeae-be0ef4d391da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:57.221833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-25b2840b-0d73-4e47-aeae-be0ef4d391da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:57.228672 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25b2840b-0d73-4e47-aeae-be0ef4d391da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:57.229141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25b2840b-0d73-4e47-aeae-be0ef4d391da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:57.229910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25b2840b-0d73-4e47-aeae-be0ef4d391da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:57.230359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-25b2840b-0d73-4e47-aeae-be0ef4d391da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:57.307375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efa1bf4b-dd9c-4a11-84c6-b5c2eece406a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:57.308401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efa1bf4b-dd9c-4a11-84c6-b5c2eece406a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:57.315037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa1bf4b-dd9c-4a11-84c6-b5c2eece406a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:57.315498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa1bf4b-dd9c-4a11-84c6-b5c2eece406a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:57.316281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa1bf4b-dd9c-4a11-84c6-b5c2eece406a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:57.316828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa1bf4b-dd9c-4a11-84c6-b5c2eece406a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:57.361370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-25b2840b-0d73-4e47-aeae-be0ef4d391da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:57.369542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-25b2840b-0d73-4e47-aeae-be0ef4d391da tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153783 May 23 14:02:57.370017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1666/3408] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:57.386299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-efa1bf4b-dd9c-4a11-84c6-b5c2eece406a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:57.395053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efa1bf4b-dd9c-4a11-84c6-b5c2eece406a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091548 May 23 14:02:57.395615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1743/3409] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:57 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:58.387389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8421496c-c237-40d1-b301-10a06a868244 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:58.387976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8421496c-c237-40d1-b301-10a06a868244 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:58.394775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8421496c-c237-40d1-b301-10a06a868244 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:58.395219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8421496c-c237-40d1-b301-10a06a868244 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:58.396007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8421496c-c237-40d1-b301-10a06a868244 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:58.396436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8421496c-c237-40d1-b301-10a06a868244 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:58.413109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e3d6390-320f-463f-83bf-25f6c2e2734b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:58.413779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e3d6390-320f-463f-83bf-25f6c2e2734b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:58.420247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3d6390-320f-463f-83bf-25f6c2e2734b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:58.420737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3d6390-320f-463f-83bf-25f6c2e2734b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:58.421501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3d6390-320f-463f-83bf-25f6c2e2734b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:58.421937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3d6390-320f-463f-83bf-25f6c2e2734b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:58.485335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e3d6390-320f-463f-83bf-25f6c2e2734b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:58.493813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e3d6390-320f-463f-83bf-25f6c2e2734b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084409 May 23 14:02:58.494391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1744/3410] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:58 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:02:58.534509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8421496c-c237-40d1-b301-10a06a868244 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:58.542522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8421496c-c237-40d1-b301-10a06a868244 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159056 May 23 14:02:58.543082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1667/3411] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:58 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:59.511453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6b7d8185-ab02-4e01-960f-666c511a2be1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:59.512060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6b7d8185-ab02-4e01-960f-666c511a2be1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:59.519483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b7d8185-ab02-4e01-960f-666c511a2be1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:59.519980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b7d8185-ab02-4e01-960f-666c511a2be1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:59.520782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b7d8185-ab02-4e01-960f-666c511a2be1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:59.521234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b7d8185-ab02-4e01-960f-666c511a2be1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:59.560421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cdea77dd-fac2-4923-8ca3-512b87c829db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:02:59.561102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cdea77dd-fac2-4923-8ca3-512b87c829db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:02:59.569076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdea77dd-fac2-4923-8ca3-512b87c829db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:59.569563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdea77dd-fac2-4923-8ca3-512b87c829db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:59.570340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdea77dd-fac2-4923-8ca3-512b87c829db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:02:59.570776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdea77dd-fac2-4923-8ca3-512b87c829db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:02:59.587936 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6b7d8185-ab02-4e01-960f-666c511a2be1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:59.596346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6b7d8185-ab02-4e01-960f-666c511a2be1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088913 May 23 14:02:59.604786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1745/3412] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:59 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:02:59.705918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cdea77dd-fac2-4923-8ca3-512b87c829db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:02:59.714052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cdea77dd-fac2-4923-8ca3-512b87c829db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157494 May 23 14:02:59.714650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1668/3413] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:02:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:00.616196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-40b85c32-9ede-43a6-b64c-ecc20ac9c289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:00.622490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40b85c32-9ede-43a6-b64c-ecc20ac9c289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:00.624361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b85c32-9ede-43a6-b64c-ecc20ac9c289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:00.624861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b85c32-9ede-43a6-b64c-ecc20ac9c289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:00.626793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b85c32-9ede-43a6-b64c-ecc20ac9c289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:00.627254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40b85c32-9ede-43a6-b64c-ecc20ac9c289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:00.694799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-40b85c32-9ede-43a6-b64c-ecc20ac9c289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:00.704644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-40b85c32-9ede-43a6-b64c-ecc20ac9c289 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092261 May 23 14:03:00.705575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1746/3414] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:00 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:00.731256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eb993e94-d24e-4254-a890-a5046da21503 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:00.734370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eb993e94-d24e-4254-a890-a5046da21503 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:00.738480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb993e94-d24e-4254-a890-a5046da21503 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:00.738928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb993e94-d24e-4254-a890-a5046da21503 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:00.739734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb993e94-d24e-4254-a890-a5046da21503 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:00.740166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eb993e94-d24e-4254-a890-a5046da21503 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:00.874427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eb993e94-d24e-4254-a890-a5046da21503 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:00.883462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eb993e94-d24e-4254-a890-a5046da21503 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156109 May 23 14:03:00.884034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1669/3415] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:01.722956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-219d5a10-d559-4513-9ee1-5d61344019d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:01.723571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-219d5a10-d559-4513-9ee1-5d61344019d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:01.731155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-219d5a10-d559-4513-9ee1-5d61344019d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:01.731610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-219d5a10-d559-4513-9ee1-5d61344019d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:01.732371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-219d5a10-d559-4513-9ee1-5d61344019d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:01.732828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-219d5a10-d559-4513-9ee1-5d61344019d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:01.797977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-219d5a10-d559-4513-9ee1-5d61344019d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:01.806285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-219d5a10-d559-4513-9ee1-5d61344019d0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088264 May 23 14:03:01.806850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1747/3416] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:01 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:01.901674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b799c1d9-9d09-46a0-8eb5-3d5a33979ef6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:01.902282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b799c1d9-9d09-46a0-8eb5-3d5a33979ef6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:01.909570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b799c1d9-9d09-46a0-8eb5-3d5a33979ef6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:01.910016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b799c1d9-9d09-46a0-8eb5-3d5a33979ef6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:01.910771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b799c1d9-9d09-46a0-8eb5-3d5a33979ef6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:01.911207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b799c1d9-9d09-46a0-8eb5-3d5a33979ef6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:02.041097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b799c1d9-9d09-46a0-8eb5-3d5a33979ef6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:02.049216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b799c1d9-9d09-46a0-8eb5-3d5a33979ef6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151560 May 23 14:03:02.049776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1670/3417] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:02.823141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5c39a15f-18c9-4e29-bc86-5f79d4595a69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:02.823749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5c39a15f-18c9-4e29-bc86-5f79d4595a69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:02.830287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c39a15f-18c9-4e29-bc86-5f79d4595a69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:02.830743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c39a15f-18c9-4e29-bc86-5f79d4595a69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:02.831496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c39a15f-18c9-4e29-bc86-5f79d4595a69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:02.831931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c39a15f-18c9-4e29-bc86-5f79d4595a69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:02.892961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5c39a15f-18c9-4e29-bc86-5f79d4595a69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:02.901123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5c39a15f-18c9-4e29-bc86-5f79d4595a69 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.081850 May 23 14:03:02.901691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1748/3418] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:02 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:03.066553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-17aee1fc-e8f9-47fc-ab99-90be61d0e89c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:03.067216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-17aee1fc-e8f9-47fc-ab99-90be61d0e89c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:03.081956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17aee1fc-e8f9-47fc-ab99-90be61d0e89c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:03.081956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17aee1fc-e8f9-47fc-ab99-90be61d0e89c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:03.081956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17aee1fc-e8f9-47fc-ab99-90be61d0e89c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:03.081956 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17aee1fc-e8f9-47fc-ab99-90be61d0e89c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:03.206487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-17aee1fc-e8f9-47fc-ab99-90be61d0e89c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:03.214385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-17aee1fc-e8f9-47fc-ab99-90be61d0e89c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151787 May 23 14:03:03.214947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1671/3419] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:03.919019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39741f98-db56-48f8-a8a7-abbcce06a8be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:03.919648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39741f98-db56-48f8-a8a7-abbcce06a8be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:03.921926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:03.927957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39741f98-db56-48f8-a8a7-abbcce06a8be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:03.928411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39741f98-db56-48f8-a8a7-abbcce06a8be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:03.929206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39741f98-db56-48f8-a8a7-abbcce06a8be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:03.929650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39741f98-db56-48f8-a8a7-abbcce06a8be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:03.997834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39741f98-db56-48f8-a8a7-abbcce06a8be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:04.007473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39741f98-db56-48f8-a8a7-abbcce06a8be tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092276 May 23 14:03:04.008051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1749/3420] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:03 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:04.231490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-69f3df43-2bea-40e1-8f2f-5acf985ab178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:04.232090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-69f3df43-2bea-40e1-8f2f-5acf985ab178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:04.239298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69f3df43-2bea-40e1-8f2f-5acf985ab178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:04.239739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69f3df43-2bea-40e1-8f2f-5acf985ab178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:04.240486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69f3df43-2bea-40e1-8f2f-5acf985ab178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:04.240941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69f3df43-2bea-40e1-8f2f-5acf985ab178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:04.372378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-69f3df43-2bea-40e1-8f2f-5acf985ab178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:04.380293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-69f3df43-2bea-40e1-8f2f-5acf985ab178 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152661 May 23 14:03:04.380882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1672/3421] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:05.025063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d13bef1-592b-4d67-8ffa-852614d8ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:05.025810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d13bef1-592b-4d67-8ffa-852614d8ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:05.032846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d13bef1-592b-4d67-8ffa-852614d8ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:05.033300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d13bef1-592b-4d67-8ffa-852614d8ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:05.034067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d13bef1-592b-4d67-8ffa-852614d8ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:05.034500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d13bef1-592b-4d67-8ffa-852614d8ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:05.052767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:05.097178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7d13bef1-592b-4d67-8ffa-852614d8ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:05.107425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d13bef1-592b-4d67-8ffa-852614d8ab67 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085972 May 23 14:03:05.110205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1750/3422] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:05 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:05.397865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-62f07bef-e3a0-464d-a6df-339e21e53db2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:05.398482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-62f07bef-e3a0-464d-a6df-339e21e53db2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:05.400907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=54 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:05.405653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62f07bef-e3a0-464d-a6df-339e21e53db2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:05.406106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62f07bef-e3a0-464d-a6df-339e21e53db2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:05.406876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62f07bef-e3a0-464d-a6df-339e21e53db2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:05.408267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62f07bef-e3a0-464d-a6df-339e21e53db2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:05.548482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-62f07bef-e3a0-464d-a6df-339e21e53db2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:05.557223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-62f07bef-e3a0-464d-a6df-339e21e53db2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.163321 May 23 14:03:05.557786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1673/3423] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:06.125266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-733db114-0616-480b-85bc-2855fbd0b35e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:06.125923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-733db114-0616-480b-85bc-2855fbd0b35e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:06.134011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-733db114-0616-480b-85bc-2855fbd0b35e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:06.134472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-733db114-0616-480b-85bc-2855fbd0b35e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:06.135247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-733db114-0616-480b-85bc-2855fbd0b35e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:06.135692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-733db114-0616-480b-85bc-2855fbd0b35e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:06.204613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-733db114-0616-480b-85bc-2855fbd0b35e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:06.213089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-733db114-0616-480b-85bc-2855fbd0b35e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091702 May 23 14:03:06.213662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1751/3424] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:06 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:06.574810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2a9124fd-a947-41a5-b946-1df235d11fc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:06.575421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2a9124fd-a947-41a5-b946-1df235d11fc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:06.582678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2a9124fd-a947-41a5-b946-1df235d11fc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:06.583133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2a9124fd-a947-41a5-b946-1df235d11fc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:06.583891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2a9124fd-a947-41a5-b946-1df235d11fc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:06.584321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2a9124fd-a947-41a5-b946-1df235d11fc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:06.588425 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:06.729686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2a9124fd-a947-41a5-b946-1df235d11fc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:06.737837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2a9124fd-a947-41a5-b946-1df235d11fc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166902 May 23 14:03:06.738409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1674/3425] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:07.230259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b099c524-98ae-4ba2-8f93-1153714a712e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:07.230850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b099c524-98ae-4ba2-8f93-1153714a712e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:07.238830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b099c524-98ae-4ba2-8f93-1153714a712e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:07.239291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b099c524-98ae-4ba2-8f93-1153714a712e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:07.240071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b099c524-98ae-4ba2-8f93-1153714a712e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:07.240546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b099c524-98ae-4ba2-8f93-1153714a712e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:07.305006 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b099c524-98ae-4ba2-8f93-1153714a712e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:07.313019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b099c524-98ae-4ba2-8f93-1153714a712e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086617 May 23 14:03:07.314165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1752/3426] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:07 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:07.755230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b7764be4-fa53-4fd2-bef2-5c8e4f51500d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:07.755834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b7764be4-fa53-4fd2-bef2-5c8e4f51500d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:07.762512 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7764be4-fa53-4fd2-bef2-5c8e4f51500d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:07.762968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7764be4-fa53-4fd2-bef2-5c8e4f51500d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:07.763730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7764be4-fa53-4fd2-bef2-5c8e4f51500d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:07.764173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7764be4-fa53-4fd2-bef2-5c8e4f51500d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:07.895330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7764be4-fa53-4fd2-bef2-5c8e4f51500d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:07.903397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b7764be4-fa53-4fd2-bef2-5c8e4f51500d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152527 May 23 14:03:07.903959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1675/3427] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:08.334680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1415ac03-fe1d-4aa1-b894-04e88c8a064f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:08.334680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1415ac03-fe1d-4aa1-b894-04e88c8a064f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:08.341247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1415ac03-fe1d-4aa1-b894-04e88c8a064f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:08.341689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1415ac03-fe1d-4aa1-b894-04e88c8a064f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:08.342452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1415ac03-fe1d-4aa1-b894-04e88c8a064f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:08.342893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1415ac03-fe1d-4aa1-b894-04e88c8a064f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:08.405591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1415ac03-fe1d-4aa1-b894-04e88c8a064f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:08.413988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1415ac03-fe1d-4aa1-b894-04e88c8a064f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087730 May 23 14:03:08.414561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1753/3428] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:08 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:08.921277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a536708d-333f-4c79-a7df-02a074fbb7f6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:08.921837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a536708d-333f-4c79-a7df-02a074fbb7f6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:08.929262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a536708d-333f-4c79-a7df-02a074fbb7f6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:08.929707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a536708d-333f-4c79-a7df-02a074fbb7f6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:08.930456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a536708d-333f-4c79-a7df-02a074fbb7f6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:08.930883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a536708d-333f-4c79-a7df-02a074fbb7f6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:09.059977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a536708d-333f-4c79-a7df-02a074fbb7f6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:09.068586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a536708d-333f-4c79-a7df-02a074fbb7f6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151185 May 23 14:03:09.069167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1676/3429] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:09.431979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-40288e19-f274-47c7-ac5f-b1942110fa26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:09.432633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40288e19-f274-47c7-ac5f-b1942110fa26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:09.439485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40288e19-f274-47c7-ac5f-b1942110fa26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:09.439867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40288e19-f274-47c7-ac5f-b1942110fa26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:09.440742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40288e19-f274-47c7-ac5f-b1942110fa26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:09.441189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40288e19-f274-47c7-ac5f-b1942110fa26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:09.505434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-40288e19-f274-47c7-ac5f-b1942110fa26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:09.513469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-40288e19-f274-47c7-ac5f-b1942110fa26 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085399 May 23 14:03:09.514042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1754/3430] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:09 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:10.085917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3a79d6a-c0ef-4a6d-b942-af336e1fd209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:10.086522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3a79d6a-c0ef-4a6d-b942-af336e1fd209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:10.093580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3a79d6a-c0ef-4a6d-b942-af336e1fd209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:10.094033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3a79d6a-c0ef-4a6d-b942-af336e1fd209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:10.095011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3a79d6a-c0ef-4a6d-b942-af336e1fd209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:10.095499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3a79d6a-c0ef-4a6d-b942-af336e1fd209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:10.229655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3a79d6a-c0ef-4a6d-b942-af336e1fd209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:10.238445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3a79d6a-c0ef-4a6d-b942-af336e1fd209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156457 May 23 14:03:10.239020 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1677/3431] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:10.531591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e28a626-8f9b-4ee0-98d6-35fd29f39d4b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:10.532822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e28a626-8f9b-4ee0-98d6-35fd29f39d4b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:10.539535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e28a626-8f9b-4ee0-98d6-35fd29f39d4b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:10.539986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e28a626-8f9b-4ee0-98d6-35fd29f39d4b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:10.540795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e28a626-8f9b-4ee0-98d6-35fd29f39d4b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:10.541234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e28a626-8f9b-4ee0-98d6-35fd29f39d4b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:10.607044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e28a626-8f9b-4ee0-98d6-35fd29f39d4b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:10.616378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e28a626-8f9b-4ee0-98d6-35fd29f39d4b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089065 May 23 14:03:10.617003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1755/3432] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:10 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:11.256306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-12169855-cdf4-4f31-b6a2-f5a0a059be15 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:11.256943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-12169855-cdf4-4f31-b6a2-f5a0a059be15 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:11.264019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12169855-cdf4-4f31-b6a2-f5a0a059be15 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:11.264471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12169855-cdf4-4f31-b6a2-f5a0a059be15 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:11.265323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12169855-cdf4-4f31-b6a2-f5a0a059be15 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:11.265769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12169855-cdf4-4f31-b6a2-f5a0a059be15 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:11.397196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-12169855-cdf4-4f31-b6a2-f5a0a059be15 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:11.405315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-12169855-cdf4-4f31-b6a2-f5a0a059be15 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152902 May 23 14:03:11.405892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1678/3433] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:11.633616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-190459b2-43b7-4631-bc5f-00470b595f91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:11.634251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-190459b2-43b7-4631-bc5f-00470b595f91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:11.641120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-190459b2-43b7-4631-bc5f-00470b595f91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:11.642033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-190459b2-43b7-4631-bc5f-00470b595f91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:11.642347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-190459b2-43b7-4631-bc5f-00470b595f91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:11.642780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-190459b2-43b7-4631-bc5f-00470b595f91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:11.706690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-190459b2-43b7-4631-bc5f-00470b595f91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:11.715272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-190459b2-43b7-4631-bc5f-00470b595f91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085527 May 23 14:03:11.715853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1756/3434] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:11 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:12.422572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-33a39035-5cf5-4fef-91e7-2f6e964bf5af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:12.423226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-33a39035-5cf5-4fef-91e7-2f6e964bf5af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:12.429870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33a39035-5cf5-4fef-91e7-2f6e964bf5af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:12.430313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33a39035-5cf5-4fef-91e7-2f6e964bf5af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:12.431061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33a39035-5cf5-4fef-91e7-2f6e964bf5af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:12.431489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-33a39035-5cf5-4fef-91e7-2f6e964bf5af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:12.568133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-33a39035-5cf5-4fef-91e7-2f6e964bf5af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:12.576017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-33a39035-5cf5-4fef-91e7-2f6e964bf5af tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157377 May 23 14:03:12.576590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1679/3435] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:12.733259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f12d6599-bef2-4dcf-985c-8e32a95e5e5a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:12.733813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f12d6599-bef2-4dcf-985c-8e32a95e5e5a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:12.740338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f12d6599-bef2-4dcf-985c-8e32a95e5e5a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:12.740826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f12d6599-bef2-4dcf-985c-8e32a95e5e5a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:12.741591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f12d6599-bef2-4dcf-985c-8e32a95e5e5a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:12.742031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f12d6599-bef2-4dcf-985c-8e32a95e5e5a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:12.803815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f12d6599-bef2-4dcf-985c-8e32a95e5e5a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:12.811718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f12d6599-bef2-4dcf-985c-8e32a95e5e5a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.082428 May 23 14:03:12.812273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1757/3436] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:12 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:13.593649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-91fca17f-1cf7-4454-b8fa-414054b7e880 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:13.594333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-91fca17f-1cf7-4454-b8fa-414054b7e880 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:13.601977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91fca17f-1cf7-4454-b8fa-414054b7e880 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:13.602433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91fca17f-1cf7-4454-b8fa-414054b7e880 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:13.603214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91fca17f-1cf7-4454-b8fa-414054b7e880 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:13.603651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91fca17f-1cf7-4454-b8fa-414054b7e880 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:13.737209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-91fca17f-1cf7-4454-b8fa-414054b7e880 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:13.745173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-91fca17f-1cf7-4454-b8fa-414054b7e880 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155564 May 23 14:03:13.745739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1680/3437] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:13.830908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ea46c6c-9de0-4154-94a2-dfa48eee05b6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:13.831518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ea46c6c-9de0-4154-94a2-dfa48eee05b6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:13.838004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ea46c6c-9de0-4154-94a2-dfa48eee05b6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:13.838455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ea46c6c-9de0-4154-94a2-dfa48eee05b6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:13.839211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ea46c6c-9de0-4154-94a2-dfa48eee05b6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:13.839643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ea46c6c-9de0-4154-94a2-dfa48eee05b6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:13.903548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ea46c6c-9de0-4154-94a2-dfa48eee05b6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:13.912413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ea46c6c-9de0-4154-94a2-dfa48eee05b6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086163 May 23 14:03:13.913009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1758/3438] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:13 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:14.762363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d6fa1f2-7a1b-4f7c-a287-7fd2a785abbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:14.762997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d6fa1f2-7a1b-4f7c-a287-7fd2a785abbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:14.769872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d6fa1f2-7a1b-4f7c-a287-7fd2a785abbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:14.770317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d6fa1f2-7a1b-4f7c-a287-7fd2a785abbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:14.771073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d6fa1f2-7a1b-4f7c-a287-7fd2a785abbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:14.771509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d6fa1f2-7a1b-4f7c-a287-7fd2a785abbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:14.903023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d6fa1f2-7a1b-4f7c-a287-7fd2a785abbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:14.911280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d6fa1f2-7a1b-4f7c-a287-7fd2a785abbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152778 May 23 14:03:14.911879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1681/3439] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:14.929785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-db066b3d-0492-4bb8-85e1-791c073183a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:14.930430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-db066b3d-0492-4bb8-85e1-791c073183a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:14.937146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db066b3d-0492-4bb8-85e1-791c073183a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:14.937598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db066b3d-0492-4bb8-85e1-791c073183a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:14.939018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db066b3d-0492-4bb8-85e1-791c073183a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:14.939537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db066b3d-0492-4bb8-85e1-791c073183a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:15.005921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-db066b3d-0492-4bb8-85e1-791c073183a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:15.013923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-db066b3d-0492-4bb8-85e1-791c073183a6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088331 May 23 14:03:15.014430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1759/3440] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:14 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:15.928752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fc0907c3-6425-42fe-9644-1cf4a54f3ed0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:15.929368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fc0907c3-6425-42fe-9644-1cf4a54f3ed0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:15.936395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc0907c3-6425-42fe-9644-1cf4a54f3ed0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:15.936879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc0907c3-6425-42fe-9644-1cf4a54f3ed0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:15.937644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc0907c3-6425-42fe-9644-1cf4a54f3ed0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:15.938083 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fc0907c3-6425-42fe-9644-1cf4a54f3ed0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:16.031410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-84674273-dc29-4416-948f-458585179189 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:16.032265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-84674273-dc29-4416-948f-458585179189 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:16.039536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84674273-dc29-4416-948f-458585179189 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:16.039992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84674273-dc29-4416-948f-458585179189 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:16.040817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84674273-dc29-4416-948f-458585179189 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:16.041260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84674273-dc29-4416-948f-458585179189 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:16.074644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fc0907c3-6425-42fe-9644-1cf4a54f3ed0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:16.081863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fc0907c3-6425-42fe-9644-1cf4a54f3ed0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157224 May 23 14:03:16.082449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1682/3441] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:16.108943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84674273-dc29-4416-948f-458585179189 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:16.115715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-84674273-dc29-4416-948f-458585179189 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088254 May 23 14:03:16.116280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1760/3442] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:16 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:17.099045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-67d635e1-3826-4269-9eda-93aa2350c854 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:17.099628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-67d635e1-3826-4269-9eda-93aa2350c854 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:17.106128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67d635e1-3826-4269-9eda-93aa2350c854 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:17.106582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67d635e1-3826-4269-9eda-93aa2350c854 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:17.109622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67d635e1-3826-4269-9eda-93aa2350c854 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:17.109622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67d635e1-3826-4269-9eda-93aa2350c854 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:17.133408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c8e2aa78-8575-429b-829b-e041199731e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:17.134019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c8e2aa78-8575-429b-829b-e041199731e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:17.141038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8e2aa78-8575-429b-829b-e041199731e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:17.141498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8e2aa78-8575-429b-829b-e041199731e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:17.142542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8e2aa78-8575-429b-829b-e041199731e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:17.143009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8e2aa78-8575-429b-829b-e041199731e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:17.209826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8e2aa78-8575-429b-829b-e041199731e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:17.218094 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c8e2aa78-8575-429b-829b-e041199731e7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088557 May 23 14:03:17.218677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1761/3443] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:17 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:17.239577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-67d635e1-3826-4269-9eda-93aa2350c854 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:17.247481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-67d635e1-3826-4269-9eda-93aa2350c854 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153045 May 23 14:03:17.248041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1683/3444] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:18.235452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-674449ad-5f02-481c-9578-5d896133eff1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:18.236045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-674449ad-5f02-481c-9578-5d896133eff1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:18.243183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-674449ad-5f02-481c-9578-5d896133eff1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:18.243641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-674449ad-5f02-481c-9578-5d896133eff1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:18.244402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-674449ad-5f02-481c-9578-5d896133eff1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:18.244869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-674449ad-5f02-481c-9578-5d896133eff1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:18.269497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-11f84c10-9011-4c49-bccb-ee2fe2ee0e4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:18.270116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-11f84c10-9011-4c49-bccb-ee2fe2ee0e4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:18.276917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11f84c10-9011-4c49-bccb-ee2fe2ee0e4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:18.277304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11f84c10-9011-4c49-bccb-ee2fe2ee0e4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:18.278073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11f84c10-9011-4c49-bccb-ee2fe2ee0e4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:18.278509 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-11f84c10-9011-4c49-bccb-ee2fe2ee0e4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:18.306763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-674449ad-5f02-481c-9578-5d896133eff1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:18.315567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-674449ad-5f02-481c-9578-5d896133eff1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083911 May 23 14:03:18.316612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1762/3445] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:18 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:18.419480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-11f84c10-9011-4c49-bccb-ee2fe2ee0e4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:18.428228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-11f84c10-9011-4c49-bccb-ee2fe2ee0e4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.162627 May 23 14:03:18.428828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1684/3446] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:19.332923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-418dabad-3a96-4bbf-84e0-564fd84337ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:19.333561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-418dabad-3a96-4bbf-84e0-564fd84337ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:19.339970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-418dabad-3a96-4bbf-84e0-564fd84337ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:19.340397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-418dabad-3a96-4bbf-84e0-564fd84337ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:19.341194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-418dabad-3a96-4bbf-84e0-564fd84337ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:19.341666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-418dabad-3a96-4bbf-84e0-564fd84337ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:19.405999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-418dabad-3a96-4bbf-84e0-564fd84337ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:19.414488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-418dabad-3a96-4bbf-84e0-564fd84337ac tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085610 May 23 14:03:19.415056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1763/3447] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:19 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:19.445286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-43033795-33b7-415f-b81f-446ca28d96e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:19.445870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-43033795-33b7-415f-b81f-446ca28d96e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:19.456452 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43033795-33b7-415f-b81f-446ca28d96e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:19.460398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43033795-33b7-415f-b81f-446ca28d96e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:19.460398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43033795-33b7-415f-b81f-446ca28d96e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:19.460398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43033795-33b7-415f-b81f-446ca28d96e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:19.592008 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43033795-33b7-415f-b81f-446ca28d96e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:19.601301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-43033795-33b7-415f-b81f-446ca28d96e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159958 May 23 14:03:19.601890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1685/3448] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:20.431255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2cd94af-74f9-4a4f-bc0d-9576d0c4a2cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:20.431954 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f2cd94af-74f9-4a4f-bc0d-9576d0c4a2cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:20.449786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2cd94af-74f9-4a4f-bc0d-9576d0c4a2cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:20.450249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2cd94af-74f9-4a4f-bc0d-9576d0c4a2cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:20.451050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2cd94af-74f9-4a4f-bc0d-9576d0c4a2cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:20.451497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2cd94af-74f9-4a4f-bc0d-9576d0c4a2cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:20.527109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f2cd94af-74f9-4a4f-bc0d-9576d0c4a2cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:20.536254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2cd94af-74f9-4a4f-bc0d-9576d0c4a2cb tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.109160 May 23 14:03:20.536864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1764/3449] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:20 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:20.618929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e50fe904-44e9-4c60-8e6f-45230befc9dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:20.624145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e50fe904-44e9-4c60-8e6f-45230befc9dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:20.626145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e50fe904-44e9-4c60-8e6f-45230befc9dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:20.626606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e50fe904-44e9-4c60-8e6f-45230befc9dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:20.628016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e50fe904-44e9-4c60-8e6f-45230befc9dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:20.628695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e50fe904-44e9-4c60-8e6f-45230befc9dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:20.766967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e50fe904-44e9-4c60-8e6f-45230befc9dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:20.775211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e50fe904-44e9-4c60-8e6f-45230befc9dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160165 May 23 14:03:20.776594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1686/3450] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:21.554661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d3e9f236-8af4-411c-a28b-0ffc1f8e15e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:21.555311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d3e9f236-8af4-411c-a28b-0ffc1f8e15e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:21.561801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3e9f236-8af4-411c-a28b-0ffc1f8e15e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:21.562256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3e9f236-8af4-411c-a28b-0ffc1f8e15e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:21.563032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3e9f236-8af4-411c-a28b-0ffc1f8e15e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:21.563482 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3e9f236-8af4-411c-a28b-0ffc1f8e15e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:21.625729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d3e9f236-8af4-411c-a28b-0ffc1f8e15e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:21.634216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d3e9f236-8af4-411c-a28b-0ffc1f8e15e4 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.083819 May 23 14:03:21.634776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1765/3451] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:21 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:21.798621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-23c7e73d-11f9-461d-a8ac-2d37b55c33bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:21.799855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-23c7e73d-11f9-461d-a8ac-2d37b55c33bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:21.806775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23c7e73d-11f9-461d-a8ac-2d37b55c33bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:21.807160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23c7e73d-11f9-461d-a8ac-2d37b55c33bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:21.808004 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23c7e73d-11f9-461d-a8ac-2d37b55c33bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:21.808439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-23c7e73d-11f9-461d-a8ac-2d37b55c33bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:21.937499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-23c7e73d-11f9-461d-a8ac-2d37b55c33bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:21.945816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-23c7e73d-11f9-461d-a8ac-2d37b55c33bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151058 May 23 14:03:21.946378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1687/3452] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:22.652210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-962fcd1b-eb0b-4c4a-9fe6-eabcce6f7cc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:22.652831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-962fcd1b-eb0b-4c4a-9fe6-eabcce6f7cc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:22.659802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962fcd1b-eb0b-4c4a-9fe6-eabcce6f7cc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:22.660256 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962fcd1b-eb0b-4c4a-9fe6-eabcce6f7cc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:22.661069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962fcd1b-eb0b-4c4a-9fe6-eabcce6f7cc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:22.661510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-962fcd1b-eb0b-4c4a-9fe6-eabcce6f7cc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:22.726011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-962fcd1b-eb0b-4c4a-9fe6-eabcce6f7cc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:22.734174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-962fcd1b-eb0b-4c4a-9fe6-eabcce6f7cc0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085815 May 23 14:03:22.734762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1766/3453] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:22 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:22.964317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6027520-b989-48d2-b6ef-2c344041d6d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:22.964918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6027520-b989-48d2-b6ef-2c344041d6d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:22.971718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6027520-b989-48d2-b6ef-2c344041d6d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:22.972218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6027520-b989-48d2-b6ef-2c344041d6d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:22.973024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6027520-b989-48d2-b6ef-2c344041d6d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:22.973467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6027520-b989-48d2-b6ef-2c344041d6d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:23.107483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6027520-b989-48d2-b6ef-2c344041d6d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:23.116225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6027520-b989-48d2-b6ef-2c344041d6d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155772 May 23 14:03:23.116849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1688/3454] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:23.756285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-81fd8009-8866-4862-a556-8c29012bc17b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:23.756950 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-81fd8009-8866-4862-a556-8c29012bc17b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:23.763816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81fd8009-8866-4862-a556-8c29012bc17b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:23.764274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81fd8009-8866-4862-a556-8c29012bc17b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:23.765087 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81fd8009-8866-4862-a556-8c29012bc17b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:23.765534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81fd8009-8866-4862-a556-8c29012bc17b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:23.771134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:23.841931 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-81fd8009-8866-4862-a556-8c29012bc17b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:23.854123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-81fd8009-8866-4862-a556-8c29012bc17b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.102113 May 23 14:03:23.855160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1767/3455] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:23 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:24.137584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f3d388d-2a58-43e2-a25b-4f15ea96ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:24.138193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f3d388d-2a58-43e2-a25b-4f15ea96ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:24.145622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f3d388d-2a58-43e2-a25b-4f15ea96ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:24.146070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f3d388d-2a58-43e2-a25b-4f15ea96ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:24.146978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f3d388d-2a58-43e2-a25b-4f15ea96ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:24.147405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f3d388d-2a58-43e2-a25b-4f15ea96ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:24.297356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f3d388d-2a58-43e2-a25b-4f15ea96ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:24.306315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f3d388d-2a58-43e2-a25b-4f15ea96ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.176074 May 23 14:03:24.307951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1689/3456] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:24.874272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2302dc72-dda4-4916-bdd2-0d32eed71a16 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:24.874893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2302dc72-dda4-4916-bdd2-0d32eed71a16 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:24.882168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2302dc72-dda4-4916-bdd2-0d32eed71a16 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:24.882619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2302dc72-dda4-4916-bdd2-0d32eed71a16 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:24.883384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2302dc72-dda4-4916-bdd2-0d32eed71a16 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:24.883818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2302dc72-dda4-4916-bdd2-0d32eed71a16 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:24.947514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2302dc72-dda4-4916-bdd2-0d32eed71a16 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:24.959224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2302dc72-dda4-4916-bdd2-0d32eed71a16 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088200 May 23 14:03:24.960429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1768/3457] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:24 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:25.324286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b207e7f-6eca-4ec2-aaae-96f6695a8db8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:25.324952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b207e7f-6eca-4ec2-aaae-96f6695a8db8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:25.332033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b207e7f-6eca-4ec2-aaae-96f6695a8db8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:25.332491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b207e7f-6eca-4ec2-aaae-96f6695a8db8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:25.333306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b207e7f-6eca-4ec2-aaae-96f6695a8db8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:25.333749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b207e7f-6eca-4ec2-aaae-96f6695a8db8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:25.470917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4b207e7f-6eca-4ec2-aaae-96f6695a8db8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:25.474929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:25.479779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b207e7f-6eca-4ec2-aaae-96f6695a8db8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159446 May 23 14:03:25.480357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1690/3458] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:25.979464 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-439d18c9-d7be-4660-8fda-4b4354d6ed45 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:25.980091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-439d18c9-d7be-4660-8fda-4b4354d6ed45 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:25.987796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-439d18c9-d7be-4660-8fda-4b4354d6ed45 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:25.988451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-439d18c9-d7be-4660-8fda-4b4354d6ed45 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:25.989282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-439d18c9-d7be-4660-8fda-4b4354d6ed45 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:25.989718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-439d18c9-d7be-4660-8fda-4b4354d6ed45 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:26.067035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-439d18c9-d7be-4660-8fda-4b4354d6ed45 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:26.075128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-439d18c9-d7be-4660-8fda-4b4354d6ed45 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.101991 May 23 14:03:26.075688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1769/3459] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:25 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:26.496141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-940477b6-5e1e-4dc8-9da6-590d03b0fb60 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:26.496785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-940477b6-5e1e-4dc8-9da6-590d03b0fb60 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:26.504670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-940477b6-5e1e-4dc8-9da6-590d03b0fb60 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:26.505127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-940477b6-5e1e-4dc8-9da6-590d03b0fb60 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:26.505984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-940477b6-5e1e-4dc8-9da6-590d03b0fb60 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:26.506430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-940477b6-5e1e-4dc8-9da6-590d03b0fb60 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:26.653043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-940477b6-5e1e-4dc8-9da6-590d03b0fb60 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:26.653043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-940477b6-5e1e-4dc8-9da6-590d03b0fb60 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160387 May 23 14:03:26.653443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1691/3460] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:27.093207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f827e30-4257-44d2-ad31-535d663075b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:27.093923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f827e30-4257-44d2-ad31-535d663075b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:27.101231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f827e30-4257-44d2-ad31-535d663075b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:27.101720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f827e30-4257-44d2-ad31-535d663075b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:27.102499 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f827e30-4257-44d2-ad31-535d663075b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:27.102935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f827e30-4257-44d2-ad31-535d663075b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:27.168136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f827e30-4257-44d2-ad31-535d663075b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:27.177070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f827e30-4257-44d2-ad31-535d663075b1 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087792 May 23 14:03:27.178717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1770/3461] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:27 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:27.670637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-48c5265e-22b4-4795-9c7d-fe8b1df8e2b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:27.671240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-48c5265e-22b4-4795-9c7d-fe8b1df8e2b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:27.678652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48c5265e-22b4-4795-9c7d-fe8b1df8e2b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:27.679100 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48c5265e-22b4-4795-9c7d-fe8b1df8e2b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:27.679859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48c5265e-22b4-4795-9c7d-fe8b1df8e2b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:27.680298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48c5265e-22b4-4795-9c7d-fe8b1df8e2b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:27.808182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-48c5265e-22b4-4795-9c7d-fe8b1df8e2b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:27.816973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-48c5265e-22b4-4795-9c7d-fe8b1df8e2b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.150154 May 23 14:03:27.817549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1692/3462] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:28.194809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a3f1055-780c-4c00-92c6-63fa194aee82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:28.195418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a3f1055-780c-4c00-92c6-63fa194aee82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:28.201809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a3f1055-780c-4c00-92c6-63fa194aee82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:28.202257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a3f1055-780c-4c00-92c6-63fa194aee82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:28.203010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a3f1055-780c-4c00-92c6-63fa194aee82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:28.203440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a3f1055-780c-4c00-92c6-63fa194aee82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:28.269521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a3f1055-780c-4c00-92c6-63fa194aee82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:28.277534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a3f1055-780c-4c00-92c6-63fa194aee82 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086534 May 23 14:03:28.278032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1771/3463] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:28 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:28.834721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cba9031a-334e-4262-8b30-0ec81555b435 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:28.835332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cba9031a-334e-4262-8b30-0ec81555b435 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:28.842075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba9031a-334e-4262-8b30-0ec81555b435 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:28.842524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba9031a-334e-4262-8b30-0ec81555b435 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:28.843293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba9031a-334e-4262-8b30-0ec81555b435 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:28.843730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cba9031a-334e-4262-8b30-0ec81555b435 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:28.984198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cba9031a-334e-4262-8b30-0ec81555b435 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:28.995400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cba9031a-334e-4262-8b30-0ec81555b435 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165108 May 23 14:03:28.996003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1693/3464] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:29.295289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-521094ef-71e3-425b-9793-f3c60d6d6457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:29.296005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-521094ef-71e3-425b-9793-f3c60d6d6457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:29.303799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-521094ef-71e3-425b-9793-f3c60d6d6457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:29.304255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-521094ef-71e3-425b-9793-f3c60d6d6457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:29.305063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-521094ef-71e3-425b-9793-f3c60d6d6457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:29.306018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-521094ef-71e3-425b-9793-f3c60d6d6457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:29.369547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-521094ef-71e3-425b-9793-f3c60d6d6457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:29.377523 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-521094ef-71e3-425b-9793-f3c60d6d6457 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086236 May 23 14:03:29.378734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1772/3465] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:29 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:30.013063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-431c756d-aec6-46cb-95f4-de278f1ae9a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:30.013713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-431c756d-aec6-46cb-95f4-de278f1ae9a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:30.020682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-431c756d-aec6-46cb-95f4-de278f1ae9a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:30.021140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-431c756d-aec6-46cb-95f4-de278f1ae9a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:30.021906 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-431c756d-aec6-46cb-95f4-de278f1ae9a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:30.022338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-431c756d-aec6-46cb-95f4-de278f1ae9a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:30.395367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f339fb41-0630-4da3-9075-2ab7d2285fa0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:30.395984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f339fb41-0630-4da3-9075-2ab7d2285fa0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:30.402533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f339fb41-0630-4da3-9075-2ab7d2285fa0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:30.402988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f339fb41-0630-4da3-9075-2ab7d2285fa0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:30.403763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f339fb41-0630-4da3-9075-2ab7d2285fa0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:30.404209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f339fb41-0630-4da3-9075-2ab7d2285fa0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:30.404374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-431c756d-aec6-46cb-95f4-de278f1ae9a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:30.413834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-431c756d-aec6-46cb-95f4-de278f1ae9a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.404746 May 23 14:03:30.420636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1694/3466] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:30.472132 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f339fb41-0630-4da3-9075-2ab7d2285fa0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:30.486941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f339fb41-0630-4da3-9075-2ab7d2285fa0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.095094 May 23 14:03:30.488588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1773/3467] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:30 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:31.434034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-109d9a26-1a6b-4831-bfb2-b6da5660b559 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:31.434646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-109d9a26-1a6b-4831-bfb2-b6da5660b559 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:31.441599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-109d9a26-1a6b-4831-bfb2-b6da5660b559 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:31.442049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-109d9a26-1a6b-4831-bfb2-b6da5660b559 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:31.442808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-109d9a26-1a6b-4831-bfb2-b6da5660b559 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:31.443237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-109d9a26-1a6b-4831-bfb2-b6da5660b559 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:31.512357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61958fe8-9d83-42ab-998f-262cab273410 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:31.513073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-61958fe8-9d83-42ab-998f-262cab273410 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:31.520418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61958fe8-9d83-42ab-998f-262cab273410 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:31.521019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61958fe8-9d83-42ab-998f-262cab273410 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:31.521803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61958fe8-9d83-42ab-998f-262cab273410 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:31.522243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61958fe8-9d83-42ab-998f-262cab273410 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:31.585975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-61958fe8-9d83-42ab-998f-262cab273410 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:31.586144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-109d9a26-1a6b-4831-bfb2-b6da5660b559 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:31.594158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-61958fe8-9d83-42ab-998f-262cab273410 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085864 May 23 14:03:31.594391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-109d9a26-1a6b-4831-bfb2-b6da5660b559 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164072 May 23 14:03:31.594961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1774/3468] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:31 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:31.595099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1695/3469] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:32.611861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2bb2d380-4b9c-4980-9a0d-00a5d5b6c5ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:32.612528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2bb2d380-4b9c-4980-9a0d-00a5d5b6c5ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:32.616391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-733d3206-21ed-4d5e-b730-f4932e1f9aae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:32.617437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-733d3206-21ed-4d5e-b730-f4932e1f9aae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:32.620297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bb2d380-4b9c-4980-9a0d-00a5d5b6c5ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:32.620924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bb2d380-4b9c-4980-9a0d-00a5d5b6c5ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:32.621699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bb2d380-4b9c-4980-9a0d-00a5d5b6c5ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:32.622136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bb2d380-4b9c-4980-9a0d-00a5d5b6c5ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:32.627282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-733d3206-21ed-4d5e-b730-f4932e1f9aae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:32.627735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-733d3206-21ed-4d5e-b730-f4932e1f9aae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:32.629750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-733d3206-21ed-4d5e-b730-f4932e1f9aae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:32.630203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-733d3206-21ed-4d5e-b730-f4932e1f9aae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:32.696515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-733d3206-21ed-4d5e-b730-f4932e1f9aae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:32.704681 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-733d3206-21ed-4d5e-b730-f4932e1f9aae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.095939 May 23 14:03:32.705394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1696/3470] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:32 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:32.761662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2bb2d380-4b9c-4980-9a0d-00a5d5b6c5ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:32.771035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2bb2d380-4b9c-4980-9a0d-00a5d5b6c5ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.163009 May 23 14:03:32.771618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1775/3471] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:32 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:33.722013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d724c5b0-c7dc-40b3-b505-21e718f39848 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:33.723259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d724c5b0-c7dc-40b3-b505-21e718f39848 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:33.730031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d724c5b0-c7dc-40b3-b505-21e718f39848 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:33.730485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d724c5b0-c7dc-40b3-b505-21e718f39848 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:33.731266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d724c5b0-c7dc-40b3-b505-21e718f39848 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:33.731711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d724c5b0-c7dc-40b3-b505-21e718f39848 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:33.788608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61ee023f-6677-4a07-81cf-abe928bc3d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:33.789311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-61ee023f-6677-4a07-81cf-abe928bc3d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:33.796091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61ee023f-6677-4a07-81cf-abe928bc3d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:33.796388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d724c5b0-c7dc-40b3-b505-21e718f39848 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:33.796728 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61ee023f-6677-4a07-81cf-abe928bc3d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:33.797542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61ee023f-6677-4a07-81cf-abe928bc3d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:33.797992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61ee023f-6677-4a07-81cf-abe928bc3d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:33.805687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d724c5b0-c7dc-40b3-b505-21e718f39848 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087598 May 23 14:03:33.806277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1697/3472] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:33 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:33.934962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-61ee023f-6677-4a07-81cf-abe928bc3d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:33.943322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-61ee023f-6677-4a07-81cf-abe928bc3d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159884 May 23 14:03:33.943902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1776/3473] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:34.823355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5948db43-e2de-49e0-af7b-d36a62e8a92f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:34.823965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5948db43-e2de-49e0-af7b-d36a62e8a92f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:34.831108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5948db43-e2de-49e0-af7b-d36a62e8a92f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:34.831606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5948db43-e2de-49e0-af7b-d36a62e8a92f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:34.832383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5948db43-e2de-49e0-af7b-d36a62e8a92f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:34.832845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5948db43-e2de-49e0-af7b-d36a62e8a92f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:34.895684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5948db43-e2de-49e0-af7b-d36a62e8a92f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:34.903753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5948db43-e2de-49e0-af7b-d36a62e8a92f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.084219 May 23 14:03:34.904321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1698/3474] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:34 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:34.960879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f8d1757-d9a0-46f5-a275-8787d327ac31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:34.961479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f8d1757-d9a0-46f5-a275-8787d327ac31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:34.968146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f8d1757-d9a0-46f5-a275-8787d327ac31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:34.972777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f8d1757-d9a0-46f5-a275-8787d327ac31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:34.972777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f8d1757-d9a0-46f5-a275-8787d327ac31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:34.972777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f8d1757-d9a0-46f5-a275-8787d327ac31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:35.127470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f8d1757-d9a0-46f5-a275-8787d327ac31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:35.136593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f8d1757-d9a0-46f5-a275-8787d327ac31 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.179940 May 23 14:03:35.137185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1777/3475] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:35.924022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13c96792-e418-4688-8a0c-68aafcc53dea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:35.925352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-13c96792-e418-4688-8a0c-68aafcc53dea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:35.931472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=52 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:35.938030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13c96792-e418-4688-8a0c-68aafcc53dea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:35.938800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13c96792-e418-4688-8a0c-68aafcc53dea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:35.940191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13c96792-e418-4688-8a0c-68aafcc53dea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:35.942160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13c96792-e418-4688-8a0c-68aafcc53dea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:36.017245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-13c96792-e418-4688-8a0c-68aafcc53dea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:36.026550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-13c96792-e418-4688-8a0c-68aafcc53dea tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.107944 May 23 14:03:36.027157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1699/3476] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:35 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:36.155137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d7344625-8ceb-4689-9cdf-9a66182182dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:36.155738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d7344625-8ceb-4689-9cdf-9a66182182dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:36.158142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=58 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:36.163766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7344625-8ceb-4689-9cdf-9a66182182dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:36.164220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7344625-8ceb-4689-9cdf-9a66182182dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:36.165123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7344625-8ceb-4689-9cdf-9a66182182dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:36.165562 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7344625-8ceb-4689-9cdf-9a66182182dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:36.307575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7344625-8ceb-4689-9cdf-9a66182182dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:36.316722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d7344625-8ceb-4689-9cdf-9a66182182dc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164765 May 23 14:03:36.317324 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1778/3477] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:36.562847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7db14f2-9cb0-499c-a87f-478408f082d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:36.563272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7db14f2-9cb0-499c-a87f-478408f082d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:36.570165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7db14f2-9cb0-499c-a87f-478408f082d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:36.570623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7db14f2-9cb0-499c-a87f-478408f082d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:36.571410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7db14f2-9cb0-499c-a87f-478408f082d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:36.571860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7db14f2-9cb0-499c-a87f-478408f082d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:36.597050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7db14f2-9cb0-499c-a87f-478408f082d5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/ips" status: 200 len: 152 microversion: 2.20 time: 0.038183 May 23 14:03:36.598791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1700/3478] 10.222.0.70 () {60 vars in 1288 bytes} [Mon May 23 14:03:36 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 14:03:37.047003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0c8bcc22-33a0-49db-9681-87c3ca19b11d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:37.047809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0c8bcc22-33a0-49db-9681-87c3ca19b11d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:37.055269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c8bcc22-33a0-49db-9681-87c3ca19b11d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:37.055734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c8bcc22-33a0-49db-9681-87c3ca19b11d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:37.056510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c8bcc22-33a0-49db-9681-87c3ca19b11d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:37.056977 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c8bcc22-33a0-49db-9681-87c3ca19b11d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:37.123062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c8bcc22-33a0-49db-9681-87c3ca19b11d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:37.132372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0c8bcc22-33a0-49db-9681-87c3ca19b11d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090632 May 23 14:03:37.133018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1779/3479] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:37 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:37.333865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dfeee1df-4af4-481a-9ef2-a1ed160557b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:37.334482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dfeee1df-4af4-481a-9ef2-a1ed160557b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:37.341231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfeee1df-4af4-481a-9ef2-a1ed160557b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:37.341684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfeee1df-4af4-481a-9ef2-a1ed160557b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:37.342498 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfeee1df-4af4-481a-9ef2-a1ed160557b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:37.342935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dfeee1df-4af4-481a-9ef2-a1ed160557b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:37.487088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dfeee1df-4af4-481a-9ef2-a1ed160557b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:37.496310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dfeee1df-4af4-481a-9ef2-a1ed160557b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166679 May 23 14:03:37.496943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1701/3480] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:38.149492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e31ee7fd-e4d6-41ef-be91-47469ce2c524 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:38.150101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e31ee7fd-e4d6-41ef-be91-47469ce2c524 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:38.159410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e31ee7fd-e4d6-41ef-be91-47469ce2c524 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:38.159897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e31ee7fd-e4d6-41ef-be91-47469ce2c524 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:38.160887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e31ee7fd-e4d6-41ef-be91-47469ce2c524 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:38.161341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e31ee7fd-e4d6-41ef-be91-47469ce2c524 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:38.239831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e31ee7fd-e4d6-41ef-be91-47469ce2c524 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:38.248927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e31ee7fd-e4d6-41ef-be91-47469ce2c524 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.103833 May 23 14:03:38.249686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1780/3481] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:38 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:38.310317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a71429f8-ce68-4e20-affe-dac3521582db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:38.310765 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a71429f8-ce68-4e20-affe-dac3521582db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:38.319006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a71429f8-ce68-4e20-affe-dac3521582db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:38.319448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a71429f8-ce68-4e20-affe-dac3521582db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:38.320268 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a71429f8-ce68-4e20-affe-dac3521582db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:38.320766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a71429f8-ce68-4e20-affe-dac3521582db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:38.349815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a71429f8-ce68-4e20-affe-dac3521582db tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/ips" status: 200 len: 148 microversion: 2.1 time: 0.044003 May 23 14:03:38.350602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1702/3482] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 14:03:38 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:03:38.514187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-64b8d400-edd3-47b2-8fad-31edef646285 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:38.514803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-64b8d400-edd3-47b2-8fad-31edef646285 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:38.521658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64b8d400-edd3-47b2-8fad-31edef646285 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:38.522119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64b8d400-edd3-47b2-8fad-31edef646285 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:38.522899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64b8d400-edd3-47b2-8fad-31edef646285 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:38.523451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64b8d400-edd3-47b2-8fad-31edef646285 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:38.677498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-64b8d400-edd3-47b2-8fad-31edef646285 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:38.687109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-64b8d400-edd3-47b2-8fad-31edef646285 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.176707 May 23 14:03:38.687697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1781/3483] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:39.267547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3e942694-53de-4819-936f-90da24df619f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:39.268170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3e942694-53de-4819-936f-90da24df619f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:39.275740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e942694-53de-4819-936f-90da24df619f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:39.276192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e942694-53de-4819-936f-90da24df619f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:39.277129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e942694-53de-4819-936f-90da24df619f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:39.277581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e942694-53de-4819-936f-90da24df619f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:39.346180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e942694-53de-4819-936f-90da24df619f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:39.356653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3e942694-53de-4819-936f-90da24df619f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.093032 May 23 14:03:39.357720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1703/3484] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:39 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:39.704542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f74c382-e8b5-4f92-bf4a-64b4d355140f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:39.705169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f74c382-e8b5-4f92-bf4a-64b4d355140f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:39.713195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f74c382-e8b5-4f92-bf4a-64b4d355140f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:39.713653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f74c382-e8b5-4f92-bf4a-64b4d355140f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:39.714435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f74c382-e8b5-4f92-bf4a-64b4d355140f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:39.714878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f74c382-e8b5-4f92-bf4a-64b4d355140f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:39.857360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f74c382-e8b5-4f92-bf4a-64b4d355140f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:39.865913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f74c382-e8b5-4f92-bf4a-64b4d355140f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165210 May 23 14:03:39.866493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1782/3485] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:40.374566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce2602d3-55ff-4066-9515-6a6f9724743c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:40.375306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce2602d3-55ff-4066-9515-6a6f9724743c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:40.382438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce2602d3-55ff-4066-9515-6a6f9724743c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:40.382893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce2602d3-55ff-4066-9515-6a6f9724743c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:40.383668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce2602d3-55ff-4066-9515-6a6f9724743c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:40.384106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce2602d3-55ff-4066-9515-6a6f9724743c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:40.449620 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ce2602d3-55ff-4066-9515-6a6f9724743c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:40.458209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce2602d3-55ff-4066-9515-6a6f9724743c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087551 May 23 14:03:40.458789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1704/3486] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:40 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:40.885722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ccb378ae-c460-4672-8262-899d4e2d702f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:40.886327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ccb378ae-c460-4672-8262-899d4e2d702f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:40.892924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccb378ae-c460-4672-8262-899d4e2d702f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:40.893376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccb378ae-c460-4672-8262-899d4e2d702f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:40.894208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccb378ae-c460-4672-8262-899d4e2d702f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:40.894702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ccb378ae-c460-4672-8262-899d4e2d702f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:41.068649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ccb378ae-c460-4672-8262-899d4e2d702f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:41.072226 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:41.077095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ccb378ae-c460-4672-8262-899d4e2d702f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.195338 May 23 14:03:41.079742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1783/3487] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:41.476303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fb01e0be-33e2-4a71-b850-185f6d4d3f11 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:41.476915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fb01e0be-33e2-4a71-b850-185f6d4d3f11 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:41.485596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb01e0be-33e2-4a71-b850-185f6d4d3f11 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:41.486072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb01e0be-33e2-4a71-b850-185f6d4d3f11 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:41.486850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb01e0be-33e2-4a71-b850-185f6d4d3f11 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:41.487287 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb01e0be-33e2-4a71-b850-185f6d4d3f11 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:41.568116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fb01e0be-33e2-4a71-b850-185f6d4d3f11 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:41.576892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fb01e0be-33e2-4a71-b850-185f6d4d3f11 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.105546 May 23 14:03:41.577640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1705/3488] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:41 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:42.094644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d584b96-186e-42e4-8b4c-0d3d3f87e17b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:42.095293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d584b96-186e-42e4-8b4c-0d3d3f87e17b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:42.102759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d584b96-186e-42e4-8b4c-0d3d3f87e17b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:42.103206 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d584b96-186e-42e4-8b4c-0d3d3f87e17b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:42.103979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d584b96-186e-42e4-8b4c-0d3d3f87e17b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:42.104410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d584b96-186e-42e4-8b4c-0d3d3f87e17b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:42.260429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d584b96-186e-42e4-8b4c-0d3d3f87e17b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:42.268979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d584b96-186e-42e4-8b4c-0d3d3f87e17b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.178070 May 23 14:03:42.269670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1784/3489] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:42.595812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1ab50960-b518-4a18-a696-33c26c249fad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:42.596556 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1ab50960-b518-4a18-a696-33c26c249fad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:42.604830 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ab50960-b518-4a18-a696-33c26c249fad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:42.605290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ab50960-b518-4a18-a696-33c26c249fad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:42.606163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ab50960-b518-4a18-a696-33c26c249fad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:42.606607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ab50960-b518-4a18-a696-33c26c249fad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:42.673733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ab50960-b518-4a18-a696-33c26c249fad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:42.683863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1ab50960-b518-4a18-a696-33c26c249fad tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.092183 May 23 14:03:42.684455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1706/3490] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:42 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:43.294797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-00d3b377-9afd-4019-8f5f-6ca0e51a0ff9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:43.295515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-00d3b377-9afd-4019-8f5f-6ca0e51a0ff9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:43.302943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00d3b377-9afd-4019-8f5f-6ca0e51a0ff9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:43.303497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00d3b377-9afd-4019-8f5f-6ca0e51a0ff9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:43.304184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00d3b377-9afd-4019-8f5f-6ca0e51a0ff9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:43.304644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00d3b377-9afd-4019-8f5f-6ca0e51a0ff9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:43.445600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-00d3b377-9afd-4019-8f5f-6ca0e51a0ff9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:43.453577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-00d3b377-9afd-4019-8f5f-6ca0e51a0ff9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.162794 May 23 14:03:43.454145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1785/3491] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:43.703361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2998d17e-f781-4caa-b1e5-5881a7eaad2d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:43.703972 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2998d17e-f781-4caa-b1e5-5881a7eaad2d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:43.711445 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2998d17e-f781-4caa-b1e5-5881a7eaad2d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:43.711896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2998d17e-f781-4caa-b1e5-5881a7eaad2d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:43.712698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2998d17e-f781-4caa-b1e5-5881a7eaad2d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:43.713141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2998d17e-f781-4caa-b1e5-5881a7eaad2d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:43.780624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2998d17e-f781-4caa-b1e5-5881a7eaad2d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:43.790183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2998d17e-f781-4caa-b1e5-5881a7eaad2d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090798 May 23 14:03:43.790768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1707/3492] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:43 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:44.470628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-239cebe7-f32c-4a37-9db1-437041203128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:44.471278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-239cebe7-f32c-4a37-9db1-437041203128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:44.479286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-239cebe7-f32c-4a37-9db1-437041203128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:44.479741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-239cebe7-f32c-4a37-9db1-437041203128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:44.480526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-239cebe7-f32c-4a37-9db1-437041203128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:44.480995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-239cebe7-f32c-4a37-9db1-437041203128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:44.619652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-239cebe7-f32c-4a37-9db1-437041203128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:44.628139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-239cebe7-f32c-4a37-9db1-437041203128 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161357 May 23 14:03:44.628785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1786/3493] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:44.807578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e5d1859b-5214-4172-9da6-3a91784c34dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:44.808169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e5d1859b-5214-4172-9da6-3a91784c34dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:44.814634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5d1859b-5214-4172-9da6-3a91784c34dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:44.815074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5d1859b-5214-4172-9da6-3a91784c34dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:44.815824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5d1859b-5214-4172-9da6-3a91784c34dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:44.816257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5d1859b-5214-4172-9da6-3a91784c34dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:44.821416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:03:44.887154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e5d1859b-5214-4172-9da6-3a91784c34dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:44.896255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e5d1859b-5214-4172-9da6-3a91784c34dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.091743 May 23 14:03:44.896863 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1708/3494] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:44 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:45.647258 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9673fcce-8b2e-4dec-9a7f-0ef88a77d86d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:45.648010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9673fcce-8b2e-4dec-9a7f-0ef88a77d86d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:45.654205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9673fcce-8b2e-4dec-9a7f-0ef88a77d86d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:45.654679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9673fcce-8b2e-4dec-9a7f-0ef88a77d86d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:45.655441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9673fcce-8b2e-4dec-9a7f-0ef88a77d86d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:45.655875 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9673fcce-8b2e-4dec-9a7f-0ef88a77d86d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:45.789353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9673fcce-8b2e-4dec-9a7f-0ef88a77d86d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:45.797656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9673fcce-8b2e-4dec-9a7f-0ef88a77d86d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155231 May 23 14:03:45.798241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1787/3495] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:45.914351 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a91d19a9-b4ca-47b5-99ae-816068f3551a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:45.914931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a91d19a9-b4ca-47b5-99ae-816068f3551a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:45.921252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a91d19a9-b4ca-47b5-99ae-816068f3551a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:45.921741 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a91d19a9-b4ca-47b5-99ae-816068f3551a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:45.922522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a91d19a9-b4ca-47b5-99ae-816068f3551a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:45.922963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a91d19a9-b4ca-47b5-99ae-816068f3551a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:45.991359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a91d19a9-b4ca-47b5-99ae-816068f3551a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:45.999407 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a91d19a9-b4ca-47b5-99ae-816068f3551a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.090812 May 23 14:03:46.000003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1709/3496] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:45 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:46.816467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0e42556e-5b61-4520-b419-23be34a6b24b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:46.817746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0e42556e-5b61-4520-b419-23be34a6b24b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:46.825031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e42556e-5b61-4520-b419-23be34a6b24b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:46.830994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e42556e-5b61-4520-b419-23be34a6b24b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:46.830994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e42556e-5b61-4520-b419-23be34a6b24b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:46.830994 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e42556e-5b61-4520-b419-23be34a6b24b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:46.969148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0e42556e-5b61-4520-b419-23be34a6b24b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:46.978500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0e42556e-5b61-4520-b419-23be34a6b24b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166112 May 23 14:03:46.979176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1788/3497] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:47.018257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-96523dfb-d9c4-4e5b-bde1-793bb6348bd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:47.018932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-96523dfb-d9c4-4e5b-bde1-793bb6348bd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:47.026217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96523dfb-d9c4-4e5b-bde1-793bb6348bd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:47.026676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96523dfb-d9c4-4e5b-bde1-793bb6348bd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:47.027463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96523dfb-d9c4-4e5b-bde1-793bb6348bd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:47.027926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96523dfb-d9c4-4e5b-bde1-793bb6348bd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:47.100645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-96523dfb-d9c4-4e5b-bde1-793bb6348bd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:47.111405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-96523dfb-d9c4-4e5b-bde1-793bb6348bd3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.096931 May 23 14:03:47.112000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1710/3498] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:47 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:47.996587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f8c345c-aa15-4d3d-bf3b-0baaaf93c6c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:47.997245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f8c345c-aa15-4d3d-bf3b-0baaaf93c6c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:48.008339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f8c345c-aa15-4d3d-bf3b-0baaaf93c6c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:48.008855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f8c345c-aa15-4d3d-bf3b-0baaaf93c6c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:48.009703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f8c345c-aa15-4d3d-bf3b-0baaaf93c6c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:48.010148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f8c345c-aa15-4d3d-bf3b-0baaaf93c6c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:48.131738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e0fde7d-cb88-478a-a31b-d9e5a5aeb9a0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:48.132458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e0fde7d-cb88-478a-a31b-d9e5a5aeb9a0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:48.141448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0fde7d-cb88-478a-a31b-d9e5a5aeb9a0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:48.142119 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0fde7d-cb88-478a-a31b-d9e5a5aeb9a0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:48.143115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0fde7d-cb88-478a-a31b-d9e5a5aeb9a0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:48.145776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e0fde7d-cb88-478a-a31b-d9e5a5aeb9a0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:48.172443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4f8c345c-aa15-4d3d-bf3b-0baaaf93c6c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:48.188850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f8c345c-aa15-4d3d-bf3b-0baaaf93c6c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.196142 May 23 14:03:48.189440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1789/3499] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:48.222877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e0fde7d-cb88-478a-a31b-d9e5a5aeb9a0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:48.233779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e0fde7d-cb88-478a-a31b-d9e5a5aeb9a0 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.105851 May 23 14:03:48.233779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1711/3500] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:48 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:49.206168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0e0645c0-78d9-4fdf-8dc6-32afbd889fdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:49.206791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0e0645c0-78d9-4fdf-8dc6-32afbd889fdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:49.214123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e0645c0-78d9-4fdf-8dc6-32afbd889fdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:49.214586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e0645c0-78d9-4fdf-8dc6-32afbd889fdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:49.215369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e0645c0-78d9-4fdf-8dc6-32afbd889fdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:49.215816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e0645c0-78d9-4fdf-8dc6-32afbd889fdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:49.250071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-158adeb6-2928-4d92-b024-bd28898e2088 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:49.250948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-158adeb6-2928-4d92-b024-bd28898e2088 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:49.258739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-158adeb6-2928-4d92-b024-bd28898e2088 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:49.259342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-158adeb6-2928-4d92-b024-bd28898e2088 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:49.260075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-158adeb6-2928-4d92-b024-bd28898e2088 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:49.260544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-158adeb6-2928-4d92-b024-bd28898e2088 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:49.326550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-158adeb6-2928-4d92-b024-bd28898e2088 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:49.336005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-158adeb6-2928-4d92-b024-bd28898e2088 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089734 May 23 14:03:49.336617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1712/3501] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:49 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:49.359277 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0e0645c0-78d9-4fdf-8dc6-32afbd889fdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:49.367911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0e0645c0-78d9-4fdf-8dc6-32afbd889fdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165658 May 23 14:03:49.368484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1790/3502] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:50.353202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7820f2ba-242b-45e5-a13b-6f61b09ab158 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:50.353763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7820f2ba-242b-45e5-a13b-6f61b09ab158 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:50.360210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7820f2ba-242b-45e5-a13b-6f61b09ab158 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:50.360701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7820f2ba-242b-45e5-a13b-6f61b09ab158 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:50.361458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7820f2ba-242b-45e5-a13b-6f61b09ab158 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:50.361892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7820f2ba-242b-45e5-a13b-6f61b09ab158 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:50.385556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ef3cb15-b6c4-4a7e-97eb-a42e5d03bbb0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:50.386272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ef3cb15-b6c4-4a7e-97eb-a42e5d03bbb0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:50.395322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ef3cb15-b6c4-4a7e-97eb-a42e5d03bbb0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:50.395892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ef3cb15-b6c4-4a7e-97eb-a42e5d03bbb0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:50.397326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ef3cb15-b6c4-4a7e-97eb-a42e5d03bbb0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:50.397840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ef3cb15-b6c4-4a7e-97eb-a42e5d03bbb0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:50.429195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7820f2ba-242b-45e5-a13b-6f61b09ab158 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:50.437724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7820f2ba-242b-45e5-a13b-6f61b09ab158 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.088404 May 23 14:03:50.438305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1713/3503] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:50 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:50.540360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0ef3cb15-b6c4-4a7e-97eb-a42e5d03bbb0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:50.548394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ef3cb15-b6c4-4a7e-97eb-a42e5d03bbb0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166753 May 23 14:03:50.548988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1791/3504] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:51.455676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a3b44c01-0a3a-461f-a02a-422d7e97ba3f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:51.456243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a3b44c01-0a3a-461f-a02a-422d7e97ba3f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:51.463639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3b44c01-0a3a-461f-a02a-422d7e97ba3f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:51.464121 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3b44c01-0a3a-461f-a02a-422d7e97ba3f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:51.464918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3b44c01-0a3a-461f-a02a-422d7e97ba3f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:51.465355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3b44c01-0a3a-461f-a02a-422d7e97ba3f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:51.530053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a3b44c01-0a3a-461f-a02a-422d7e97ba3f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:51.538596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a3b44c01-0a3a-461f-a02a-422d7e97ba3f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.086880 May 23 14:03:51.539165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1714/3505] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:51 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:51.566371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4d536e9d-58ee-459d-8625-9b247efdcae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:51.566984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4d536e9d-58ee-459d-8625-9b247efdcae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:51.574370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d536e9d-58ee-459d-8625-9b247efdcae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:51.574816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d536e9d-58ee-459d-8625-9b247efdcae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:51.575581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d536e9d-58ee-459d-8625-9b247efdcae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:51.576016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4d536e9d-58ee-459d-8625-9b247efdcae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:51.719963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4d536e9d-58ee-459d-8625-9b247efdcae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:51.729908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4d536e9d-58ee-459d-8625-9b247efdcae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.167340 May 23 14:03:51.730491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1792/3506] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:52.556400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ec4e59d-306b-42db-8e32-17c4367af119 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:52.557031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ec4e59d-306b-42db-8e32-17c4367af119 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:52.563569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec4e59d-306b-42db-8e32-17c4367af119 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:52.564013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec4e59d-306b-42db-8e32-17c4367af119 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:52.564802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec4e59d-306b-42db-8e32-17c4367af119 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:52.565237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ec4e59d-306b-42db-8e32-17c4367af119 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:52.628487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ec4e59d-306b-42db-8e32-17c4367af119 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:52.637134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ec4e59d-306b-42db-8e32-17c4367af119 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.085389 May 23 14:03:52.637707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1715/3507] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:52 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:52.753057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-72561080-ea44-46f9-b876-1b7f85a627d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:52.753057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-72561080-ea44-46f9-b876-1b7f85a627d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:52.762119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72561080-ea44-46f9-b876-1b7f85a627d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:52.762668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72561080-ea44-46f9-b876-1b7f85a627d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:52.763601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72561080-ea44-46f9-b876-1b7f85a627d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:52.764090 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-72561080-ea44-46f9-b876-1b7f85a627d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:52.927765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-72561080-ea44-46f9-b876-1b7f85a627d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:52.943963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-72561080-ea44-46f9-b876-1b7f85a627d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.196023 May 23 14:03:52.945066 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1793/3508] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:53.654821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ff13f202-2242-4c6e-b7bb-74056e95ebae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:53.655436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ff13f202-2242-4c6e-b7bb-74056e95ebae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:53.662120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff13f202-2242-4c6e-b7bb-74056e95ebae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:53.662572 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff13f202-2242-4c6e-b7bb-74056e95ebae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:53.663344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff13f202-2242-4c6e-b7bb-74056e95ebae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:53.663785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ff13f202-2242-4c6e-b7bb-74056e95ebae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:53.731784 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ff13f202-2242-4c6e-b7bb-74056e95ebae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:53.740789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ff13f202-2242-4c6e-b7bb-74056e95ebae tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.089785 May 23 14:03:53.741366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1716/3509] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:53 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:53.970378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cbe74dcf-b47d-474c-b2a5-562d4929577f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:53.970962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cbe74dcf-b47d-474c-b2a5-562d4929577f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:53.978604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbe74dcf-b47d-474c-b2a5-562d4929577f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:53.979082 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbe74dcf-b47d-474c-b2a5-562d4929577f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:53.979859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbe74dcf-b47d-474c-b2a5-562d4929577f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:53.980300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbe74dcf-b47d-474c-b2a5-562d4929577f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:54.118850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cbe74dcf-b47d-474c-b2a5-562d4929577f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:54.127235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cbe74dcf-b47d-474c-b2a5-562d4929577f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160798 May 23 14:03:54.127926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1794/3510] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:54.758782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2676644-6873-4da6-9718-4503b53dfec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:54.759387 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2676644-6873-4da6-9718-4503b53dfec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:54.766010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2676644-6873-4da6-9718-4503b53dfec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:54.766454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2676644-6873-4da6-9718-4503b53dfec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:54.767210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2676644-6873-4da6-9718-4503b53dfec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:54.767644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2676644-6873-4da6-9718-4503b53dfec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:54.833062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2676644-6873-4da6-9718-4503b53dfec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:54.842394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2676644-6873-4da6-9718-4503b53dfec7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.087979 May 23 14:03:54.849111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1717/3511] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:54 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:55.145879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-520d56d9-cd01-4ced-b3ac-a2c8fb2d655c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:55.146560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-520d56d9-cd01-4ced-b3ac-a2c8fb2d655c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:55.153529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-520d56d9-cd01-4ced-b3ac-a2c8fb2d655c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:55.153987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-520d56d9-cd01-4ced-b3ac-a2c8fb2d655c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:55.154858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-520d56d9-cd01-4ced-b3ac-a2c8fb2d655c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:55.155386 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-520d56d9-cd01-4ced-b3ac-a2c8fb2d655c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:55.298912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-520d56d9-cd01-4ced-b3ac-a2c8fb2d655c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:55.309345 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-520d56d9-cd01-4ced-b3ac-a2c8fb2d655c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.168087 May 23 14:03:55.309939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1795/3512] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:55.864692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-26e0843f-ceb6-4f0d-a1c2-0d72c2afb76f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:55.865358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-26e0843f-ceb6-4f0d-a1c2-0d72c2afb76f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:55.871975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26e0843f-ceb6-4f0d-a1c2-0d72c2afb76f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:55.872418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26e0843f-ceb6-4f0d-a1c2-0d72c2afb76f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:55.873219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26e0843f-ceb6-4f0d-a1c2-0d72c2afb76f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:55.873654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26e0843f-ceb6-4f0d-a1c2-0d72c2afb76f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:55.946370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-26e0843f-ceb6-4f0d-a1c2-0d72c2afb76f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:55.954605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-26e0843f-ceb6-4f0d-a1c2-0d72c2afb76f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 200 len: 1368 microversion: 2.1 time: 0.094158 May 23 14:03:55.955086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1718/3513] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:55 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:55.972726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-06b070e2-8e6c-4b5f-900c-aa47d4783699 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '.version_select at 0x7effb1c9c310>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:56.089469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-06b070e2-8e6c-4b5f-900c-aa47d4783699 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797391439" status: 202 len: 0 microversion: 2.1 time: 0.120547 May 23 14:03:56.090052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1796/3514] 10.222.0.70 () {58 vars in 1220 bytes} [Mon May 23 14:03:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797391439 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:03:56.329825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15ebff07-a988-4f9f-a4d3-63491446e2be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:56.329825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-15ebff07-a988-4f9f-a4d3-63491446e2be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:56.335201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15ebff07-a988-4f9f-a4d3-63491446e2be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:56.335659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15ebff07-a988-4f9f-a4d3-63491446e2be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:56.336435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15ebff07-a988-4f9f-a4d3-63491446e2be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:56.336897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15ebff07-a988-4f9f-a4d3-63491446e2be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:56.548242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-15ebff07-a988-4f9f-a4d3-63491446e2be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:56.557633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-15ebff07-a988-4f9f-a4d3-63491446e2be tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.234201 May 23 14:03:56.558216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1719/3515] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:57.236742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a557626-90c9-46be-8e87-21d0fa454abe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Action: 'create', calling method: .version_select at 0x7effb1d06160>, body: {"keypair": {"name": "tempest-keypair-1985357311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx0hzx3CocXrub0ecdGk7505PULq8giUKvu/fpUh4GTwqRLkhAkv/75FoJnqfV0UF9U7552T1K5McOVhp7u4wgK8v8ObYhvVOsEywX8L3gVoQMqNe1xQYX9Ton9yiGnig=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:03:57.252617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-6a557626-90c9-46be-8e87-21d0fa454abe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Getting quotas for project 6bb9e74e9b64480a80d45a03945ea51f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:03:57.256758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-6a557626-90c9-46be-8e87-21d0fa454abe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Getting quotas for user a58edb91d7b641298e40dd356eec9eac and project 6bb9e74e9b64480a80d45a03945ea51f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:03:57.438606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a557626-90c9-46be-8e87-21d0fa454abe tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.207007 May 23 14:03:57.439219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1797/3516] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 14:03:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:03:57.575179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-197e6185-a863-48f5-a586-068d11a92849 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:57.575753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-197e6185-a863-48f5-a586-068d11a92849 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:57.582409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-197e6185-a863-48f5-a586-068d11a92849 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:57.582874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-197e6185-a863-48f5-a586-068d11a92849 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:57.584977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-197e6185-a863-48f5-a586-068d11a92849 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:57.585430 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-197e6185-a863-48f5-a586-068d11a92849 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:57.762684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-197e6185-a863-48f5-a586-068d11a92849 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:57.773023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-197e6185-a863-48f5-a586-068d11a92849 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.201789 May 23 14:03:57.773626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1720/3517] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:03:58.791237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9277c4b6-6302-4a88-a3b9-d7833f5839e4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:58.791874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9277c4b6-6302-4a88-a3b9-d7833f5839e4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:58.798021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9277c4b6-6302-4a88-a3b9-d7833f5839e4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:58.798475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9277c4b6-6302-4a88-a3b9-d7833f5839e4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:58.799265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9277c4b6-6302-4a88-a3b9-d7833f5839e4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:58.799709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9277c4b6-6302-4a88-a3b9-d7833f5839e4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:58.956018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9277c4b6-6302-4a88-a3b9-d7833f5839e4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:03:58.965236 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9277c4b6-6302-4a88-a3b9-d7833f5839e4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.178325 May 23 14:03:58.966068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1798/3518] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:58 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:03:59.989747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2fe917ef-a5dd-424b-abfd-ce54db8e8361 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:03:59.991040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2fe917ef-a5dd-424b-abfd-ce54db8e8361 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:03:59.997341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fe917ef-a5dd-424b-abfd-ce54db8e8361 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:59.997796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fe917ef-a5dd-424b-abfd-ce54db8e8361 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:03:59.998561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fe917ef-a5dd-424b-abfd-ce54db8e8361 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:03:59.998995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fe917ef-a5dd-424b-abfd-ce54db8e8361 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:00.135392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1877516052", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2bea62-f6f1-4527-b917-50977245b156"}], "security_groups": [{"name": "tempest-securitygroup--772483008"}], "key_name": "tempest-keypair-1985357311", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:04:00.145692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2fe917ef-a5dd-424b-abfd-ce54db8e8361 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:00.154861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2fe917ef-a5dd-424b-abfd-ce54db8e8361 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.169295 May 23 14:04:00.155546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1721/3519] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:03:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:00.262504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] validate_networks() for [('be2bea62-f6f1-4527-b917-50977245b156', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 14:04:00.664260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 14:04:00.664744 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 14:04:00.665281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 14:04:00.665715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 14:04:00.666129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 14:04:00.674930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:00.675378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:00.676160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:00.676658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:00.694544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Getting quotas for project 6bb9e74e9b64480a80d45a03945ea51f. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:04:00.698625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Getting quotas for user a58edb91d7b641298e40dd356eec9eac and project 6bb9e74e9b64480a80d45a03945ea51f. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:04:00.709550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 14:04:00.711795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 14:04:00.845116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-696884bb-d9c6-4e00-b861-9d9269726fbc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.714290 May 23 14:04:00.845918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1799/3520] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 14:04:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 14:04:00.857737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-127679a0-07d8-4edd-8ab3-e10109ea7798 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:00.858490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-127679a0-07d8-4edd-8ab3-e10109ea7798 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:00.921808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-127679a0-07d8-4edd-8ab3-e10109ea7798 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:00.932074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-127679a0-07d8-4edd-8ab3-e10109ea7798 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1238 microversion: 2.1 time: 0.079034 May 23 14:04:00.932776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1722/3521] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:00 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:01.174196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e68e38ab-29f3-418b-851c-bbe97612aaa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:01.174767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e68e38ab-29f3-418b-851c-bbe97612aaa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:01.182717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e68e38ab-29f3-418b-851c-bbe97612aaa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:01.183103 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e68e38ab-29f3-418b-851c-bbe97612aaa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:01.183890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e68e38ab-29f3-418b-851c-bbe97612aaa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:01.184336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e68e38ab-29f3-418b-851c-bbe97612aaa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:01.325614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e68e38ab-29f3-418b-851c-bbe97612aaa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:01.333872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e68e38ab-29f3-418b-851c-bbe97612aaa2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164149 May 23 14:04:01.334467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1800/3522] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:01.950240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4dbb01dd-bb33-44ae-9051-727727719e8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:01.950990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4dbb01dd-bb33-44ae-9051-727727719e8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:01.958076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4dbb01dd-bb33-44ae-9051-727727719e8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:01.959003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4dbb01dd-bb33-44ae-9051-727727719e8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:01.960093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4dbb01dd-bb33-44ae-9051-727727719e8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:01.960526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4dbb01dd-bb33-44ae-9051-727727719e8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:02.025316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4dbb01dd-bb33-44ae-9051-727727719e8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:02.033180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4dbb01dd-bb33-44ae-9051-727727719e8a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1242 microversion: 2.1 time: 0.086876 May 23 14:04:02.033818 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1723/3523] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:01 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:04:02.352350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c83ffda7-d2d3-4609-8bf3-4db4e42026e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:02.353199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c83ffda7-d2d3-4609-8bf3-4db4e42026e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:02.360141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c83ffda7-d2d3-4609-8bf3-4db4e42026e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:02.360635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c83ffda7-d2d3-4609-8bf3-4db4e42026e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:02.361416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c83ffda7-d2d3-4609-8bf3-4db4e42026e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:02.361858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c83ffda7-d2d3-4609-8bf3-4db4e42026e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:02.507559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c83ffda7-d2d3-4609-8bf3-4db4e42026e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:02.516326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c83ffda7-d2d3-4609-8bf3-4db4e42026e3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.168529 May 23 14:04:02.516953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1801/3524] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:03.056441 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b58f7b9-4253-47e1-9a02-a341053f3427 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:03.057397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b58f7b9-4253-47e1-9a02-a341053f3427 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:03.063757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b58f7b9-4253-47e1-9a02-a341053f3427 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:03.064208 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b58f7b9-4253-47e1-9a02-a341053f3427 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:03.065006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b58f7b9-4253-47e1-9a02-a341053f3427 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:03.065607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b58f7b9-4253-47e1-9a02-a341053f3427 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:03.129751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b58f7b9-4253-47e1-9a02-a341053f3427 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:03.137233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b58f7b9-4253-47e1-9a02-a341053f3427 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1290 microversion: 2.1 time: 0.085761 May 23 14:04:03.137865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1724/3525] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:03 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:03.534614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-adb92cff-14ce-4ac1-a1b1-46f7674b058c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:03.535270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-adb92cff-14ce-4ac1-a1b1-46f7674b058c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:03.542991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adb92cff-14ce-4ac1-a1b1-46f7674b058c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:03.543475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adb92cff-14ce-4ac1-a1b1-46f7674b058c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:03.544249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adb92cff-14ce-4ac1-a1b1-46f7674b058c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:03.544736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adb92cff-14ce-4ac1-a1b1-46f7674b058c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:03.689145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-adb92cff-14ce-4ac1-a1b1-46f7674b058c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:03.697893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-adb92cff-14ce-4ac1-a1b1-46f7674b058c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.168445 May 23 14:04:03.698478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1802/3526] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:04.155088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-000125f1-dbfb-4b23-b066-2e2716fd55bc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:04.155709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-000125f1-dbfb-4b23-b066-2e2716fd55bc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:04.162612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-000125f1-dbfb-4b23-b066-2e2716fd55bc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:04.166228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-000125f1-dbfb-4b23-b066-2e2716fd55bc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:04.166228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-000125f1-dbfb-4b23-b066-2e2716fd55bc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:04.166228 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-000125f1-dbfb-4b23-b066-2e2716fd55bc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:04.359033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-000125f1-dbfb-4b23-b066-2e2716fd55bc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:04.362549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:04.368204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-000125f1-dbfb-4b23-b066-2e2716fd55bc tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1363 microversion: 2.1 time: 0.217026 May 23 14:04:04.368822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1725/3527] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:04 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:04.714849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e089d21f-0602-4584-8da3-bf7a0731545c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:04.715624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e089d21f-0602-4584-8da3-bf7a0731545c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:04.722307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e089d21f-0602-4584-8da3-bf7a0731545c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:04.722762 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e089d21f-0602-4584-8da3-bf7a0731545c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:04.723529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e089d21f-0602-4584-8da3-bf7a0731545c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:04.723973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e089d21f-0602-4584-8da3-bf7a0731545c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:04.728688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:04.872021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e089d21f-0602-4584-8da3-bf7a0731545c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:04.880073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e089d21f-0602-4584-8da3-bf7a0731545c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.169229 May 23 14:04:04.882101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1803/3528] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:05.144615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-53531d0b-6b55-49e4-b32c-39ba0f7b8a2a req-16f9a807-c945-4f30-90d9-5c7cf7dfc4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a637819f-e77a-49d3-be43-d19961bd66ef", "tag": "51f2c234-f78c-4013-bb1f-3840be1a6e81"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:04:05.147030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-53531d0b-6b55-49e4-b32c-39ba0f7b8a2a req-16f9a807-c945-4f30-90d9-5c7cf7dfc4c8 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:05.147748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-53531d0b-6b55-49e4-b32c-39ba0f7b8a2a req-16f9a807-c945-4f30-90d9-5c7cf7dfc4c8 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:05.168063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-53531d0b-6b55-49e4-b32c-39ba0f7b8a2a req-16f9a807-c945-4f30-90d9-5c7cf7dfc4c8 service nova] Creating event network-changed:51f2c234-f78c-4013-bb1f-3840be1a6e81 for instance a637819f-e77a-49d3-be43-d19961bd66ef on hv-cinder-82549 May 23 14:04:05.173337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-53531d0b-6b55-49e4-b32c-39ba0f7b8a2a req-16f9a807-c945-4f30-90d9-5c7cf7dfc4c8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041239 May 23 14:04:05.174047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1726/3529] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:04:05.386015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14d46bf2-eee9-48d5-9c85-af70cfa8441f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:05.386618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-14d46bf2-eee9-48d5-9c85-af70cfa8441f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:05.392835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14d46bf2-eee9-48d5-9c85-af70cfa8441f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:05.393295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14d46bf2-eee9-48d5-9c85-af70cfa8441f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:05.394062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14d46bf2-eee9-48d5-9c85-af70cfa8441f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:05.394503 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14d46bf2-eee9-48d5-9c85-af70cfa8441f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:05.534685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14d46bf2-eee9-48d5-9c85-af70cfa8441f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:05.542973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-14d46bf2-eee9-48d5-9c85-af70cfa8441f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1363 microversion: 2.1 time: 0.160820 May 23 14:04:05.543567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1804/3530] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:05 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:05.900431 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06029b81-01a9-4f85-8728-d82fff07d709 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:05.903594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06029b81-01a9-4f85-8728-d82fff07d709 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:05.908014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06029b81-01a9-4f85-8728-d82fff07d709 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:05.908778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06029b81-01a9-4f85-8728-d82fff07d709 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:05.909549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06029b81-01a9-4f85-8728-d82fff07d709 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:05.909983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06029b81-01a9-4f85-8728-d82fff07d709 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:06.061865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06029b81-01a9-4f85-8728-d82fff07d709 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:06.070611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06029b81-01a9-4f85-8728-d82fff07d709 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.175335 May 23 14:04:06.071222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1727/3531] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:06.562623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a410cced-1465-41a7-8bf4-dc075b03dbf6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:06.563561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a410cced-1465-41a7-8bf4-dc075b03dbf6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:06.566865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:06.574392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a410cced-1465-41a7-8bf4-dc075b03dbf6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:06.579825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a410cced-1465-41a7-8bf4-dc075b03dbf6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:06.579825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a410cced-1465-41a7-8bf4-dc075b03dbf6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:06.579825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a410cced-1465-41a7-8bf4-dc075b03dbf6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:06.734172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a410cced-1465-41a7-8bf4-dc075b03dbf6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:06.742319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a410cced-1465-41a7-8bf4-dc075b03dbf6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1363 microversion: 2.1 time: 0.186120 May 23 14:04:06.746034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1805/3532] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:06 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:07.092358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15bd8827-6d6c-4dca-95cb-5d64ed788b7e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:07.093018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-15bd8827-6d6c-4dca-95cb-5d64ed788b7e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:07.095470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=60 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:07.102021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15bd8827-6d6c-4dca-95cb-5d64ed788b7e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:07.102506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15bd8827-6d6c-4dca-95cb-5d64ed788b7e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:07.103284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15bd8827-6d6c-4dca-95cb-5d64ed788b7e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:07.103722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15bd8827-6d6c-4dca-95cb-5d64ed788b7e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:07.242485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-15bd8827-6d6c-4dca-95cb-5d64ed788b7e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:07.250806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-15bd8827-6d6c-4dca-95cb-5d64ed788b7e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166883 May 23 14:04:07.251386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1728/3533] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:07.759793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b29acf3f-1a34-483f-86bc-4d73f12703ec tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:07.760432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b29acf3f-1a34-483f-86bc-4d73f12703ec tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:07.766984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b29acf3f-1a34-483f-86bc-4d73f12703ec tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:07.767432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b29acf3f-1a34-483f-86bc-4d73f12703ec tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:07.768186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b29acf3f-1a34-483f-86bc-4d73f12703ec tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:07.768645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b29acf3f-1a34-483f-86bc-4d73f12703ec tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:08.147383 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b29acf3f-1a34-483f-86bc-4d73f12703ec tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:08.155746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b29acf3f-1a34-483f-86bc-4d73f12703ec tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1363 microversion: 2.1 time: 0.400371 May 23 14:04:08.156351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1806/3534] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:07 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:08.268350 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-988bddf3-9681-439e-aa64-7ab022321550 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:08.269047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-988bddf3-9681-439e-aa64-7ab022321550 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:08.275704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-988bddf3-9681-439e-aa64-7ab022321550 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:08.276157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-988bddf3-9681-439e-aa64-7ab022321550 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:08.276965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-988bddf3-9681-439e-aa64-7ab022321550 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:08.277408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-988bddf3-9681-439e-aa64-7ab022321550 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:08.415028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-988bddf3-9681-439e-aa64-7ab022321550 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:08.423369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-988bddf3-9681-439e-aa64-7ab022321550 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158702 May 23 14:04:08.423817 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1729/3535] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:09.173422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-44fdae8c-b9f0-4cc8-87d1-a4406bfad7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:09.174039 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-44fdae8c-b9f0-4cc8-87d1-a4406bfad7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:09.181412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44fdae8c-b9f0-4cc8-87d1-a4406bfad7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:09.181863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44fdae8c-b9f0-4cc8-87d1-a4406bfad7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:09.182910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44fdae8c-b9f0-4cc8-87d1-a4406bfad7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:09.183373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44fdae8c-b9f0-4cc8-87d1-a4406bfad7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:09.317546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-44fdae8c-b9f0-4cc8-87d1-a4406bfad7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:09.325872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-44fdae8c-b9f0-4cc8-87d1-a4406bfad7e6 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1363 microversion: 2.1 time: 0.156257 May 23 14:04:09.326436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1807/3536] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:09 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:09.443501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-78f60024-ae24-496f-a34a-956c000864bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:09.444143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-78f60024-ae24-496f-a34a-956c000864bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:09.451312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78f60024-ae24-496f-a34a-956c000864bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:09.451766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78f60024-ae24-496f-a34a-956c000864bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:09.452549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78f60024-ae24-496f-a34a-956c000864bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:09.453017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78f60024-ae24-496f-a34a-956c000864bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:09.599211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78f60024-ae24-496f-a34a-956c000864bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:09.599211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-78f60024-ae24-496f-a34a-956c000864bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158525 May 23 14:04:09.599211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1730/3537] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:04:10.343095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb1dceb6-66f0-4772-9ce8-ca3cc591e213 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:10.343714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb1dceb6-66f0-4772-9ce8-ca3cc591e213 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:10.350381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb1dceb6-66f0-4772-9ce8-ca3cc591e213 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:10.350847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb1dceb6-66f0-4772-9ce8-ca3cc591e213 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:10.352215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb1dceb6-66f0-4772-9ce8-ca3cc591e213 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:10.352752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb1dceb6-66f0-4772-9ce8-ca3cc591e213 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:10.489539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb1dceb6-66f0-4772-9ce8-ca3cc591e213 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:10.497436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb1dceb6-66f0-4772-9ce8-ca3cc591e213 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1363 microversion: 2.1 time: 0.158255 May 23 14:04:10.498070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1808/3538] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:10 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:10.616773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f38017da-72db-4a6e-9e51-7fe66f0b04ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:10.618730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f38017da-72db-4a6e-9e51-7fe66f0b04ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:10.625405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f38017da-72db-4a6e-9e51-7fe66f0b04ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:10.631881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f38017da-72db-4a6e-9e51-7fe66f0b04ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:10.631881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f38017da-72db-4a6e-9e51-7fe66f0b04ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:10.631881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f38017da-72db-4a6e-9e51-7fe66f0b04ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:10.763263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f38017da-72db-4a6e-9e51-7fe66f0b04ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:10.771389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f38017da-72db-4a6e-9e51-7fe66f0b04ae tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158545 May 23 14:04:10.771958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1731/3539] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:11.514400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2d70b0bd-e466-42e7-8f3f-7e979e029e91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:11.515044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2d70b0bd-e466-42e7-8f3f-7e979e029e91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:11.516898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:11.517591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:11.522941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d70b0bd-e466-42e7-8f3f-7e979e029e91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:11.527483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d70b0bd-e466-42e7-8f3f-7e979e029e91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:11.527483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d70b0bd-e466-42e7-8f3f-7e979e029e91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:11.527483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d70b0bd-e466-42e7-8f3f-7e979e029e91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:11.657634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d70b0bd-e466-42e7-8f3f-7e979e029e91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:11.666260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2d70b0bd-e466-42e7-8f3f-7e979e029e91 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1363 microversion: 2.1 time: 0.155766 May 23 14:04:11.666849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1809/3540] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:11 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:11.787737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b7cf7f93-9683-4da3-99f9-820fd0c1a616 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:11.788342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b7cf7f93-9683-4da3-99f9-820fd0c1a616 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:11.790915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:11.796533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7cf7f93-9683-4da3-99f9-820fd0c1a616 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:11.796705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7cf7f93-9683-4da3-99f9-820fd0c1a616 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:11.797329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7cf7f93-9683-4da3-99f9-820fd0c1a616 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:11.797756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7cf7f93-9683-4da3-99f9-820fd0c1a616 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:11.932267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7cf7f93-9683-4da3-99f9-820fd0c1a616 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:11.941128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b7cf7f93-9683-4da3-99f9-820fd0c1a616 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156967 May 23 14:04:11.941997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1732/3541] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:04:12.458061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-15277ca0-a29d-438e-845f-774124b1ff0b req-9d12bade-42b2-4b98-9967-82170bc8c773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a637819f-e77a-49d3-be43-d19961bd66ef", "name": "network-vif-plugged", "status": "completed", "tag": "51f2c234-f78c-4013-bb1f-3840be1a6e81"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:04:12.467282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-15277ca0-a29d-438e-845f-774124b1ff0b req-9d12bade-42b2-4b98-9967-82170bc8c773 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:12.467735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-15277ca0-a29d-438e-845f-774124b1ff0b req-9d12bade-42b2-4b98-9967-82170bc8c773 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:12.479658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-15277ca0-a29d-438e-845f-774124b1ff0b req-9d12bade-42b2-4b98-9967-82170bc8c773 service nova] Creating event network-vif-plugged:51f2c234-f78c-4013-bb1f-3840be1a6e81 for instance a637819f-e77a-49d3-be43-d19961bd66ef on hv-cinder-82549 May 23 14:04:12.485019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-15277ca0-a29d-438e-845f-774124b1ff0b req-9d12bade-42b2-4b98-9967-82170bc8c773 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030712 May 23 14:04:12.485617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1810/3542] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:04:12.682581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5538706b-7016-4d41-a473-a83fd9273f1c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:12.683482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5538706b-7016-4d41-a473-a83fd9273f1c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:12.689689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5538706b-7016-4d41-a473-a83fd9273f1c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:12.690140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5538706b-7016-4d41-a473-a83fd9273f1c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:12.690911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5538706b-7016-4d41-a473-a83fd9273f1c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:12.691347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5538706b-7016-4d41-a473-a83fd9273f1c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:12.824732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5538706b-7016-4d41-a473-a83fd9273f1c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:12.831481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5538706b-7016-4d41-a473-a83fd9273f1c tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1363 microversion: 2.1 time: 0.152976 May 23 14:04:12.832077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1733/3543] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:12 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:12.960537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5018d639-aefc-4573-baae-ebab953179a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:12.962035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5018d639-aefc-4573-baae-ebab953179a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:12.969130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5018d639-aefc-4573-baae-ebab953179a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:12.970115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5018d639-aefc-4573-baae-ebab953179a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:12.970361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5018d639-aefc-4573-baae-ebab953179a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:12.970810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5018d639-aefc-4573-baae-ebab953179a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:13.104966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5018d639-aefc-4573-baae-ebab953179a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:13.115045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5018d639-aefc-4573-baae-ebab953179a7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160441 May 23 14:04:13.115625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1811/3544] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:13.848637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-05d60e1c-e9b2-4465-82cc-c616eafd608a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:13.849213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-05d60e1c-e9b2-4465-82cc-c616eafd608a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:13.856223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d60e1c-e9b2-4465-82cc-c616eafd608a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:13.856704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d60e1c-e9b2-4465-82cc-c616eafd608a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:13.857467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d60e1c-e9b2-4465-82cc-c616eafd608a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:13.857904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05d60e1c-e9b2-4465-82cc-c616eafd608a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:13.989289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05d60e1c-e9b2-4465-82cc-c616eafd608a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:13.996886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-05d60e1c-e9b2-4465-82cc-c616eafd608a tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1363 microversion: 2.1 time: 0.152180 May 23 14:04:13.997453 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1734/3545] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:13 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:14.134525 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8810d9cf-91eb-4b81-be0d-9f22c5da5220 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:14.135164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8810d9cf-91eb-4b81-be0d-9f22c5da5220 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:14.141788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8810d9cf-91eb-4b81-be0d-9f22c5da5220 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:14.142235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8810d9cf-91eb-4b81-be0d-9f22c5da5220 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:14.142991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8810d9cf-91eb-4b81-be0d-9f22c5da5220 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:14.143424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8810d9cf-91eb-4b81-be0d-9f22c5da5220 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:14.276358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8810d9cf-91eb-4b81-be0d-9f22c5da5220 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:14.284476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8810d9cf-91eb-4b81-be0d-9f22c5da5220 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154843 May 23 14:04:14.285067 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1812/3546] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:15.013792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7d306c36-7cbd-44a9-bfd7-721ca6a63b64 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:15.014395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7d306c36-7cbd-44a9-bfd7-721ca6a63b64 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:15.020932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d306c36-7cbd-44a9-bfd7-721ca6a63b64 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:15.021380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d306c36-7cbd-44a9-bfd7-721ca6a63b64 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:15.022126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d306c36-7cbd-44a9-bfd7-721ca6a63b64 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:15.022554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d306c36-7cbd-44a9-bfd7-721ca6a63b64 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:15.163984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7d306c36-7cbd-44a9-bfd7-721ca6a63b64 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:15.172103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7d306c36-7cbd-44a9-bfd7-721ca6a63b64 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1548 microversion: 2.1 time: 0.162154 May 23 14:04:15.172694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1735/3547] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:15 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:15.188738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ded0954f-aae3-47e9-8fe1-8e2793c12df3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:15.189223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ded0954f-aae3-47e9-8fe1-8e2793c12df3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:15.195343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded0954f-aae3-47e9-8fe1-8e2793c12df3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:15.195733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded0954f-aae3-47e9-8fe1-8e2793c12df3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:15.196560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded0954f-aae3-47e9-8fe1-8e2793c12df3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:15.197077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ded0954f-aae3-47e9-8fe1-8e2793c12df3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:15.280510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ded0954f-aae3-47e9-8fe1-8e2793c12df3 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095695 May 23 14:04:15.281862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1813/3548] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 23 14:04:15 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:04:15.301346 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-195029f9-76da-47cb-bf9d-dff95d6498c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:15.301963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-195029f9-76da-47cb-bf9d-dff95d6498c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:15.309176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-195029f9-76da-47cb-bf9d-dff95d6498c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:15.309660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-195029f9-76da-47cb-bf9d-dff95d6498c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:15.310434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-195029f9-76da-47cb-bf9d-dff95d6498c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:15.310877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-195029f9-76da-47cb-bf9d-dff95d6498c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:15.572256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-195029f9-76da-47cb-bf9d-dff95d6498c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:15.580461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-195029f9-76da-47cb-bf9d-dff95d6498c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.282879 May 23 14:04:15.581096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1736/3549] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:16.599478 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3139562f-eb3c-44c8-9f80-69f927a15965 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:16.600112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3139562f-eb3c-44c8-9f80-69f927a15965 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:16.606908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3139562f-eb3c-44c8-9f80-69f927a15965 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:16.607352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3139562f-eb3c-44c8-9f80-69f927a15965 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:16.608468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3139562f-eb3c-44c8-9f80-69f927a15965 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:16.608933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3139562f-eb3c-44c8-9f80-69f927a15965 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:16.689914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-26dd6dc6-bd1f-4de9-962c-ce3402ea80b5 req-f833883b-66ef-4790-bf2d-ba8d1b94a583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a637819f-e77a-49d3-be43-d19961bd66ef", "tag": "51f2c234-f78c-4013-bb1f-3840be1a6e81"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:04:16.699764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-26dd6dc6-bd1f-4de9-962c-ce3402ea80b5 req-f833883b-66ef-4790-bf2d-ba8d1b94a583 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:16.700630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-26dd6dc6-bd1f-4de9-962c-ce3402ea80b5 req-f833883b-66ef-4790-bf2d-ba8d1b94a583 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:16.717791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-26dd6dc6-bd1f-4de9-962c-ce3402ea80b5 req-f833883b-66ef-4790-bf2d-ba8d1b94a583 service nova] Creating event network-changed:51f2c234-f78c-4013-bb1f-3840be1a6e81 for instance a637819f-e77a-49d3-be43-d19961bd66ef on hv-cinder-82549 May 23 14:04:16.723522 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-26dd6dc6-bd1f-4de9-962c-ce3402ea80b5 req-f833883b-66ef-4790-bf2d-ba8d1b94a583 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037612 May 23 14:04:16.724182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1737/3550] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:04:16.769648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3139562f-eb3c-44c8-9f80-69f927a15965 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:16.781914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3139562f-eb3c-44c8-9f80-69f927a15965 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.185712 May 23 14:04:16.781914 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1814/3551] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:16 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:17.807235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5d9b278-8e92-4c76-b8a5-7c504732b766 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:17.807872 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5d9b278-8e92-4c76-b8a5-7c504732b766 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:17.814563 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5d9b278-8e92-4c76-b8a5-7c504732b766 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:17.815010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5d9b278-8e92-4c76-b8a5-7c504732b766 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:17.815768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5d9b278-8e92-4c76-b8a5-7c504732b766 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:17.816197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5d9b278-8e92-4c76-b8a5-7c504732b766 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:17.958548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f5d9b278-8e92-4c76-b8a5-7c504732b766 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:17.967273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5d9b278-8e92-4c76-b8a5-7c504732b766 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165392 May 23 14:04:17.967848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1738/3552] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:18.983735 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8607e947-139c-42f7-b7d1-157403d08100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:18.984290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8607e947-139c-42f7-b7d1-157403d08100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:18.990855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8607e947-139c-42f7-b7d1-157403d08100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:18.991306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8607e947-139c-42f7-b7d1-157403d08100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:18.992080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8607e947-139c-42f7-b7d1-157403d08100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:18.992513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8607e947-139c-42f7-b7d1-157403d08100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:19.123943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8607e947-139c-42f7-b7d1-157403d08100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:19.132037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8607e947-139c-42f7-b7d1-157403d08100 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152290 May 23 14:04:19.132656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1815/3553] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:20.149970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95b36b77-b95b-414f-9082-b6f677a3c9b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:20.150577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95b36b77-b95b-414f-9082-b6f677a3c9b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:20.157265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95b36b77-b95b-414f-9082-b6f677a3c9b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:20.157716 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95b36b77-b95b-414f-9082-b6f677a3c9b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:20.158463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95b36b77-b95b-414f-9082-b6f677a3c9b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:20.158897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95b36b77-b95b-414f-9082-b6f677a3c9b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:20.291920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95b36b77-b95b-414f-9082-b6f677a3c9b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:20.300541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95b36b77-b95b-414f-9082-b6f677a3c9b8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154914 May 23 14:04:20.301027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1739/3554] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:21.317513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb0bc480-0f2a-4393-a681-5b7f0bef912e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:21.318177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb0bc480-0f2a-4393-a681-5b7f0bef912e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:21.325375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb0bc480-0f2a-4393-a681-5b7f0bef912e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:21.325820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb0bc480-0f2a-4393-a681-5b7f0bef912e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:21.326577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb0bc480-0f2a-4393-a681-5b7f0bef912e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:21.327003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb0bc480-0f2a-4393-a681-5b7f0bef912e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:21.457238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb0bc480-0f2a-4393-a681-5b7f0bef912e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:21.470221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb0bc480-0f2a-4393-a681-5b7f0bef912e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156409 May 23 14:04:21.470851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1816/3555] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:22.487873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e02849cd-5f65-4a42-9f38-519aad846577 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:22.488515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e02849cd-5f65-4a42-9f38-519aad846577 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:22.495259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e02849cd-5f65-4a42-9f38-519aad846577 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:22.495705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e02849cd-5f65-4a42-9f38-519aad846577 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:22.496462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e02849cd-5f65-4a42-9f38-519aad846577 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:22.496935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e02849cd-5f65-4a42-9f38-519aad846577 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:22.632392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e02849cd-5f65-4a42-9f38-519aad846577 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:22.640903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e02849cd-5f65-4a42-9f38-519aad846577 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156943 May 23 14:04:22.641489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1740/3556] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:23.659695 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e813d6e3-0dcd-49bc-b36f-dccef671be94 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:23.660315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e813d6e3-0dcd-49bc-b36f-dccef671be94 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:23.667761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e813d6e3-0dcd-49bc-b36f-dccef671be94 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:23.668215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e813d6e3-0dcd-49bc-b36f-dccef671be94 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:23.669045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e813d6e3-0dcd-49bc-b36f-dccef671be94 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:23.669485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e813d6e3-0dcd-49bc-b36f-dccef671be94 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:23.817137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e813d6e3-0dcd-49bc-b36f-dccef671be94 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:23.826278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e813d6e3-0dcd-49bc-b36f-dccef671be94 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.170665 May 23 14:04:23.826891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1817/3557] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:24.843579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7a3b0638-dea1-4c00-aed5-efed503595ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:24.844176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7a3b0638-dea1-4c00-aed5-efed503595ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:24.850754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a3b0638-dea1-4c00-aed5-efed503595ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:24.851195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a3b0638-dea1-4c00-aed5-efed503595ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:24.851951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a3b0638-dea1-4c00-aed5-efed503595ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:24.852379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a3b0638-dea1-4c00-aed5-efed503595ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:25.001120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7a3b0638-dea1-4c00-aed5-efed503595ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:25.015320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7a3b0638-dea1-4c00-aed5-efed503595ec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.170117 May 23 14:04:25.015320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1741/3558] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:26.027470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8cb0ba81-1b68-4386-ba66-27bda4afbf7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:26.028139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8cb0ba81-1b68-4386-ba66-27bda4afbf7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:26.034700 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cb0ba81-1b68-4386-ba66-27bda4afbf7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:26.035159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cb0ba81-1b68-4386-ba66-27bda4afbf7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:26.035928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cb0ba81-1b68-4386-ba66-27bda4afbf7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:26.036519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cb0ba81-1b68-4386-ba66-27bda4afbf7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:26.172295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8cb0ba81-1b68-4386-ba66-27bda4afbf7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:26.185012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8cb0ba81-1b68-4386-ba66-27bda4afbf7c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159799 May 23 14:04:26.185012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1818/3559] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:27.202138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0714b10d-1151-4eda-911b-e5442afff305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:27.202794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0714b10d-1151-4eda-911b-e5442afff305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:27.209769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0714b10d-1151-4eda-911b-e5442afff305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:27.210140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0714b10d-1151-4eda-911b-e5442afff305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:27.210923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0714b10d-1151-4eda-911b-e5442afff305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:27.211505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0714b10d-1151-4eda-911b-e5442afff305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:27.356841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0714b10d-1151-4eda-911b-e5442afff305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:27.365153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0714b10d-1151-4eda-911b-e5442afff305 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.167032 May 23 14:04:27.365743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1742/3560] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:28.383109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-26ea534f-f35e-4a4a-8a58-2970deeb5c5c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:28.383718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-26ea534f-f35e-4a4a-8a58-2970deeb5c5c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:28.390973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26ea534f-f35e-4a4a-8a58-2970deeb5c5c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:28.391434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26ea534f-f35e-4a4a-8a58-2970deeb5c5c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:28.392199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26ea534f-f35e-4a4a-8a58-2970deeb5c5c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:28.392662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-26ea534f-f35e-4a4a-8a58-2970deeb5c5c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:28.541793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-26ea534f-f35e-4a4a-8a58-2970deeb5c5c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:28.549960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-26ea534f-f35e-4a4a-8a58-2970deeb5c5c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.170683 May 23 14:04:28.550534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1819/3561] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:29.569039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6867c672-f952-4ad4-a2cf-be49d6626e2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:29.569601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6867c672-f952-4ad4-a2cf-be49d6626e2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:29.577024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6867c672-f952-4ad4-a2cf-be49d6626e2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:29.577586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6867c672-f952-4ad4-a2cf-be49d6626e2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:29.578447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6867c672-f952-4ad4-a2cf-be49d6626e2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:29.578887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6867c672-f952-4ad4-a2cf-be49d6626e2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:29.721815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6867c672-f952-4ad4-a2cf-be49d6626e2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:29.725467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:29.730896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6867c672-f952-4ad4-a2cf-be49d6626e2c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165801 May 23 14:04:29.731477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1743/3562] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:30.749493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3cb64645-6a73-4771-b732-045a085f394c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:30.750105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3cb64645-6a73-4771-b732-045a085f394c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:30.756653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cb64645-6a73-4771-b732-045a085f394c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:30.757108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cb64645-6a73-4771-b732-045a085f394c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:30.757863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cb64645-6a73-4771-b732-045a085f394c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:30.758298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cb64645-6a73-4771-b732-045a085f394c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:30.896997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3cb64645-6a73-4771-b732-045a085f394c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:30.900550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:30.906065 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3cb64645-6a73-4771-b732-045a085f394c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161741 May 23 14:04:30.906642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1820/3563] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:31.923879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-839e1f8e-406a-421b-a241-3a837e6e6fcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:31.924493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-839e1f8e-406a-421b-a241-3a837e6e6fcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:31.931638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-839e1f8e-406a-421b-a241-3a837e6e6fcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:31.932178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-839e1f8e-406a-421b-a241-3a837e6e6fcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:31.932983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-839e1f8e-406a-421b-a241-3a837e6e6fcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:31.934046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-839e1f8e-406a-421b-a241-3a837e6e6fcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:32.087170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-839e1f8e-406a-421b-a241-3a837e6e6fcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:32.096216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-839e1f8e-406a-421b-a241-3a837e6e6fcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.176216 May 23 14:04:32.096911 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1744/3564] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:33.114672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec6e8f32-c3ba-472f-97dd-fa8f7475211d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:33.115291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec6e8f32-c3ba-472f-97dd-fa8f7475211d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:33.122878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec6e8f32-c3ba-472f-97dd-fa8f7475211d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:33.126311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec6e8f32-c3ba-472f-97dd-fa8f7475211d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:33.126311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec6e8f32-c3ba-472f-97dd-fa8f7475211d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:33.126311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec6e8f32-c3ba-472f-97dd-fa8f7475211d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:33.266286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec6e8f32-c3ba-472f-97dd-fa8f7475211d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:33.275015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec6e8f32-c3ba-472f-97dd-fa8f7475211d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164516 May 23 14:04:33.275605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1821/3565] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:34.294276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8e4c0a7a-85eb-437b-9d6d-5051141d654e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:34.294896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8e4c0a7a-85eb-437b-9d6d-5051141d654e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:34.303294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e4c0a7a-85eb-437b-9d6d-5051141d654e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:34.303747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e4c0a7a-85eb-437b-9d6d-5051141d654e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:34.304521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e4c0a7a-85eb-437b-9d6d-5051141d654e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:34.304993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e4c0a7a-85eb-437b-9d6d-5051141d654e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:34.444915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8e4c0a7a-85eb-437b-9d6d-5051141d654e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:34.454297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8e4c0a7a-85eb-437b-9d6d-5051141d654e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164262 May 23 14:04:34.454894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1745/3566] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:35.473423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8bbfd8ae-879f-4307-a4cf-585edd1696e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:35.474076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8bbfd8ae-879f-4307-a4cf-585edd1696e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:35.481398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bbfd8ae-879f-4307-a4cf-585edd1696e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:35.483447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bbfd8ae-879f-4307-a4cf-585edd1696e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:35.483447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bbfd8ae-879f-4307-a4cf-585edd1696e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:35.483447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8bbfd8ae-879f-4307-a4cf-585edd1696e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:35.631044 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8bbfd8ae-879f-4307-a4cf-585edd1696e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:35.641076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8bbfd8ae-879f-4307-a4cf-585edd1696e1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.172370 May 23 14:04:35.641665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1822/3567] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:36.660636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59b63201-c33e-40eb-98cd-86a77226ac93 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:36.661252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59b63201-c33e-40eb-98cd-86a77226ac93 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:36.667800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59b63201-c33e-40eb-98cd-86a77226ac93 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:36.668242 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59b63201-c33e-40eb-98cd-86a77226ac93 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:36.669874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59b63201-c33e-40eb-98cd-86a77226ac93 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:36.670152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59b63201-c33e-40eb-98cd-86a77226ac93 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:36.805934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59b63201-c33e-40eb-98cd-86a77226ac93 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:36.814605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59b63201-c33e-40eb-98cd-86a77226ac93 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158761 May 23 14:04:36.815197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1746/3568] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:04:37.831558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-deece36c-d60f-4ba6-88d0-2e5198a217f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:37.832216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-deece36c-d60f-4ba6-88d0-2e5198a217f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:37.834511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=36 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:37.839361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-deece36c-d60f-4ba6-88d0-2e5198a217f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:37.839808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-deece36c-d60f-4ba6-88d0-2e5198a217f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:37.840588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-deece36c-d60f-4ba6-88d0-2e5198a217f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:37.841050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-deece36c-d60f-4ba6-88d0-2e5198a217f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:37.995310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-deece36c-d60f-4ba6-88d0-2e5198a217f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:38.004271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-deece36c-d60f-4ba6-88d0-2e5198a217f2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.176756 May 23 14:04:38.004886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1823/3569] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:04:39.027364 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b41b945f-c20c-4c4d-bd50-e85058189e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:39.028041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b41b945f-c20c-4c4d-bd50-e85058189e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:39.030606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=38 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:04:39.035496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b41b945f-c20c-4c4d-bd50-e85058189e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:39.035950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b41b945f-c20c-4c4d-bd50-e85058189e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:39.036877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b41b945f-c20c-4c4d-bd50-e85058189e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:39.037325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b41b945f-c20c-4c4d-bd50-e85058189e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:39.184505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b41b945f-c20c-4c4d-bd50-e85058189e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:39.196237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b41b945f-c20c-4c4d-bd50-e85058189e55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.172781 May 23 14:04:39.196883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1747/3570] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:40.213489 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f01206e-761a-4644-a9ea-ea839fbdb615 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:40.214112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f01206e-761a-4644-a9ea-ea839fbdb615 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:40.221398 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f01206e-761a-4644-a9ea-ea839fbdb615 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:40.221856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f01206e-761a-4644-a9ea-ea839fbdb615 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:40.222627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f01206e-761a-4644-a9ea-ea839fbdb615 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:40.223071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f01206e-761a-4644-a9ea-ea839fbdb615 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:40.365971 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f01206e-761a-4644-a9ea-ea839fbdb615 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:40.374787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f01206e-761a-4644-a9ea-ea839fbdb615 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165169 May 23 14:04:40.375355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1824/3571] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:41.392118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9e7e1df-3235-4786-bb94-91b4f4574eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:41.392815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9e7e1df-3235-4786-bb94-91b4f4574eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:41.399260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9e7e1df-3235-4786-bb94-91b4f4574eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:41.399713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9e7e1df-3235-4786-bb94-91b4f4574eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:41.400474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9e7e1df-3235-4786-bb94-91b4f4574eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:41.400944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9e7e1df-3235-4786-bb94-91b4f4574eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:41.559197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9e7e1df-3235-4786-bb94-91b4f4574eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:41.567929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9e7e1df-3235-4786-bb94-91b4f4574eab tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.180444 May 23 14:04:41.568516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1748/3572] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:42.585732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aff922d2-6422-4de7-89bb-03b3fe4d228e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:42.586335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aff922d2-6422-4de7-89bb-03b3fe4d228e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:42.593155 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aff922d2-6422-4de7-89bb-03b3fe4d228e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:42.593604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aff922d2-6422-4de7-89bb-03b3fe4d228e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:42.594372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aff922d2-6422-4de7-89bb-03b3fe4d228e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:42.594906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aff922d2-6422-4de7-89bb-03b3fe4d228e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:42.732876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aff922d2-6422-4de7-89bb-03b3fe4d228e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:42.740896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aff922d2-6422-4de7-89bb-03b3fe4d228e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158973 May 23 14:04:42.741457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1825/3573] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:43.759231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-38cb0409-fab9-439a-b199-61d2f455faec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:43.759840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-38cb0409-fab9-439a-b199-61d2f455faec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:43.766493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38cb0409-fab9-439a-b199-61d2f455faec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:43.766937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38cb0409-fab9-439a-b199-61d2f455faec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:43.767687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38cb0409-fab9-439a-b199-61d2f455faec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:43.768114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38cb0409-fab9-439a-b199-61d2f455faec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:43.907117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-38cb0409-fab9-439a-b199-61d2f455faec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:43.916433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-38cb0409-fab9-439a-b199-61d2f455faec tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161106 May 23 14:04:43.917035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1749/3574] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:04:44.933581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3437c763-e229-4005-bf7f-874ae9a6d46a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:44.934215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3437c763-e229-4005-bf7f-874ae9a6d46a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:44.941340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3437c763-e229-4005-bf7f-874ae9a6d46a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:44.943260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3437c763-e229-4005-bf7f-874ae9a6d46a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:44.943260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3437c763-e229-4005-bf7f-874ae9a6d46a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:44.943260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3437c763-e229-4005-bf7f-874ae9a6d46a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:45.088856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3437c763-e229-4005-bf7f-874ae9a6d46a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:45.098555 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3437c763-e229-4005-bf7f-874ae9a6d46a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.169012 May 23 14:04:45.099157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1826/3575] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:46.115943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-82471517-00c0-4d62-9601-f21616b4268f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:46.116557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-82471517-00c0-4d62-9601-f21616b4268f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:46.123238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82471517-00c0-4d62-9601-f21616b4268f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:46.132253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82471517-00c0-4d62-9601-f21616b4268f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:46.132253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82471517-00c0-4d62-9601-f21616b4268f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:46.132253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82471517-00c0-4d62-9601-f21616b4268f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:46.263586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82471517-00c0-4d62-9601-f21616b4268f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:46.271764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-82471517-00c0-4d62-9601-f21616b4268f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159800 May 23 14:04:46.272336 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1750/3576] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:47.289702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e5872c75-0784-4944-b1e4-754e476f55e9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:47.290319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e5872c75-0784-4944-b1e4-754e476f55e9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:47.297352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5872c75-0784-4944-b1e4-754e476f55e9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:47.297955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5872c75-0784-4944-b1e4-754e476f55e9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:47.298837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5872c75-0784-4944-b1e4-754e476f55e9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:47.299280 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5872c75-0784-4944-b1e4-754e476f55e9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:47.443234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e5872c75-0784-4944-b1e4-754e476f55e9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:47.451986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e5872c75-0784-4944-b1e4-754e476f55e9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166477 May 23 14:04:47.452590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1827/3577] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:48.469422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d247d485-6d2d-4fbd-9b86-cacecfbabeb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:48.470068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d247d485-6d2d-4fbd-9b86-cacecfbabeb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:48.476487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d247d485-6d2d-4fbd-9b86-cacecfbabeb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:48.476969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d247d485-6d2d-4fbd-9b86-cacecfbabeb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:48.477732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d247d485-6d2d-4fbd-9b86-cacecfbabeb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:48.478165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d247d485-6d2d-4fbd-9b86-cacecfbabeb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:48.632254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d247d485-6d2d-4fbd-9b86-cacecfbabeb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:48.640422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d247d485-6d2d-4fbd-9b86-cacecfbabeb8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.174856 May 23 14:04:48.641127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1751/3578] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:49.659743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-044fe98c-847f-4592-87a7-0262fb41220d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:49.660456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-044fe98c-847f-4592-87a7-0262fb41220d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:49.667045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-044fe98c-847f-4592-87a7-0262fb41220d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:49.667539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-044fe98c-847f-4592-87a7-0262fb41220d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:49.668311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-044fe98c-847f-4592-87a7-0262fb41220d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:49.668786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-044fe98c-847f-4592-87a7-0262fb41220d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:49.807774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-044fe98c-847f-4592-87a7-0262fb41220d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:49.816309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-044fe98c-847f-4592-87a7-0262fb41220d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161182 May 23 14:04:49.816910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1828/3579] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:50.834573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5e2c9aa-56ee-4349-b773-10fdf74824dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:50.835192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5e2c9aa-56ee-4349-b773-10fdf74824dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:50.843904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5e2c9aa-56ee-4349-b773-10fdf74824dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:50.844358 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5e2c9aa-56ee-4349-b773-10fdf74824dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:50.845167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5e2c9aa-56ee-4349-b773-10fdf74824dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:50.845632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5e2c9aa-56ee-4349-b773-10fdf74824dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:50.997744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5e2c9aa-56ee-4349-b773-10fdf74824dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:51.006653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5e2c9aa-56ee-4349-b773-10fdf74824dd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.176777 May 23 14:04:51.007246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1752/3580] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:52.025263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4bb093aa-e4c0-4c77-b9f7-ae594ee2fc86 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:52.025860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4bb093aa-e4c0-4c77-b9f7-ae594ee2fc86 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:52.032301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb093aa-e4c0-4c77-b9f7-ae594ee2fc86 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:52.032790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb093aa-e4c0-4c77-b9f7-ae594ee2fc86 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:52.034414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb093aa-e4c0-4c77-b9f7-ae594ee2fc86 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:52.034882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb093aa-e4c0-4c77-b9f7-ae594ee2fc86 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:52.170788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4bb093aa-e4c0-4c77-b9f7-ae594ee2fc86 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:52.179018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4bb093aa-e4c0-4c77-b9f7-ae594ee2fc86 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157691 May 23 14:04:52.179621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1829/3581] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:53.196338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e19c7e6e-b58e-4040-b38b-b3a56ac754f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:53.197084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e19c7e6e-b58e-4040-b38b-b3a56ac754f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:53.203819 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e19c7e6e-b58e-4040-b38b-b3a56ac754f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:53.204354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e19c7e6e-b58e-4040-b38b-b3a56ac754f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:53.205199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e19c7e6e-b58e-4040-b38b-b3a56ac754f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:53.205627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e19c7e6e-b58e-4040-b38b-b3a56ac754f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:53.345428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e19c7e6e-b58e-4040-b38b-b3a56ac754f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:53.358663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e19c7e6e-b58e-4040-b38b-b3a56ac754f8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166132 May 23 14:04:53.359238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1753/3582] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:54.375857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c7e10601-d4d1-4e7d-ba54-92c33afce523 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:54.376453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7e10601-d4d1-4e7d-ba54-92c33afce523 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:54.383703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7e10601-d4d1-4e7d-ba54-92c33afce523 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:54.384153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7e10601-d4d1-4e7d-ba54-92c33afce523 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:54.384946 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7e10601-d4d1-4e7d-ba54-92c33afce523 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:54.386002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7e10601-d4d1-4e7d-ba54-92c33afce523 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:54.516418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7e10601-d4d1-4e7d-ba54-92c33afce523 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:54.524924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c7e10601-d4d1-4e7d-ba54-92c33afce523 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152872 May 23 14:04:54.525511 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1830/3583] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:55.542086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e540d1fa-bf21-487e-a34b-3a5f20c7fb32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:55.542703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e540d1fa-bf21-487e-a34b-3a5f20c7fb32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:55.550345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e540d1fa-bf21-487e-a34b-3a5f20c7fb32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:55.550745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e540d1fa-bf21-487e-a34b-3a5f20c7fb32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:55.551516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e540d1fa-bf21-487e-a34b-3a5f20c7fb32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:55.551982 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e540d1fa-bf21-487e-a34b-3a5f20c7fb32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:55.695519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e540d1fa-bf21-487e-a34b-3a5f20c7fb32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:55.703752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e540d1fa-bf21-487e-a34b-3a5f20c7fb32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165561 May 23 14:04:55.704325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1754/3584] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:56.720918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b74c0f41-976e-458f-9d38-5bfb01b8b286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:56.721640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b74c0f41-976e-458f-9d38-5bfb01b8b286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:56.729211 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74c0f41-976e-458f-9d38-5bfb01b8b286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:56.729672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74c0f41-976e-458f-9d38-5bfb01b8b286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:56.730465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74c0f41-976e-458f-9d38-5bfb01b8b286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:56.730944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b74c0f41-976e-458f-9d38-5bfb01b8b286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:56.868474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b74c0f41-976e-458f-9d38-5bfb01b8b286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:56.876505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b74c0f41-976e-458f-9d38-5bfb01b8b286 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159583 May 23 14:04:56.877106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1831/3585] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:57.894614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d41a6baf-8080-414b-8cbd-745e0b25c2d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:57.895338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d41a6baf-8080-414b-8cbd-745e0b25c2d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:57.901824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d41a6baf-8080-414b-8cbd-745e0b25c2d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:57.902276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d41a6baf-8080-414b-8cbd-745e0b25c2d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:57.903035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d41a6baf-8080-414b-8cbd-745e0b25c2d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:57.903471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d41a6baf-8080-414b-8cbd-745e0b25c2d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:58.031927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d41a6baf-8080-414b-8cbd-745e0b25c2d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:58.041326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d41a6baf-8080-414b-8cbd-745e0b25c2d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151172 May 23 14:04:58.041892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1755/3586] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:04:59.058595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d5015528-3843-438c-9dae-bb78f02da4cd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:04:59.059213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d5015528-3843-438c-9dae-bb78f02da4cd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:04:59.066707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5015528-3843-438c-9dae-bb78f02da4cd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:59.067152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5015528-3843-438c-9dae-bb78f02da4cd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:59.067919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5015528-3843-438c-9dae-bb78f02da4cd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:04:59.068355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d5015528-3843-438c-9dae-bb78f02da4cd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:04:59.201309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d5015528-3843-438c-9dae-bb78f02da4cd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:04:59.210473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d5015528-3843-438c-9dae-bb78f02da4cd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155650 May 23 14:04:59.211047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1832/3587] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:04:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:00.231070 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e166b416-6742-4e28-8ea1-17dcf44030db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:00.231683 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e166b416-6742-4e28-8ea1-17dcf44030db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:00.238229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e166b416-6742-4e28-8ea1-17dcf44030db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:00.239158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e166b416-6742-4e28-8ea1-17dcf44030db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:00.239970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e166b416-6742-4e28-8ea1-17dcf44030db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:00.240410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e166b416-6742-4e28-8ea1-17dcf44030db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:00.370811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e166b416-6742-4e28-8ea1-17dcf44030db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:00.379669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e166b416-6742-4e28-8ea1-17dcf44030db tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152696 May 23 14:05:00.380244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1756/3588] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:01.396837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-96923c72-0867-4f17-92f9-d2401e47ee4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:01.397682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-96923c72-0867-4f17-92f9-d2401e47ee4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:01.403973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96923c72-0867-4f17-92f9-d2401e47ee4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:01.404425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96923c72-0867-4f17-92f9-d2401e47ee4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:01.405233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96923c72-0867-4f17-92f9-d2401e47ee4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:01.405674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-96923c72-0867-4f17-92f9-d2401e47ee4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:01.537117 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-96923c72-0867-4f17-92f9-d2401e47ee4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:01.545116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-96923c72-0867-4f17-92f9-d2401e47ee4a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152227 May 23 14:05:01.545775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1833/3589] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:02.516249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:05:02.516949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:05:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:05:02.562959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d12826ee-bb6e-4ee7-8fe4-e1f60c68b77f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:02.563569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d12826ee-bb6e-4ee7-8fe4-e1f60c68b77f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:02.570754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d12826ee-bb6e-4ee7-8fe4-e1f60c68b77f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:02.571198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d12826ee-bb6e-4ee7-8fe4-e1f60c68b77f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:02.571950 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d12826ee-bb6e-4ee7-8fe4-e1f60c68b77f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:02.572385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d12826ee-bb6e-4ee7-8fe4-e1f60c68b77f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:02.574937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=79 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:05:02.706899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d12826ee-bb6e-4ee7-8fe4-e1f60c68b77f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:02.715041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d12826ee-bb6e-4ee7-8fe4-e1f60c68b77f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156190 May 23 14:05:02.715610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1757/3590] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:03.732059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2090e0c2-b0e5-433d-beb5-5b0b7a4f670f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:03.732701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2090e0c2-b0e5-433d-beb5-5b0b7a4f670f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:03.739216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2090e0c2-b0e5-433d-beb5-5b0b7a4f670f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:03.739667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2090e0c2-b0e5-433d-beb5-5b0b7a4f670f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:03.740438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2090e0c2-b0e5-433d-beb5-5b0b7a4f670f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:03.740925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2090e0c2-b0e5-433d-beb5-5b0b7a4f670f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:03.744111 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=79 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:05:03.877282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2090e0c2-b0e5-433d-beb5-5b0b7a4f670f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:03.886577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2090e0c2-b0e5-433d-beb5-5b0b7a4f670f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158331 May 23 14:05:03.887147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1834/3591] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:04.904277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72d58acc-3f97-4a91-a09a-027bee92dbbd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:04.904907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72d58acc-3f97-4a91-a09a-027bee92dbbd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:04.911323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72d58acc-3f97-4a91-a09a-027bee92dbbd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:04.911875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72d58acc-3f97-4a91-a09a-027bee92dbbd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:04.912507 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72d58acc-3f97-4a91-a09a-027bee92dbbd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:04.912966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72d58acc-3f97-4a91-a09a-027bee92dbbd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:05.051924 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72d58acc-3f97-4a91-a09a-027bee92dbbd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:05.060754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72d58acc-3f97-4a91-a09a-027bee92dbbd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160362 May 23 14:05:05.061326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1758/3592] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:06.077861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f01d2ed-e3d7-43be-b0fa-11e415852fed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:06.078980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f01d2ed-e3d7-43be-b0fa-11e415852fed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:06.085322 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f01d2ed-e3d7-43be-b0fa-11e415852fed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:06.085779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f01d2ed-e3d7-43be-b0fa-11e415852fed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:06.087197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f01d2ed-e3d7-43be-b0fa-11e415852fed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:06.087648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f01d2ed-e3d7-43be-b0fa-11e415852fed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:06.220854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f01d2ed-e3d7-43be-b0fa-11e415852fed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:06.229674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f01d2ed-e3d7-43be-b0fa-11e415852fed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155730 May 23 14:05:06.230247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1835/3593] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:05:07.247782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06ce5c40-d3ca-410b-a5b4-8c1fe93e1a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:07.248397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06ce5c40-d3ca-410b-a5b4-8c1fe93e1a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:07.255007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06ce5c40-d3ca-410b-a5b4-8c1fe93e1a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:07.255458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06ce5c40-d3ca-410b-a5b4-8c1fe93e1a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:07.256225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06ce5c40-d3ca-410b-a5b4-8c1fe93e1a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:07.256696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06ce5c40-d3ca-410b-a5b4-8c1fe93e1a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:07.389442 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06ce5c40-d3ca-410b-a5b4-8c1fe93e1a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:07.398873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06ce5c40-d3ca-410b-a5b4-8c1fe93e1a0d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156062 May 23 14:05:07.399447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1759/3594] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:08.417561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f02ef5f-aebd-44ae-9b47-da64eb9a2781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:08.418177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f02ef5f-aebd-44ae-9b47-da64eb9a2781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:08.420481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:05:08.425387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f02ef5f-aebd-44ae-9b47-da64eb9a2781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:08.425842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f02ef5f-aebd-44ae-9b47-da64eb9a2781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:08.426615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f02ef5f-aebd-44ae-9b47-da64eb9a2781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:08.427057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f02ef5f-aebd-44ae-9b47-da64eb9a2781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:08.561218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f02ef5f-aebd-44ae-9b47-da64eb9a2781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:08.569357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f02ef5f-aebd-44ae-9b47-da64eb9a2781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156663 May 23 14:05:08.569923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1836/3595] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:09.587328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4db06675-774b-4798-a5da-db84a8e70895 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:09.587898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4db06675-774b-4798-a5da-db84a8e70895 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:09.590255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:05:09.595303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db06675-774b-4798-a5da-db84a8e70895 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:09.595802 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db06675-774b-4798-a5da-db84a8e70895 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:09.596584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db06675-774b-4798-a5da-db84a8e70895 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:09.597028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4db06675-774b-4798-a5da-db84a8e70895 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:09.733926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4db06675-774b-4798-a5da-db84a8e70895 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:09.741987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4db06675-774b-4798-a5da-db84a8e70895 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158614 May 23 14:05:09.742552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1760/3596] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:10.760253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2f3527d-a228-4ae7-9473-da8b484e4ca6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:10.760906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f2f3527d-a228-4ae7-9473-da8b484e4ca6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:10.768154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2f3527d-a228-4ae7-9473-da8b484e4ca6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:10.768643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2f3527d-a228-4ae7-9473-da8b484e4ca6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:10.769416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2f3527d-a228-4ae7-9473-da8b484e4ca6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:10.769858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2f3527d-a228-4ae7-9473-da8b484e4ca6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:10.897921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f2f3527d-a228-4ae7-9473-da8b484e4ca6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:10.906545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2f3527d-a228-4ae7-9473-da8b484e4ca6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.150180 May 23 14:05:10.907088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1837/3597] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:11.924536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f4aafd9-a906-4643-bf77-f05d8a835cbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:11.925191 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f4aafd9-a906-4643-bf77-f05d8a835cbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:11.931653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f4aafd9-a906-4643-bf77-f05d8a835cbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:11.932103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f4aafd9-a906-4643-bf77-f05d8a835cbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:11.932885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f4aafd9-a906-4643-bf77-f05d8a835cbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:11.933331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f4aafd9-a906-4643-bf77-f05d8a835cbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:12.069260 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f4aafd9-a906-4643-bf77-f05d8a835cbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:12.078060 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f4aafd9-a906-4643-bf77-f05d8a835cbc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158348 May 23 14:05:12.078632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1761/3598] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:12.514840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:05:12.515051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:05:13.096018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a199facd-0bcd-4eb5-a2e5-dd3a3fb5d1ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:13.096639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a199facd-0bcd-4eb5-a2e5-dd3a3fb5d1ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:13.103116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a199facd-0bcd-4eb5-a2e5-dd3a3fb5d1ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:13.103563 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a199facd-0bcd-4eb5-a2e5-dd3a3fb5d1ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:13.104321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a199facd-0bcd-4eb5-a2e5-dd3a3fb5d1ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:13.104801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a199facd-0bcd-4eb5-a2e5-dd3a3fb5d1ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:13.246833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a199facd-0bcd-4eb5-a2e5-dd3a3fb5d1ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:13.255448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a199facd-0bcd-4eb5-a2e5-dd3a3fb5d1ad tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164308 May 23 14:05:13.256015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1838/3599] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:14.272189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-399ad767-817f-4cf9-b194-254adf49d31a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:14.272903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-399ad767-817f-4cf9-b194-254adf49d31a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:14.280517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-399ad767-817f-4cf9-b194-254adf49d31a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:14.281040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-399ad767-817f-4cf9-b194-254adf49d31a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:14.281837 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-399ad767-817f-4cf9-b194-254adf49d31a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:14.282367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-399ad767-817f-4cf9-b194-254adf49d31a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:14.414893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-399ad767-817f-4cf9-b194-254adf49d31a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:14.424130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-399ad767-817f-4cf9-b194-254adf49d31a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155863 May 23 14:05:14.424708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1762/3600] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:15.443670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9bb8c6a-8a51-405e-8ce6-f054b0b0bb4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:15.444266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9bb8c6a-8a51-405e-8ce6-f054b0b0bb4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:15.450373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9bb8c6a-8a51-405e-8ce6-f054b0b0bb4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:15.450886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9bb8c6a-8a51-405e-8ce6-f054b0b0bb4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:15.451787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9bb8c6a-8a51-405e-8ce6-f054b0b0bb4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:15.452246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9bb8c6a-8a51-405e-8ce6-f054b0b0bb4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:15.585709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9bb8c6a-8a51-405e-8ce6-f054b0b0bb4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:15.594063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9bb8c6a-8a51-405e-8ce6-f054b0b0bb4f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155822 May 23 14:05:15.594629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1839/3601] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:16.614227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c813c0c3-d069-461f-8c78-1fb7674b8a85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:16.614822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c813c0c3-d069-461f-8c78-1fb7674b8a85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:16.621682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c813c0c3-d069-461f-8c78-1fb7674b8a85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:16.622141 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c813c0c3-d069-461f-8c78-1fb7674b8a85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:16.622933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c813c0c3-d069-461f-8c78-1fb7674b8a85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:16.623370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c813c0c3-d069-461f-8c78-1fb7674b8a85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:16.756653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c813c0c3-d069-461f-8c78-1fb7674b8a85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:16.765145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c813c0c3-d069-461f-8c78-1fb7674b8a85 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154378 May 23 14:05:16.773420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1763/3602] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:16 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:17.784377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc04a6ab-6a80-45ea-821f-e012849680ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:17.785033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc04a6ab-6a80-45ea-821f-e012849680ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:17.791528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc04a6ab-6a80-45ea-821f-e012849680ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:17.791986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc04a6ab-6a80-45ea-821f-e012849680ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:17.792791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc04a6ab-6a80-45ea-821f-e012849680ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:17.793235 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc04a6ab-6a80-45ea-821f-e012849680ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:17.926685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dc04a6ab-6a80-45ea-821f-e012849680ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:17.934661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc04a6ab-6a80-45ea-821f-e012849680ef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155092 May 23 14:05:17.935461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1840/3603] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:18.951899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-85463ae7-c5f3-4dc9-abf8-534302fb588d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:18.952505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-85463ae7-c5f3-4dc9-abf8-534302fb588d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:18.959583 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85463ae7-c5f3-4dc9-abf8-534302fb588d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:18.960029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85463ae7-c5f3-4dc9-abf8-534302fb588d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:18.960828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85463ae7-c5f3-4dc9-abf8-534302fb588d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:18.961264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85463ae7-c5f3-4dc9-abf8-534302fb588d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:19.093752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85463ae7-c5f3-4dc9-abf8-534302fb588d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:19.102553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-85463ae7-c5f3-4dc9-abf8-534302fb588d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154502 May 23 14:05:19.103118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1764/3604] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:20.119712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-19e6cc6e-fada-4160-8f40-8a6f615853ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:20.120334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-19e6cc6e-fada-4160-8f40-8a6f615853ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:20.126955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19e6cc6e-fada-4160-8f40-8a6f615853ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:20.127408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19e6cc6e-fada-4160-8f40-8a6f615853ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:20.128838 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19e6cc6e-fada-4160-8f40-8a6f615853ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:20.129285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19e6cc6e-fada-4160-8f40-8a6f615853ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:20.272339 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-19e6cc6e-fada-4160-8f40-8a6f615853ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:20.280216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-19e6cc6e-fada-4160-8f40-8a6f615853ff tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164421 May 23 14:05:20.280806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1841/3605] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:21.296816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae51d709-d2b1-4d40-80ed-6892b5bc8ba7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:21.297440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae51d709-d2b1-4d40-80ed-6892b5bc8ba7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:21.304782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae51d709-d2b1-4d40-80ed-6892b5bc8ba7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:21.305238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae51d709-d2b1-4d40-80ed-6892b5bc8ba7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:21.306005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae51d709-d2b1-4d40-80ed-6892b5bc8ba7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:21.306440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae51d709-d2b1-4d40-80ed-6892b5bc8ba7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:21.444379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae51d709-d2b1-4d40-80ed-6892b5bc8ba7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:21.452405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae51d709-d2b1-4d40-80ed-6892b5bc8ba7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159456 May 23 14:05:21.452994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1765/3606] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:22.469737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4aae4cbd-dba2-4c7f-922f-a85055dfc177 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:22.470355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4aae4cbd-dba2-4c7f-922f-a85055dfc177 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:22.477371 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4aae4cbd-dba2-4c7f-922f-a85055dfc177 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:22.477824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4aae4cbd-dba2-4c7f-922f-a85055dfc177 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:22.478591 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4aae4cbd-dba2-4c7f-922f-a85055dfc177 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:22.479030 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4aae4cbd-dba2-4c7f-922f-a85055dfc177 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:22.610149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4aae4cbd-dba2-4c7f-922f-a85055dfc177 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:22.618627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4aae4cbd-dba2-4c7f-922f-a85055dfc177 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152787 May 23 14:05:22.619624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1842/3607] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:23.641748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-49e2f726-8fd3-4101-9ffd-0aae1b151592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:23.643321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-49e2f726-8fd3-4101-9ffd-0aae1b151592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:23.654183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49e2f726-8fd3-4101-9ffd-0aae1b151592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:23.654879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49e2f726-8fd3-4101-9ffd-0aae1b151592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:23.655496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49e2f726-8fd3-4101-9ffd-0aae1b151592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:23.655932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49e2f726-8fd3-4101-9ffd-0aae1b151592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:23.803581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49e2f726-8fd3-4101-9ffd-0aae1b151592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:23.811599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-49e2f726-8fd3-4101-9ffd-0aae1b151592 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.173820 May 23 14:05:23.812159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1766/3608] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:24.827988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eef96b9d-a0fd-4bd7-8d77-2124208d5721 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:24.828639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eef96b9d-a0fd-4bd7-8d77-2124208d5721 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:24.835575 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eef96b9d-a0fd-4bd7-8d77-2124208d5721 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:24.836034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eef96b9d-a0fd-4bd7-8d77-2124208d5721 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:24.836915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eef96b9d-a0fd-4bd7-8d77-2124208d5721 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:24.837353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eef96b9d-a0fd-4bd7-8d77-2124208d5721 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:24.971148 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eef96b9d-a0fd-4bd7-8d77-2124208d5721 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:24.979500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eef96b9d-a0fd-4bd7-8d77-2124208d5721 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155261 May 23 14:05:24.980078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1843/3609] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:25.996639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-86623151-c7d1-4087-a8cf-05e22f6677fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:25.997257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-86623151-c7d1-4087-a8cf-05e22f6677fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:26.003740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86623151-c7d1-4087-a8cf-05e22f6677fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:26.004198 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86623151-c7d1-4087-a8cf-05e22f6677fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:26.011850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86623151-c7d1-4087-a8cf-05e22f6677fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:26.011850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86623151-c7d1-4087-a8cf-05e22f6677fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:26.140398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-86623151-c7d1-4087-a8cf-05e22f6677fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:26.144597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-86623151-c7d1-4087-a8cf-05e22f6677fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151966 May 23 14:05:26.145162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1767/3610] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:05:27.163674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-42d19873-aa52-4e58-9b68-c42f96ca8466 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:27.164318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-42d19873-aa52-4e58-9b68-c42f96ca8466 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:27.170811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42d19873-aa52-4e58-9b68-c42f96ca8466 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:27.171259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42d19873-aa52-4e58-9b68-c42f96ca8466 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:27.172022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42d19873-aa52-4e58-9b68-c42f96ca8466 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:27.172460 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42d19873-aa52-4e58-9b68-c42f96ca8466 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:27.302808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42d19873-aa52-4e58-9b68-c42f96ca8466 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:27.310887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-42d19873-aa52-4e58-9b68-c42f96ca8466 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151893 May 23 14:05:27.311462 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1844/3611] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:28.329798 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31c25ac1-f40d-448f-91c1-ee644040ac90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:28.330414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31c25ac1-f40d-448f-91c1-ee644040ac90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:28.337590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31c25ac1-f40d-448f-91c1-ee644040ac90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:28.338048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31c25ac1-f40d-448f-91c1-ee644040ac90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:28.338832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31c25ac1-f40d-448f-91c1-ee644040ac90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:28.339277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31c25ac1-f40d-448f-91c1-ee644040ac90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:28.471778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31c25ac1-f40d-448f-91c1-ee644040ac90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:28.480636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31c25ac1-f40d-448f-91c1-ee644040ac90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154713 May 23 14:05:28.481205 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1768/3612] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:29.498391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b8f3fa59-38a7-404b-baba-17cdbe505782 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:29.498983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b8f3fa59-38a7-404b-baba-17cdbe505782 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:29.505354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8f3fa59-38a7-404b-baba-17cdbe505782 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:29.506479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8f3fa59-38a7-404b-baba-17cdbe505782 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:29.507502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8f3fa59-38a7-404b-baba-17cdbe505782 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:29.507965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8f3fa59-38a7-404b-baba-17cdbe505782 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:29.649181 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b8f3fa59-38a7-404b-baba-17cdbe505782 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:29.657270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b8f3fa59-38a7-404b-baba-17cdbe505782 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.162814 May 23 14:05:29.657841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1845/3613] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:30.675390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a185f9c0-72da-455d-b883-56b2d2b89781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:30.676015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a185f9c0-72da-455d-b883-56b2d2b89781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:30.682359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a185f9c0-72da-455d-b883-56b2d2b89781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:30.682814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a185f9c0-72da-455d-b883-56b2d2b89781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:30.683571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a185f9c0-72da-455d-b883-56b2d2b89781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:30.684013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a185f9c0-72da-455d-b883-56b2d2b89781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:30.815769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a185f9c0-72da-455d-b883-56b2d2b89781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:30.824914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a185f9c0-72da-455d-b883-56b2d2b89781 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153504 May 23 14:05:30.825490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1769/3614] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:31.841933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2a792c79-0c75-4a6e-a1ea-cafcb40ac87b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:31.842546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2a792c79-0c75-4a6e-a1ea-cafcb40ac87b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:31.848969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a792c79-0c75-4a6e-a1ea-cafcb40ac87b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:31.849413 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a792c79-0c75-4a6e-a1ea-cafcb40ac87b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:31.850169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a792c79-0c75-4a6e-a1ea-cafcb40ac87b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:31.850606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a792c79-0c75-4a6e-a1ea-cafcb40ac87b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:31.933733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ffb31cc1-6596-4f9f-8b94-4ccf49fe6ac2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:31.934232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ffb31cc1-6596-4f9f-8b94-4ccf49fe6ac2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:31.941204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffb31cc1-6596-4f9f-8b94-4ccf49fe6ac2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:31.941654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffb31cc1-6596-4f9f-8b94-4ccf49fe6ac2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:31.942455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffb31cc1-6596-4f9f-8b94-4ccf49fe6ac2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:31.942938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffb31cc1-6596-4f9f-8b94-4ccf49fe6ac2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:31.966926 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ffb31cc1-6596-4f9f-8b94-4ccf49fe6ac2 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef/ips" status: 200 len: 143 microversion: 2.1 time: 0.037147 May 23 14:05:31.967642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1770/3615] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 14:05:31 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef/ips => generated 143 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:05:31.986027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2a792c79-0c75-4a6e-a1ea-cafcb40ac87b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:31.994930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2a792c79-0c75-4a6e-a1ea-cafcb40ac87b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156778 May 23 14:05:31.995501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1846/3616] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:05:33.014700 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8395ce70-0c45-4a53-93a0-aa383dd3c9b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:33.015925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8395ce70-0c45-4a53-93a0-aa383dd3c9b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:33.023097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8395ce70-0c45-4a53-93a0-aa383dd3c9b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:33.023608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8395ce70-0c45-4a53-93a0-aa383dd3c9b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:33.024372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8395ce70-0c45-4a53-93a0-aa383dd3c9b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:33.025500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8395ce70-0c45-4a53-93a0-aa383dd3c9b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:33.029627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=82 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:05:33.156379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8395ce70-0c45-4a53-93a0-aa383dd3c9b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:33.164307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8395ce70-0c45-4a53-93a0-aa383dd3c9b6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155980 May 23 14:05:33.164907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1771/3617] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:34.181960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-42a9cf20-c3a7-4f6d-8bbd-ca598211ab69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:34.183009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-42a9cf20-c3a7-4f6d-8bbd-ca598211ab69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:34.189736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42a9cf20-c3a7-4f6d-8bbd-ca598211ab69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:34.190186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42a9cf20-c3a7-4f6d-8bbd-ca598211ab69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:34.190960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42a9cf20-c3a7-4f6d-8bbd-ca598211ab69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:34.191400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-42a9cf20-c3a7-4f6d-8bbd-ca598211ab69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:34.196253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:05:34.323801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-42a9cf20-c3a7-4f6d-8bbd-ca598211ab69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:34.331881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-42a9cf20-c3a7-4f6d-8bbd-ca598211ab69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154471 May 23 14:05:34.332455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1847/3618] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:35.350469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3bbd927a-3829-451e-bd83-3d56c82f96ac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:35.351062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3bbd927a-3829-451e-bd83-3d56c82f96ac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:35.357809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bbd927a-3829-451e-bd83-3d56c82f96ac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:35.358263 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bbd927a-3829-451e-bd83-3d56c82f96ac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:35.359067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bbd927a-3829-451e-bd83-3d56c82f96ac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:35.359508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bbd927a-3829-451e-bd83-3d56c82f96ac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:35.507664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3bbd927a-3829-451e-bd83-3d56c82f96ac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:35.515908 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3bbd927a-3829-451e-bd83-3d56c82f96ac tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.169883 May 23 14:05:35.516482 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1772/3619] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:36.534312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-54b97c9f-c845-4e2d-bc94-c485c19ea405 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:36.534988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-54b97c9f-c845-4e2d-bc94-c485c19ea405 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:36.541670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54b97c9f-c845-4e2d-bc94-c485c19ea405 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:36.542124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54b97c9f-c845-4e2d-bc94-c485c19ea405 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:36.542902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54b97c9f-c845-4e2d-bc94-c485c19ea405 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:36.543342 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54b97c9f-c845-4e2d-bc94-c485c19ea405 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:36.678498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54b97c9f-c845-4e2d-bc94-c485c19ea405 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:36.686611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-54b97c9f-c845-4e2d-bc94-c485c19ea405 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156138 May 23 14:05:36.687193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1848/3620] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:37.708145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d358f37a-326c-404f-a0e1-bf3202dbe6b7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:37.709843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d358f37a-326c-404f-a0e1-bf3202dbe6b7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:37.720637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d358f37a-326c-404f-a0e1-bf3202dbe6b7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:37.721093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d358f37a-326c-404f-a0e1-bf3202dbe6b7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:37.721869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d358f37a-326c-404f-a0e1-bf3202dbe6b7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:37.722391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d358f37a-326c-404f-a0e1-bf3202dbe6b7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:37.862602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d358f37a-326c-404f-a0e1-bf3202dbe6b7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:37.871227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d358f37a-326c-404f-a0e1-bf3202dbe6b7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.169784 May 23 14:05:37.871813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1773/3621] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:38.888173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7647dd78-4820-4086-a0f4-4350ecee1e8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:38.888831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7647dd78-4820-4086-a0f4-4350ecee1e8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:38.891187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:05:38.896208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7647dd78-4820-4086-a0f4-4350ecee1e8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:38.896697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7647dd78-4820-4086-a0f4-4350ecee1e8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:38.897797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7647dd78-4820-4086-a0f4-4350ecee1e8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:38.898240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7647dd78-4820-4086-a0f4-4350ecee1e8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:39.051677 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7647dd78-4820-4086-a0f4-4350ecee1e8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:39.061078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7647dd78-4820-4086-a0f4-4350ecee1e8b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.176863 May 23 14:05:39.061674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1849/3622] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:40.079879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b10c4a1-9662-4fd1-94c4-c894b2489d32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:40.081032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b10c4a1-9662-4fd1-94c4-c894b2489d32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:40.085035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:05:40.094577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b10c4a1-9662-4fd1-94c4-c894b2489d32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:40.094577 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b10c4a1-9662-4fd1-94c4-c894b2489d32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:40.095339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b10c4a1-9662-4fd1-94c4-c894b2489d32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:40.095793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b10c4a1-9662-4fd1-94c4-c894b2489d32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:40.247371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b10c4a1-9662-4fd1-94c4-c894b2489d32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:40.255962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b10c4a1-9662-4fd1-94c4-c894b2489d32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.181127 May 23 14:05:40.256749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1774/3623] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:41.275565 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45667d0d-4376-4679-b6af-a5aed2c6078a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:41.276171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-45667d0d-4376-4679-b6af-a5aed2c6078a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:41.282725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45667d0d-4376-4679-b6af-a5aed2c6078a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:41.283185 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45667d0d-4376-4679-b6af-a5aed2c6078a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:41.283952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45667d0d-4376-4679-b6af-a5aed2c6078a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:41.284396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45667d0d-4376-4679-b6af-a5aed2c6078a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:41.430502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-45667d0d-4376-4679-b6af-a5aed2c6078a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:41.438963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45667d0d-4376-4679-b6af-a5aed2c6078a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.168223 May 23 14:05:41.439467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1850/3624] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:42.456677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c8819105-e6e1-4d7d-b53a-ea37536e0e07 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:42.457308 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c8819105-e6e1-4d7d-b53a-ea37536e0e07 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:42.463947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8819105-e6e1-4d7d-b53a-ea37536e0e07 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:42.464391 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8819105-e6e1-4d7d-b53a-ea37536e0e07 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:42.465170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8819105-e6e1-4d7d-b53a-ea37536e0e07 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:42.465602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8819105-e6e1-4d7d-b53a-ea37536e0e07 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:42.597998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8819105-e6e1-4d7d-b53a-ea37536e0e07 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:42.606886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c8819105-e6e1-4d7d-b53a-ea37536e0e07 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153966 May 23 14:05:42.607462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1775/3625] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:43.625114 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-315eb372-770b-4769-8739-7e2ef60cfa23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:43.625764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-315eb372-770b-4769-8739-7e2ef60cfa23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:43.633717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-315eb372-770b-4769-8739-7e2ef60cfa23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:43.634175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-315eb372-770b-4769-8739-7e2ef60cfa23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:43.634958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-315eb372-770b-4769-8739-7e2ef60cfa23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:43.635401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-315eb372-770b-4769-8739-7e2ef60cfa23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:43.782853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-315eb372-770b-4769-8739-7e2ef60cfa23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:43.791797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-315eb372-770b-4769-8739-7e2ef60cfa23 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.170532 May 23 14:05:43.792402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1851/3626] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:44.809747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-616fa077-7b10-4499-8976-81a6357f9ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:44.810345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-616fa077-7b10-4499-8976-81a6357f9ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:44.817153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-616fa077-7b10-4499-8976-81a6357f9ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:44.817611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-616fa077-7b10-4499-8976-81a6357f9ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:44.818366 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-616fa077-7b10-4499-8976-81a6357f9ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:44.818803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-616fa077-7b10-4499-8976-81a6357f9ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:44.951039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-616fa077-7b10-4499-8976-81a6357f9ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:44.959216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-616fa077-7b10-4499-8976-81a6357f9ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153913 May 23 14:05:44.959788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1776/3627] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:45.976331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2a85be7a-9ae7-4bfb-b2a3-60eacb7bacbb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:45.977613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2a85be7a-9ae7-4bfb-b2a3-60eacb7bacbb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:45.984416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a85be7a-9ae7-4bfb-b2a3-60eacb7bacbb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:45.984904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a85be7a-9ae7-4bfb-b2a3-60eacb7bacbb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:45.985690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a85be7a-9ae7-4bfb-b2a3-60eacb7bacbb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:45.986136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2a85be7a-9ae7-4bfb-b2a3-60eacb7bacbb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:46.123603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2a85be7a-9ae7-4bfb-b2a3-60eacb7bacbb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:46.132123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2a85be7a-9ae7-4bfb-b2a3-60eacb7bacbb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159703 May 23 14:05:46.132737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1852/3628] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:47.150031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9f3078d9-2ea2-4b48-a5af-e58f9913dd90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:47.150653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9f3078d9-2ea2-4b48-a5af-e58f9913dd90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:47.157396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f3078d9-2ea2-4b48-a5af-e58f9913dd90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:47.157847 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f3078d9-2ea2-4b48-a5af-e58f9913dd90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:47.158644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f3078d9-2ea2-4b48-a5af-e58f9913dd90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:47.159068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9f3078d9-2ea2-4b48-a5af-e58f9913dd90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:47.303118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9f3078d9-2ea2-4b48-a5af-e58f9913dd90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:47.312340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9f3078d9-2ea2-4b48-a5af-e58f9913dd90 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166378 May 23 14:05:47.312998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1777/3629] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:48.339295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-11d9e8f7-4e46-45ad-866c-5ae39061fd0b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:48.339981 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-11d9e8f7-4e46-45ad-866c-5ae39061fd0b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:48.347782 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11d9e8f7-4e46-45ad-866c-5ae39061fd0b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:48.348378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11d9e8f7-4e46-45ad-866c-5ae39061fd0b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:48.349329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11d9e8f7-4e46-45ad-866c-5ae39061fd0b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:48.349776 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11d9e8f7-4e46-45ad-866c-5ae39061fd0b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:48.491020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-11d9e8f7-4e46-45ad-866c-5ae39061fd0b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:48.500594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-11d9e8f7-4e46-45ad-866c-5ae39061fd0b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166976 May 23 14:05:48.501180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1853/3630] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:49.520235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a11ad1f5-88af-428a-875f-597653089ca2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:49.520975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a11ad1f5-88af-428a-875f-597653089ca2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:49.528173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a11ad1f5-88af-428a-875f-597653089ca2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:49.528644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a11ad1f5-88af-428a-875f-597653089ca2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:49.529429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a11ad1f5-88af-428a-875f-597653089ca2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:49.529902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a11ad1f5-88af-428a-875f-597653089ca2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:49.668670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a11ad1f5-88af-428a-875f-597653089ca2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:49.676917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a11ad1f5-88af-428a-875f-597653089ca2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161862 May 23 14:05:49.677491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1778/3631] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:50.694779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc9a33e0-eb93-4f2c-8447-fd8f94b518a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:50.695410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc9a33e0-eb93-4f2c-8447-fd8f94b518a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:50.704341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc9a33e0-eb93-4f2c-8447-fd8f94b518a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:50.704833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc9a33e0-eb93-4f2c-8447-fd8f94b518a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:50.705630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc9a33e0-eb93-4f2c-8447-fd8f94b518a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:50.706072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc9a33e0-eb93-4f2c-8447-fd8f94b518a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:50.951241 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc9a33e0-eb93-4f2c-8447-fd8f94b518a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:50.959604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc9a33e0-eb93-4f2c-8447-fd8f94b518a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.269027 May 23 14:05:50.960223 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1854/3632] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:51.981516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e77a6ea4-b91d-4704-9e71-ea1a32601bea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:51.982128 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e77a6ea4-b91d-4704-9e71-ea1a32601bea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:51.988921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77a6ea4-b91d-4704-9e71-ea1a32601bea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:51.989379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77a6ea4-b91d-4704-9e71-ea1a32601bea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:51.990161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77a6ea4-b91d-4704-9e71-ea1a32601bea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:51.990597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77a6ea4-b91d-4704-9e71-ea1a32601bea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:52.128695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e77a6ea4-b91d-4704-9e71-ea1a32601bea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:52.137536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e77a6ea4-b91d-4704-9e71-ea1a32601bea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160516 May 23 14:05:52.138104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1779/3633] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:53.154893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ceb10a20-3ca9-411d-9d48-24d30f16b170 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:53.155515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ceb10a20-3ca9-411d-9d48-24d30f16b170 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:53.162113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceb10a20-3ca9-411d-9d48-24d30f16b170 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:53.162571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceb10a20-3ca9-411d-9d48-24d30f16b170 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:53.163335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceb10a20-3ca9-411d-9d48-24d30f16b170 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:53.163777 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ceb10a20-3ca9-411d-9d48-24d30f16b170 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:53.298872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ceb10a20-3ca9-411d-9d48-24d30f16b170 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:53.307621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ceb10a20-3ca9-411d-9d48-24d30f16b170 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156504 May 23 14:05:53.308203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1855/3634] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:54.325673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ded20ef2-e1d4-438c-a4e0-f8f2e813e5ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:54.326345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ded20ef2-e1d4-438c-a4e0-f8f2e813e5ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:54.333097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ded20ef2-e1d4-438c-a4e0-f8f2e813e5ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:54.333573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ded20ef2-e1d4-438c-a4e0-f8f2e813e5ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:54.334324 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ded20ef2-e1d4-438c-a4e0-f8f2e813e5ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:54.334758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ded20ef2-e1d4-438c-a4e0-f8f2e813e5ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:54.476161 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ded20ef2-e1d4-438c-a4e0-f8f2e813e5ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:54.487832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ded20ef2-e1d4-438c-a4e0-f8f2e813e5ea tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.167358 May 23 14:05:54.488611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1780/3635] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:55.506035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-986a37cb-a506-49a3-856d-274cf88dc97a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:55.506661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-986a37cb-a506-49a3-856d-274cf88dc97a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:55.514050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-986a37cb-a506-49a3-856d-274cf88dc97a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:55.514494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-986a37cb-a506-49a3-856d-274cf88dc97a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:55.515302 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-986a37cb-a506-49a3-856d-274cf88dc97a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:55.515741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-986a37cb-a506-49a3-856d-274cf88dc97a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:55.667900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-986a37cb-a506-49a3-856d-274cf88dc97a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:55.676195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-986a37cb-a506-49a3-856d-274cf88dc97a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.174089 May 23 14:05:55.676807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1856/3636] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:56.694448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e0ed4ec-907b-49ff-a6ac-f62813057023 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:56.695097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e0ed4ec-907b-49ff-a6ac-f62813057023 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:56.702075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e0ed4ec-907b-49ff-a6ac-f62813057023 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:56.702526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e0ed4ec-907b-49ff-a6ac-f62813057023 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:56.703511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e0ed4ec-907b-49ff-a6ac-f62813057023 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:56.703953 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e0ed4ec-907b-49ff-a6ac-f62813057023 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:56.839107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e0ed4ec-907b-49ff-a6ac-f62813057023 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:56.847424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e0ed4ec-907b-49ff-a6ac-f62813057023 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157058 May 23 14:05:56.848002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1781/3637] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:57.863940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-af32bc68-be9c-47f7-a835-43d43eee1f99 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:57.864552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-af32bc68-be9c-47f7-a835-43d43eee1f99 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:57.871766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af32bc68-be9c-47f7-a835-43d43eee1f99 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:57.872217 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af32bc68-be9c-47f7-a835-43d43eee1f99 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:57.873008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af32bc68-be9c-47f7-a835-43d43eee1f99 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:57.873445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af32bc68-be9c-47f7-a835-43d43eee1f99 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:58.013312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-af32bc68-be9c-47f7-a835-43d43eee1f99 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:58.021432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-af32bc68-be9c-47f7-a835-43d43eee1f99 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161171 May 23 14:05:58.022265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1857/3638] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:05:59.043214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-293e6d45-a0a9-409e-9524-ec4ef8139a55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:05:59.043862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-293e6d45-a0a9-409e-9524-ec4ef8139a55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:05:59.050615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-293e6d45-a0a9-409e-9524-ec4ef8139a55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:59.051066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-293e6d45-a0a9-409e-9524-ec4ef8139a55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:59.051821 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-293e6d45-a0a9-409e-9524-ec4ef8139a55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:05:59.052256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-293e6d45-a0a9-409e-9524-ec4ef8139a55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:05:59.185175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-293e6d45-a0a9-409e-9524-ec4ef8139a55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:05:59.193673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-293e6d45-a0a9-409e-9524-ec4ef8139a55 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155018 May 23 14:05:59.194245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1782/3639] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:05:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:00.212017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0bc1893b-1c78-4ffc-8388-c1d9e76b02f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:00.212649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0bc1893b-1c78-4ffc-8388-c1d9e76b02f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:00.220020 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bc1893b-1c78-4ffc-8388-c1d9e76b02f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:00.220465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bc1893b-1c78-4ffc-8388-c1d9e76b02f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:00.221261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bc1893b-1c78-4ffc-8388-c1d9e76b02f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:00.221696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bc1893b-1c78-4ffc-8388-c1d9e76b02f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:00.358636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0bc1893b-1c78-4ffc-8388-c1d9e76b02f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:00.366718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0bc1893b-1c78-4ffc-8388-c1d9e76b02f4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159433 May 23 14:06:00.367291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1858/3640] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:06:01.383822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95c03422-378f-4ffe-ba15-6e81e52abd53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:01.384432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95c03422-378f-4ffe-ba15-6e81e52abd53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:01.391587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95c03422-378f-4ffe-ba15-6e81e52abd53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:01.392025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95c03422-378f-4ffe-ba15-6e81e52abd53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:01.392833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95c03422-378f-4ffe-ba15-6e81e52abd53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:01.393267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95c03422-378f-4ffe-ba15-6e81e52abd53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:01.534536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95c03422-378f-4ffe-ba15-6e81e52abd53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:01.543257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95c03422-378f-4ffe-ba15-6e81e52abd53 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.163451 May 23 14:06:01.543824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1783/3641] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:02.560966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e3eb502-d4c4-4558-9e1d-95f1cc25e354 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:02.561518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e3eb502-d4c4-4558-9e1d-95f1cc25e354 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:02.568369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e3eb502-d4c4-4558-9e1d-95f1cc25e354 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:02.568862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e3eb502-d4c4-4558-9e1d-95f1cc25e354 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:02.569634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e3eb502-d4c4-4558-9e1d-95f1cc25e354 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:02.570074 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e3eb502-d4c4-4558-9e1d-95f1cc25e354 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:02.699842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3e3eb502-d4c4-4558-9e1d-95f1cc25e354 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:02.708909 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e3eb502-d4c4-4558-9e1d-95f1cc25e354 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152007 May 23 14:06:02.709483 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1859/3642] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:03.726417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1a4016c9-db0f-4e83-a015-a5f28ae2aa35 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:03.727034 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1a4016c9-db0f-4e83-a015-a5f28ae2aa35 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:03.734305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4016c9-db0f-4e83-a015-a5f28ae2aa35 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:03.734764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4016c9-db0f-4e83-a015-a5f28ae2aa35 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:03.735527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4016c9-db0f-4e83-a015-a5f28ae2aa35 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:03.735967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1a4016c9-db0f-4e83-a015-a5f28ae2aa35 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:03.738596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:06:03.887352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1a4016c9-db0f-4e83-a015-a5f28ae2aa35 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:03.897174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1a4016c9-db0f-4e83-a015-a5f28ae2aa35 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.174600 May 23 14:06:03.897751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1784/3643] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:04.914934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9880c73-0f6e-416f-a2a9-fa2233b891a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:04.915648 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9880c73-0f6e-416f-a2a9-fa2233b891a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:04.922897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9880c73-0f6e-416f-a2a9-fa2233b891a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:04.923351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9880c73-0f6e-416f-a2a9-fa2233b891a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:04.924115 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9880c73-0f6e-416f-a2a9-fa2233b891a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:04.924586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9880c73-0f6e-416f-a2a9-fa2233b891a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:04.928510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:06:05.063760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9880c73-0f6e-416f-a2a9-fa2233b891a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:05.073070 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9880c73-0f6e-416f-a2a9-fa2233b891a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161997 May 23 14:06:05.073640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1860/3644] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:06.090253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e1119ebd-6736-45c0-b8e7-c11ecdd80a9b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:06.090843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e1119ebd-6736-45c0-b8e7-c11ecdd80a9b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:06.098526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1119ebd-6736-45c0-b8e7-c11ecdd80a9b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:06.098968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1119ebd-6736-45c0-b8e7-c11ecdd80a9b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:06.099731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1119ebd-6736-45c0-b8e7-c11ecdd80a9b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:06.100515 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1119ebd-6736-45c0-b8e7-c11ecdd80a9b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:06.233638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e1119ebd-6736-45c0-b8e7-c11ecdd80a9b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:06.241721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e1119ebd-6736-45c0-b8e7-c11ecdd80a9b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156046 May 23 14:06:06.242297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1785/3645] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:07.258775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45ef5e86-12db-4da7-9bdf-e68e95966229 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:07.259397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-45ef5e86-12db-4da7-9bdf-e68e95966229 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:07.266649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ef5e86-12db-4da7-9bdf-e68e95966229 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:07.267098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ef5e86-12db-4da7-9bdf-e68e95966229 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:07.267878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ef5e86-12db-4da7-9bdf-e68e95966229 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:07.268330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45ef5e86-12db-4da7-9bdf-e68e95966229 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:07.403844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-45ef5e86-12db-4da7-9bdf-e68e95966229 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:07.411742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45ef5e86-12db-4da7-9bdf-e68e95966229 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157100 May 23 14:06:07.412314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1861/3646] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:08.429637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-424ad2a0-1d35-4dbf-babe-f8b760009add tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:08.430195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-424ad2a0-1d35-4dbf-babe-f8b760009add tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:08.437618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-424ad2a0-1d35-4dbf-babe-f8b760009add tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:08.438076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-424ad2a0-1d35-4dbf-babe-f8b760009add tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:08.438848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-424ad2a0-1d35-4dbf-babe-f8b760009add tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:08.439291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-424ad2a0-1d35-4dbf-babe-f8b760009add tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:08.586585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-424ad2a0-1d35-4dbf-babe-f8b760009add tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:08.595021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-424ad2a0-1d35-4dbf-babe-f8b760009add tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.169261 May 23 14:06:08.595615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1786/3647] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:09.614666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a98c45b-89f2-428a-8cdf-7842a3bb02fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:09.615293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a98c45b-89f2-428a-8cdf-7842a3bb02fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:09.618930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:06:09.624497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a98c45b-89f2-428a-8cdf-7842a3bb02fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:09.624993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a98c45b-89f2-428a-8cdf-7842a3bb02fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:09.625791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a98c45b-89f2-428a-8cdf-7842a3bb02fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:09.626243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a98c45b-89f2-428a-8cdf-7842a3bb02fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:09.783506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5a98c45b-89f2-428a-8cdf-7842a3bb02fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:09.798315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a98c45b-89f2-428a-8cdf-7842a3bb02fc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.188498 May 23 14:06:09.802063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1862/3648] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:10.817698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-69c4a982-d868-4735-b246-43a98708beef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:10.818302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-69c4a982-d868-4735-b246-43a98708beef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:10.820655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:06:10.826063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c4a982-d868-4735-b246-43a98708beef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:10.826513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c4a982-d868-4735-b246-43a98708beef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:10.827274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c4a982-d868-4735-b246-43a98708beef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:10.827712 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c4a982-d868-4735-b246-43a98708beef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:10.960386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-69c4a982-d868-4735-b246-43a98708beef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:10.969405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-69c4a982-d868-4735-b246-43a98708beef tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155813 May 23 14:06:10.969986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1787/3649] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:11.986320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-257b19a0-5778-4212-a29a-12ed860fc356 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:11.986921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-257b19a0-5778-4212-a29a-12ed860fc356 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:11.994021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-257b19a0-5778-4212-a29a-12ed860fc356 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:11.994505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-257b19a0-5778-4212-a29a-12ed860fc356 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:11.995547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-257b19a0-5778-4212-a29a-12ed860fc356 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:11.995733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-257b19a0-5778-4212-a29a-12ed860fc356 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:12.130191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-257b19a0-5778-4212-a29a-12ed860fc356 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:12.138656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-257b19a0-5778-4212-a29a-12ed860fc356 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156209 May 23 14:06:12.139242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1863/3650] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:13.155738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2a69ed8-dcaf-4e2a-b850-54aa3645ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:13.156377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2a69ed8-dcaf-4e2a-b850-54aa3645ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:13.162879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2a69ed8-dcaf-4e2a-b850-54aa3645ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:13.163323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2a69ed8-dcaf-4e2a-b850-54aa3645ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:13.164067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2a69ed8-dcaf-4e2a-b850-54aa3645ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:13.164496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2a69ed8-dcaf-4e2a-b850-54aa3645ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:13.298129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2a69ed8-dcaf-4e2a-b850-54aa3645ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:13.306200 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2a69ed8-dcaf-4e2a-b850-54aa3645ae3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154510 May 23 14:06:13.306767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1788/3651] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:14.325787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-74c5b522-6eb3-4e6a-983d-689a16d542e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:14.326381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-74c5b522-6eb3-4e6a-983d-689a16d542e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:14.332910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74c5b522-6eb3-4e6a-983d-689a16d542e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:14.333365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74c5b522-6eb3-4e6a-983d-689a16d542e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:14.334119 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74c5b522-6eb3-4e6a-983d-689a16d542e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:14.334559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-74c5b522-6eb3-4e6a-983d-689a16d542e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:14.466171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-74c5b522-6eb3-4e6a-983d-689a16d542e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:14.474122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-74c5b522-6eb3-4e6a-983d-689a16d542e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153055 May 23 14:06:14.474751 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1864/3652] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:15.491295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-63b72c79-8760-4164-ac74-4f2710a5c94c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:15.491840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-63b72c79-8760-4164-ac74-4f2710a5c94c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:15.499549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63b72c79-8760-4164-ac74-4f2710a5c94c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:15.504429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63b72c79-8760-4164-ac74-4f2710a5c94c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:15.504429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63b72c79-8760-4164-ac74-4f2710a5c94c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:15.504429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63b72c79-8760-4164-ac74-4f2710a5c94c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:15.649125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-63b72c79-8760-4164-ac74-4f2710a5c94c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:15.657838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-63b72c79-8760-4164-ac74-4f2710a5c94c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.170578 May 23 14:06:15.658417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1789/3653] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:16.675948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c40a411b-595e-4fce-83c4-849cd47e0a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:16.676622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c40a411b-595e-4fce-83c4-849cd47e0a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:16.682823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c40a411b-595e-4fce-83c4-849cd47e0a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:16.683841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c40a411b-595e-4fce-83c4-849cd47e0a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:16.684836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c40a411b-595e-4fce-83c4-849cd47e0a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:16.685279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c40a411b-595e-4fce-83c4-849cd47e0a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:16.819896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c40a411b-595e-4fce-83c4-849cd47e0a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:16.828116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c40a411b-595e-4fce-83c4-849cd47e0a36 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156003 May 23 14:06:16.828715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1865/3654] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:16 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:17.845870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3d351ceb-532a-40a0-8966-7182cf9c2d69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:17.846621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3d351ceb-532a-40a0-8966-7182cf9c2d69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:17.853786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d351ceb-532a-40a0-8966-7182cf9c2d69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:17.854231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d351ceb-532a-40a0-8966-7182cf9c2d69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:17.854983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d351ceb-532a-40a0-8966-7182cf9c2d69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:17.855962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d351ceb-532a-40a0-8966-7182cf9c2d69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:17.988932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3d351ceb-532a-40a0-8966-7182cf9c2d69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:17.998259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3d351ceb-532a-40a0-8966-7182cf9c2d69 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156376 May 23 14:06:17.998839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1790/3655] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:06:19.015586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f847ba88-ebb8-45ad-bd08-6bcd848cdee2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:19.016242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f847ba88-ebb8-45ad-bd08-6bcd848cdee2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:19.023524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f847ba88-ebb8-45ad-bd08-6bcd848cdee2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:19.024011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f847ba88-ebb8-45ad-bd08-6bcd848cdee2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:19.024803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f847ba88-ebb8-45ad-bd08-6bcd848cdee2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:19.025274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f847ba88-ebb8-45ad-bd08-6bcd848cdee2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:19.157653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f847ba88-ebb8-45ad-bd08-6bcd848cdee2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:19.165526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f847ba88-ebb8-45ad-bd08-6bcd848cdee2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154126 May 23 14:06:19.166086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1866/3656] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:20.182996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-66f764c1-bb2d-4235-92c1-bd90096385d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:20.184254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-66f764c1-bb2d-4235-92c1-bd90096385d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:20.191155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66f764c1-bb2d-4235-92c1-bd90096385d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:20.191607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66f764c1-bb2d-4235-92c1-bd90096385d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:20.192662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66f764c1-bb2d-4235-92c1-bd90096385d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:20.193107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66f764c1-bb2d-4235-92c1-bd90096385d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:20.326629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-66f764c1-bb2d-4235-92c1-bd90096385d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:20.334543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-66f764c1-bb2d-4235-92c1-bd90096385d0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155744 May 23 14:06:20.335129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1791/3657] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:21.351475 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df90e6ea-8190-4af6-ab2a-fa6540a496d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:21.352084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df90e6ea-8190-4af6-ab2a-fa6540a496d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:21.359594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df90e6ea-8190-4af6-ab2a-fa6540a496d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:21.360160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df90e6ea-8190-4af6-ab2a-fa6540a496d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:21.360925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df90e6ea-8190-4af6-ab2a-fa6540a496d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:21.361330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df90e6ea-8190-4af6-ab2a-fa6540a496d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:21.493976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df90e6ea-8190-4af6-ab2a-fa6540a496d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:21.502101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df90e6ea-8190-4af6-ab2a-fa6540a496d4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154515 May 23 14:06:21.502675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1867/3658] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:22.519625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7e40c69-5301-4cd4-bc3e-c4a1a173968d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:22.520283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7e40c69-5301-4cd4-bc3e-c4a1a173968d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:22.526646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7e40c69-5301-4cd4-bc3e-c4a1a173968d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:22.527097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7e40c69-5301-4cd4-bc3e-c4a1a173968d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:22.528267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7e40c69-5301-4cd4-bc3e-c4a1a173968d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:22.528739 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7e40c69-5301-4cd4-bc3e-c4a1a173968d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:22.666517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7e40c69-5301-4cd4-bc3e-c4a1a173968d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:22.674440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7e40c69-5301-4cd4-bc3e-c4a1a173968d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159122 May 23 14:06:22.675002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1792/3659] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:23.691395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c77fb6b1-6e40-4c92-a0ac-d2c9867ebdf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:23.692054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c77fb6b1-6e40-4c92-a0ac-d2c9867ebdf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:23.698911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c77fb6b1-6e40-4c92-a0ac-d2c9867ebdf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:23.699343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c77fb6b1-6e40-4c92-a0ac-d2c9867ebdf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:23.701318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c77fb6b1-6e40-4c92-a0ac-d2c9867ebdf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:23.701771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c77fb6b1-6e40-4c92-a0ac-d2c9867ebdf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:23.841766 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c77fb6b1-6e40-4c92-a0ac-d2c9867ebdf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:23.849892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c77fb6b1-6e40-4c92-a0ac-d2c9867ebdf2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.162458 May 23 14:06:23.850454 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1868/3660] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:24.871357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9877407b-9705-4694-9790-30b9c93e9dc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:24.871975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9877407b-9705-4694-9790-30b9c93e9dc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:24.879320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9877407b-9705-4694-9790-30b9c93e9dc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:24.879782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9877407b-9705-4694-9790-30b9c93e9dc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:24.880552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9877407b-9705-4694-9790-30b9c93e9dc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:24.881018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9877407b-9705-4694-9790-30b9c93e9dc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:25.019568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9877407b-9705-4694-9790-30b9c93e9dc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:25.027766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9877407b-9705-4694-9790-30b9c93e9dc0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164994 May 23 14:06:25.028362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1793/3661] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:26.046317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-79fefa03-5263-42ae-8401-5360d848f87d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:26.046966 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-79fefa03-5263-42ae-8401-5360d848f87d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:26.053578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79fefa03-5263-42ae-8401-5360d848f87d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:26.054080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79fefa03-5263-42ae-8401-5360d848f87d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:26.054816 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79fefa03-5263-42ae-8401-5360d848f87d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:26.055255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79fefa03-5263-42ae-8401-5360d848f87d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:26.192667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-79fefa03-5263-42ae-8401-5360d848f87d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:26.200944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-79fefa03-5263-42ae-8401-5360d848f87d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159256 May 23 14:06:26.201514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1869/3662] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:27.218473 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b3987d5c-7e38-4bfb-b7ee-2b2dbf4d3774 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:27.219094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b3987d5c-7e38-4bfb-b7ee-2b2dbf4d3774 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:27.225636 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3987d5c-7e38-4bfb-b7ee-2b2dbf4d3774 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:27.226086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3987d5c-7e38-4bfb-b7ee-2b2dbf4d3774 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:27.228130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3987d5c-7e38-4bfb-b7ee-2b2dbf4d3774 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:27.228606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3987d5c-7e38-4bfb-b7ee-2b2dbf4d3774 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:27.359544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b3987d5c-7e38-4bfb-b7ee-2b2dbf4d3774 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:27.367578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b3987d5c-7e38-4bfb-b7ee-2b2dbf4d3774 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153280 May 23 14:06:27.368143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1794/3663] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:28.385381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bd640dd5-9b02-4304-9b8e-1ad6d811db10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:28.385937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bd640dd5-9b02-4304-9b8e-1ad6d811db10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:28.393269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd640dd5-9b02-4304-9b8e-1ad6d811db10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:28.393949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd640dd5-9b02-4304-9b8e-1ad6d811db10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:28.395101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd640dd5-9b02-4304-9b8e-1ad6d811db10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:28.395765 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd640dd5-9b02-4304-9b8e-1ad6d811db10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:28.539948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd640dd5-9b02-4304-9b8e-1ad6d811db10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:28.548253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bd640dd5-9b02-4304-9b8e-1ad6d811db10 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166861 May 23 14:06:28.548852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1870/3664] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:29.565313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72605f1a-8e8a-4b7b-be61-29cce8205436 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:29.565948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72605f1a-8e8a-4b7b-be61-29cce8205436 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:29.572885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72605f1a-8e8a-4b7b-be61-29cce8205436 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:29.573339 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72605f1a-8e8a-4b7b-be61-29cce8205436 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:29.574096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72605f1a-8e8a-4b7b-be61-29cce8205436 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:29.574534 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72605f1a-8e8a-4b7b-be61-29cce8205436 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:29.710315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72605f1a-8e8a-4b7b-be61-29cce8205436 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:29.719116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72605f1a-8e8a-4b7b-be61-29cce8205436 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157683 May 23 14:06:29.719691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1795/3665] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:30.737121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b729f308-1a13-47c9-9507-7766f2efcdf9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:30.737719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b729f308-1a13-47c9-9507-7766f2efcdf9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:30.743874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b729f308-1a13-47c9-9507-7766f2efcdf9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:30.748267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b729f308-1a13-47c9-9507-7766f2efcdf9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:30.748267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b729f308-1a13-47c9-9507-7766f2efcdf9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:30.748267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b729f308-1a13-47c9-9507-7766f2efcdf9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:30.876746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b729f308-1a13-47c9-9507-7766f2efcdf9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:30.884614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b729f308-1a13-47c9-9507-7766f2efcdf9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152594 May 23 14:06:30.885177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1871/3666] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:31.901777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9a19b3e9-ee50-47f1-bd63-5f2422b8e416 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:31.902388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9a19b3e9-ee50-47f1-bd63-5f2422b8e416 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:31.909634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9a19b3e9-ee50-47f1-bd63-5f2422b8e416 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:31.910074 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9a19b3e9-ee50-47f1-bd63-5f2422b8e416 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:31.910827 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9a19b3e9-ee50-47f1-bd63-5f2422b8e416 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:31.911259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9a19b3e9-ee50-47f1-bd63-5f2422b8e416 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:32.048315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9a19b3e9-ee50-47f1-bd63-5f2422b8e416 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:32.056249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9a19b3e9-ee50-47f1-bd63-5f2422b8e416 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158318 May 23 14:06:32.056843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1796/3667] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:32.128244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e5fd0fc3-3cd6-41de-aa70-0799512153d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:32.128773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e5fd0fc3-3cd6-41de-aa70-0799512153d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:32.134859 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5fd0fc3-3cd6-41de-aa70-0799512153d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:32.135304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5fd0fc3-3cd6-41de-aa70-0799512153d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:32.136064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5fd0fc3-3cd6-41de-aa70-0799512153d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:32.136498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e5fd0fc3-3cd6-41de-aa70-0799512153d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:32.161481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e5fd0fc3-3cd6-41de-aa70-0799512153d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:06:32.514854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e5fd0fc3-3cd6-41de-aa70-0799512153d5 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 204 len: 0 microversion: 2.1 time: 0.476362 May 23 14:06:32.515361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1872/3668] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:06:32 2022] DELETE /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 14:06:32.523539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f153234a-841e-4491-aa99-cb46a6db3f35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:32.525292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f153234a-841e-4491-aa99-cb46a6db3f35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:32.531056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f153234a-841e-4491-aa99-cb46a6db3f35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:32.531517 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f153234a-841e-4491-aa99-cb46a6db3f35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:32.532288 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f153234a-841e-4491-aa99-cb46a6db3f35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:32.532761 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f153234a-841e-4491-aa99-cb46a6db3f35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:32.664989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f153234a-841e-4491-aa99-cb46a6db3f35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:32.673606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f153234a-841e-4491-aa99-cb46a6db3f35 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1671 microversion: 2.1 time: 0.153898 May 23 14:06:32.674170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1797/3669] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:32 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:33.074337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4753e826-be7d-4775-b5cc-223601904c18 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:33.075048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4753e826-be7d-4775-b5cc-223601904c18 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:33.081886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4753e826-be7d-4775-b5cc-223601904c18 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:33.082335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4753e826-be7d-4775-b5cc-223601904c18 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:33.083113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4753e826-be7d-4775-b5cc-223601904c18 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:33.083528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4753e826-be7d-4775-b5cc-223601904c18 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:33.217717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4753e826-be7d-4775-b5cc-223601904c18 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:33.225963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4753e826-be7d-4775-b5cc-223601904c18 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156087 May 23 14:06:33.226532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1873/3670] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:33.692111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba18c919-1ad2-471a-bb2a-5473ffbf8b8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:33.692754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba18c919-1ad2-471a-bb2a-5473ffbf8b8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:33.699440 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba18c919-1ad2-471a-bb2a-5473ffbf8b8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:33.699937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba18c919-1ad2-471a-bb2a-5473ffbf8b8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:33.700740 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba18c919-1ad2-471a-bb2a-5473ffbf8b8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:33.701965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba18c919-1ad2-471a-bb2a-5473ffbf8b8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:33.841236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba18c919-1ad2-471a-bb2a-5473ffbf8b8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:33.843633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=88 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:06:33.849627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba18c919-1ad2-471a-bb2a-5473ffbf8b8f tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1671 microversion: 2.1 time: 0.161443 May 23 14:06:33.850201 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1798/3671] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:33 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:34.244447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01fcd823-f485-4863-a681-8aafe4566309 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:34.245098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-01fcd823-f485-4863-a681-8aafe4566309 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:34.252418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01fcd823-f485-4863-a681-8aafe4566309 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:34.252903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01fcd823-f485-4863-a681-8aafe4566309 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:34.253703 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01fcd823-f485-4863-a681-8aafe4566309 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:34.254147 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01fcd823-f485-4863-a681-8aafe4566309 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:34.391787 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-01fcd823-f485-4863-a681-8aafe4566309 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:34.400035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01fcd823-f485-4863-a681-8aafe4566309 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159446 May 23 14:06:34.400902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1874/3672] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:34.874317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ec02b029-af83-48ae-afed-827932491297 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:34.875044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ec02b029-af83-48ae-afed-827932491297 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:34.881618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec02b029-af83-48ae-afed-827932491297 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:34.882134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec02b029-af83-48ae-afed-827932491297 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:34.882841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec02b029-af83-48ae-afed-827932491297 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:34.883305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec02b029-af83-48ae-afed-827932491297 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:35.021566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ec02b029-af83-48ae-afed-827932491297 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:35.029189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ec02b029-af83-48ae-afed-827932491297 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1671 microversion: 2.1 time: 0.159706 May 23 14:06:35.030485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1799/3673] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:34 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:35.367215 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-0a137aa9-dec2-413b-8b36-f26944d2a0b6 req-bbb1cd69-ac01-45a4-a2f0-12524c716cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a637819f-e77a-49d3-be43-d19961bd66ef", "name": "network-vif-deleted", "tag": "51f2c234-f78c-4013-bb1f-3840be1a6e81"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:06:35.376418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-0a137aa9-dec2-413b-8b36-f26944d2a0b6 req-bbb1cd69-ac01-45a4-a2f0-12524c716cc9 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:35.376903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-0a137aa9-dec2-413b-8b36-f26944d2a0b6 req-bbb1cd69-ac01-45a4-a2f0-12524c716cc9 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:35.381027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:06:35.389487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-0a137aa9-dec2-413b-8b36-f26944d2a0b6 req-bbb1cd69-ac01-45a4-a2f0-12524c716cc9 service nova] Creating event network-vif-deleted:51f2c234-f78c-4013-bb1f-3840be1a6e81 for instance a637819f-e77a-49d3-be43-d19961bd66ef on hv-cinder-82549 May 23 14:06:35.394760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-0a137aa9-dec2-413b-8b36-f26944d2a0b6 req-bbb1cd69-ac01-45a4-a2f0-12524c716cc9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031412 May 23 14:06:35.395405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1875/3674] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:06:35.417147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-be6f82e2-6893-47a8-b7d0-c01ee47b7d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:35.417787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-be6f82e2-6893-47a8-b7d0-c01ee47b7d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:35.428974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be6f82e2-6893-47a8-b7d0-c01ee47b7d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:35.429436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be6f82e2-6893-47a8-b7d0-c01ee47b7d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:35.430204 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be6f82e2-6893-47a8-b7d0-c01ee47b7d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:35.430639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-be6f82e2-6893-47a8-b7d0-c01ee47b7d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:35.584795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-be6f82e2-6893-47a8-b7d0-c01ee47b7d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:35.594136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-be6f82e2-6893-47a8-b7d0-c01ee47b7d0c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.180836 May 23 14:06:35.595337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1800/3675] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:36.049452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:36.050166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:36.056853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:36.057310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:36.058084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:36.058530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:36.091590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:36.092586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:36.093649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lazy-loading 'fault' on Instance uuid a637819f-e77a-49d3-be43-d19961bd66ef {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:06:36.141037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58edb91d7b641298e40dd356eec9eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb9e74e9b64480a80d45a03945ea51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:36.150289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c11a3c3-5e28-4131-9118-cdb86e985e65 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 200 len: 1328 microversion: 2.1 time: 0.106514 May 23 14:06:36.152719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1876/3676] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:36 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:36.612217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db5ceb46-e862-4b24-8363-45c1a2e7334e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:36.612851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db5ceb46-e862-4b24-8363-45c1a2e7334e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:36.619533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db5ceb46-e862-4b24-8363-45c1a2e7334e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:36.620017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db5ceb46-e862-4b24-8363-45c1a2e7334e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:36.620881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db5ceb46-e862-4b24-8363-45c1a2e7334e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:36.621314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db5ceb46-e862-4b24-8363-45c1a2e7334e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:36.763992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db5ceb46-e862-4b24-8363-45c1a2e7334e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:36.772077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db5ceb46-e862-4b24-8363-45c1a2e7334e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164562 May 23 14:06:36.772677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1801/3677] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:37.178274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:37.178952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:37.185746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:37.186863 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:37.187651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:37.188100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:37.203639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] HTTP exception thrown: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Request method failure captured: May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef HTTP/1.1 May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zL3O8aGlUhmGawlSY5yyW1yR9CzTOwASfzoPOqo6J80W8zAchwKh2Ngmd8XlvZcahyug6djJlKvjdVKX9jO1hw6FJsgdDmjWos7NQcL0jxyny_fYHrXPLzLX0KmnND84kSxy4Mu-lS3rEsnnm6-nSjD-Gc-9lw1oUi3iPQrcYpvr0 May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 6bb9e74e9b64480a80d45a03945ea51f May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeTestJSON-1226336556 May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:06:37.205374 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6bb9e74e9b64480a80d45a03945ea51f"}]}] May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeTestJSON-1226336556 May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 6bb9e74e9b64480a80d45a03945ea51f May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1226336556 May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeTestJSON-1226336556-project May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: a58edb91d7b641298e40dd356eec9eac May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeTestJSON-1226336556-project May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:37.207151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': 'a637819f-e77a-49d3-be43-d19961bd66ef'} May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:06:37.208242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:37.209975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:37.211450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Returning 404 to user: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:06:37.211450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f2af89a-f17d-4c53-b0ab-ad0d074c8470 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 404 len: 111 microversion: 2.1 time: 0.032449 May 23 14:06:37.211450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1877/3678] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:37 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:06:37.215808 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4fdf5455-fc09-45c1-9a55-b105626b3c4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '.version_select at 0x7effb26e4d30>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:37.364284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4fdf5455-fc09-45c1-9a55-b105626b3c4e tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985357311" status: 202 len: 0 microversion: 2.1 time: 0.152231 May 23 14:06:37.364931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1802/3679] 10.222.0.70 () {58 vars in 1220 bytes} [Mon May 23 14:06:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985357311 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 14:06:37.790630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f63954ea-0ae6-4fd9-bba4-33193dfc3388 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:37.791243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f63954ea-0ae6-4fd9-bba4-33193dfc3388 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:37.798112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63954ea-0ae6-4fd9-bba4-33193dfc3388 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:37.798569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63954ea-0ae6-4fd9-bba4-33193dfc3388 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:37.799347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63954ea-0ae6-4fd9-bba4-33193dfc3388 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:37.799789 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63954ea-0ae6-4fd9-bba4-33193dfc3388 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:38.019199 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f63954ea-0ae6-4fd9-bba4-33193dfc3388 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:38.027978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f63954ea-0ae6-4fd9-bba4-33193dfc3388 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.241140 May 23 14:06:38.028992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1878/3680] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:37 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:38.298313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:38.298920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:38.305369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:38.305815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:38.306584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:38.307045 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:38.324340 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] HTTP exception thrown: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Request method failure captured: May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef HTTP/1.1 May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zL3O8aGlUhmGawlSY5yyW1yR9CzTOwASfzoPOqo6J80W8zAchwKh2Ngmd8XlvZcahyug6djJlKvjdVKX9jO1hw6FJsgdDmjWos7NQcL0jxyny_fYHrXPLzLX0KmnND84kSxy4Mu-lS3rEsnnm6-nSjD-Gc-9lw1oUi3iPQrcYpvr0 May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 6bb9e74e9b64480a80d45a03945ea51f May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeTestJSON-1226336556 May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:06:38.326075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6bb9e74e9b64480a80d45a03945ea51f"}]}] May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeTestJSON-1226336556 May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 6bb9e74e9b64480a80d45a03945ea51f May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1226336556 May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeTestJSON-1226336556-project May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: a58edb91d7b641298e40dd356eec9eac May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeTestJSON-1226336556-project May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.327774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'a637819f-e77a-49d3-be43-d19961bd66ef'} May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:06:38.328786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.330388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:06:38.332879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Returning 404 to user: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:06:38.332879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-52bd4f1b-bd72-4067-8100-8be4615d63f7 tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 404 len: 111 microversion: 2.1 time: 0.034167 May 23 14:06:38.332879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1803/3681] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:06:38 2022] DELETE /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:06:38.336893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:38.338101 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: a637819f-e77a-49d3-be43-d19961bd66ef] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:38.344238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:38.344238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:38.344238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:38.346091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:38.360040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] HTTP exception thrown: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Request method failure captured: May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef HTTP/1.1 May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zL3O8aGlUhmGawlSY5yyW1yR9CzTOwASfzoPOqo6J80W8zAchwKh2Ngmd8XlvZcahyug6djJlKvjdVKX9jO1hw6FJsgdDmjWos7NQcL0jxyny_fYHrXPLzLX0KmnND84kSxy4Mu-lS3rEsnnm6-nSjD-Gc-9lw1oUi3iPQrcYpvr0 May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 6bb9e74e9b64480a80d45a03945ea51f May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeTestJSON-1226336556 May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:06:38.361616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6bb9e74e9b64480a80d45a03945ea51f"}]}] May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeTestJSON-1226336556 May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 6bb9e74e9b64480a80d45a03945ea51f May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1226336556 May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeTestJSON-1226336556-project May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: a58edb91d7b641298e40dd356eec9eac May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeTestJSON-1226336556-project May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.363327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': 'a637819f-e77a-49d3-be43-d19961bd66ef'} May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:06:38.364242 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. May 23 14:06:38.365670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:06:38.366910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Returning 404 to user: Instance a637819f-e77a-49d3-be43-d19961bd66ef could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:06:38.366910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-599ffa8a-2578-435b-ab22-3faa3f169c1b tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef" status: 404 len: 111 microversion: 2.1 time: 0.029981 May 23 14:06:38.366910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1879/3682] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:38 2022] GET /compute/v2.1/servers/a637819f-e77a-49d3-be43-d19961bd66ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 14:06:39.047075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-421a0eb2-ef1c-4167-bf58-575067a440fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:39.047689 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-421a0eb2-ef1c-4167-bf58-575067a440fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:39.053909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-421a0eb2-ef1c-4167-bf58-575067a440fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:39.054362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-421a0eb2-ef1c-4167-bf58-575067a440fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:39.055443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-421a0eb2-ef1c-4167-bf58-575067a440fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:39.055891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-421a0eb2-ef1c-4167-bf58-575067a440fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:39.193795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-421a0eb2-ef1c-4167-bf58-575067a440fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:39.202637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-421a0eb2-ef1c-4167-bf58-575067a440fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159861 May 23 14:06:39.203210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1804/3683] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:40.220444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8cf82277-dac9-4162-86d1-1e90de9e2ec6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:40.221129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8cf82277-dac9-4162-86d1-1e90de9e2ec6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:40.223599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:06:40.229054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cf82277-dac9-4162-86d1-1e90de9e2ec6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:40.241672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cf82277-dac9-4162-86d1-1e90de9e2ec6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:40.241672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cf82277-dac9-4162-86d1-1e90de9e2ec6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:40.241672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cf82277-dac9-4162-86d1-1e90de9e2ec6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:40.380494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8cf82277-dac9-4162-86d1-1e90de9e2ec6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:40.384254 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8cf82277-dac9-4162-86d1-1e90de9e2ec6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.168385 May 23 14:06:40.384881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1880/3684] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:41.401437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6a27733-74b7-4984-b018-073672ce6e6b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:41.402316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c6a27733-74b7-4984-b018-073672ce6e6b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:41.404759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:06:41.409763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6a27733-74b7-4984-b018-073672ce6e6b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:41.410218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6a27733-74b7-4984-b018-073672ce6e6b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:41.410990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6a27733-74b7-4984-b018-073672ce6e6b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:41.411429 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6a27733-74b7-4984-b018-073672ce6e6b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:41.549793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c6a27733-74b7-4984-b018-073672ce6e6b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:41.558079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c6a27733-74b7-4984-b018-073672ce6e6b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160414 May 23 14:06:41.558640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1805/3685] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:06:42.576348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-398d869d-1360-4574-aad1-29911e56bfba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:42.577509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-398d869d-1360-4574-aad1-29911e56bfba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:42.586209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-398d869d-1360-4574-aad1-29911e56bfba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:42.586662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-398d869d-1360-4574-aad1-29911e56bfba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:42.587446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-398d869d-1360-4574-aad1-29911e56bfba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:42.587888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-398d869d-1360-4574-aad1-29911e56bfba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:42.721823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-398d869d-1360-4574-aad1-29911e56bfba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:42.729904 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-398d869d-1360-4574-aad1-29911e56bfba tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157854 May 23 14:06:42.730468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1881/3686] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:43.747179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-409a098f-88b5-4df6-9813-397238b48ef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:43.747783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-409a098f-88b5-4df6-9813-397238b48ef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:43.755810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-409a098f-88b5-4df6-9813-397238b48ef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:43.756381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-409a098f-88b5-4df6-9813-397238b48ef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:43.757496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-409a098f-88b5-4df6-9813-397238b48ef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:43.757925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-409a098f-88b5-4df6-9813-397238b48ef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:43.897315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-409a098f-88b5-4df6-9813-397238b48ef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:43.905332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-409a098f-88b5-4df6-9813-397238b48ef1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.162052 May 23 14:06:43.905904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1806/3687] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:44.922417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-afdb33ee-6c49-4417-a972-5db0921055bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:44.923015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-afdb33ee-6c49-4417-a972-5db0921055bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:44.929552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afdb33ee-6c49-4417-a972-5db0921055bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:44.930004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afdb33ee-6c49-4417-a972-5db0921055bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:44.930790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afdb33ee-6c49-4417-a972-5db0921055bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:44.931198 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-afdb33ee-6c49-4417-a972-5db0921055bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:45.074885 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-afdb33ee-6c49-4417-a972-5db0921055bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:45.088705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-afdb33ee-6c49-4417-a972-5db0921055bc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.170094 May 23 14:06:45.089281 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1882/3688] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:44 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:46.107053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c5fc3c7c-e24b-422d-a9a9-258ab072cac8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:46.107660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5fc3c7c-e24b-422d-a9a9-258ab072cac8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:46.114879 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5fc3c7c-e24b-422d-a9a9-258ab072cac8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:46.115327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5fc3c7c-e24b-422d-a9a9-258ab072cac8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:46.116098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5fc3c7c-e24b-422d-a9a9-258ab072cac8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:46.116533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5fc3c7c-e24b-422d-a9a9-258ab072cac8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:46.256478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5fc3c7c-e24b-422d-a9a9-258ab072cac8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:46.264656 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c5fc3c7c-e24b-422d-a9a9-258ab072cac8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161552 May 23 14:06:46.265357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1807/3689] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:47.282667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb8706d7-57d4-4300-857b-2605f72a276c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:47.283243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb8706d7-57d4-4300-857b-2605f72a276c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:47.289818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb8706d7-57d4-4300-857b-2605f72a276c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:47.290273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb8706d7-57d4-4300-857b-2605f72a276c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:47.291036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb8706d7-57d4-4300-857b-2605f72a276c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:47.291472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb8706d7-57d4-4300-857b-2605f72a276c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:47.430174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cb8706d7-57d4-4300-857b-2605f72a276c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:47.439951 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb8706d7-57d4-4300-857b-2605f72a276c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.161820 May 23 14:06:47.440521 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1883/3690] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:48.457659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d0471f7-c6fa-4817-9ddd-207baba7a3a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:48.458548 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d0471f7-c6fa-4817-9ddd-207baba7a3a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:48.464703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d0471f7-c6fa-4817-9ddd-207baba7a3a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:48.465154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d0471f7-c6fa-4817-9ddd-207baba7a3a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:48.465907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d0471f7-c6fa-4817-9ddd-207baba7a3a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:48.466338 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d0471f7-c6fa-4817-9ddd-207baba7a3a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:48.602516 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d0471f7-c6fa-4817-9ddd-207baba7a3a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:48.610777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d0471f7-c6fa-4817-9ddd-207baba7a3a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157073 May 23 14:06:48.611341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1808/3691] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:49.627851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d91676f3-1b6f-468d-9beb-2752cb430ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:49.628455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d91676f3-1b6f-468d-9beb-2752cb430ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:49.635251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d91676f3-1b6f-468d-9beb-2752cb430ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:49.635712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d91676f3-1b6f-468d-9beb-2752cb430ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:49.636510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d91676f3-1b6f-468d-9beb-2752cb430ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:49.636987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d91676f3-1b6f-468d-9beb-2752cb430ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:49.780890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d91676f3-1b6f-468d-9beb-2752cb430ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:49.788987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d91676f3-1b6f-468d-9beb-2752cb430ae6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165733 May 23 14:06:49.789552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1884/3692] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:50.807123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0167511-cd17-41db-8d9f-86a48100a93b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:50.807725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0167511-cd17-41db-8d9f-86a48100a93b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:50.814421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0167511-cd17-41db-8d9f-86a48100a93b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:50.814873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0167511-cd17-41db-8d9f-86a48100a93b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:50.815643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0167511-cd17-41db-8d9f-86a48100a93b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:50.816084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0167511-cd17-41db-8d9f-86a48100a93b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:50.947455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d0167511-cd17-41db-8d9f-86a48100a93b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:50.955606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0167511-cd17-41db-8d9f-86a48100a93b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152456 May 23 14:06:50.956176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1809/3693] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:50 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:51.973469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9b12a56-0aff-48e4-9b2e-e4a0641851a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:51.974443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9b12a56-0aff-48e4-9b2e-e4a0641851a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:51.981356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9b12a56-0aff-48e4-9b2e-e4a0641851a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:51.982154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9b12a56-0aff-48e4-9b2e-e4a0641851a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:51.983490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9b12a56-0aff-48e4-9b2e-e4a0641851a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:51.984650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9b12a56-0aff-48e4-9b2e-e4a0641851a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:52.146466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d9b12a56-0aff-48e4-9b2e-e4a0641851a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:52.155062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9b12a56-0aff-48e4-9b2e-e4a0641851a9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.186136 May 23 14:06:52.156829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1885/3694] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:53.174259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5cf3dc99-b471-4751-8589-abe06daaca5b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:53.174867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5cf3dc99-b471-4751-8589-abe06daaca5b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:53.181766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cf3dc99-b471-4751-8589-abe06daaca5b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:53.182214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cf3dc99-b471-4751-8589-abe06daaca5b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:53.183126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cf3dc99-b471-4751-8589-abe06daaca5b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:53.183404 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cf3dc99-b471-4751-8589-abe06daaca5b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:53.321449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5cf3dc99-b471-4751-8589-abe06daaca5b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:53.330117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5cf3dc99-b471-4751-8589-abe06daaca5b tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160395 May 23 14:06:53.330831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1810/3695] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:54.347926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6e88bb9e-545d-4372-9ba8-5c3447bd1aeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:54.348613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6e88bb9e-545d-4372-9ba8-5c3447bd1aeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:54.355249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e88bb9e-545d-4372-9ba8-5c3447bd1aeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:54.355711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e88bb9e-545d-4372-9ba8-5c3447bd1aeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:54.356487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e88bb9e-545d-4372-9ba8-5c3447bd1aeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:54.356955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6e88bb9e-545d-4372-9ba8-5c3447bd1aeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:54.491269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6e88bb9e-545d-4372-9ba8-5c3447bd1aeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:54.499970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6e88bb9e-545d-4372-9ba8-5c3447bd1aeb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156590 May 23 14:06:54.501298 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1886/3696] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:55.520192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-676197fd-59ea-4468-ab6b-70ba10fa25c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:55.520813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-676197fd-59ea-4468-ab6b-70ba10fa25c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:55.527408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-676197fd-59ea-4468-ab6b-70ba10fa25c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:55.527862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-676197fd-59ea-4468-ab6b-70ba10fa25c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:55.528680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-676197fd-59ea-4468-ab6b-70ba10fa25c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:55.529212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-676197fd-59ea-4468-ab6b-70ba10fa25c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:55.670466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-676197fd-59ea-4468-ab6b-70ba10fa25c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:55.679164 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-676197fd-59ea-4468-ab6b-70ba10fa25c2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164331 May 23 14:06:55.679729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1811/3697] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:56.697549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4bb85443-591e-41ba-9ad0-35b9c0fe14fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:56.704617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4bb85443-591e-41ba-9ad0-35b9c0fe14fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:56.705441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb85443-591e-41ba-9ad0-35b9c0fe14fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:56.706550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb85443-591e-41ba-9ad0-35b9c0fe14fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:56.707344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb85443-591e-41ba-9ad0-35b9c0fe14fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:56.707785 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb85443-591e-41ba-9ad0-35b9c0fe14fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:56.842164 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4bb85443-591e-41ba-9ad0-35b9c0fe14fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:56.850291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4bb85443-591e-41ba-9ad0-35b9c0fe14fe tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157420 May 23 14:06:56.850867 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1887/3698] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:56.888042 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:06:56.888234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:06:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:06:57.869266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cd30d23c-dbce-4511-ba43-9342fe784cfb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:57.870399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cd30d23c-dbce-4511-ba43-9342fe784cfb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:57.882353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd30d23c-dbce-4511-ba43-9342fe784cfb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:57.883052 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd30d23c-dbce-4511-ba43-9342fe784cfb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:57.883887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd30d23c-dbce-4511-ba43-9342fe784cfb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:57.884330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd30d23c-dbce-4511-ba43-9342fe784cfb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:58.122963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd30d23c-dbce-4511-ba43-9342fe784cfb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:58.135576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cd30d23c-dbce-4511-ba43-9342fe784cfb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.267243 May 23 14:06:58.135576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1812/3699] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:57 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:06:59.149093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-46dd0c01-9b8a-4131-bb34-ef5462629763 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:06:59.149706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-46dd0c01-9b8a-4131-bb34-ef5462629763 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:06:59.156130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46dd0c01-9b8a-4131-bb34-ef5462629763 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:59.156556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46dd0c01-9b8a-4131-bb34-ef5462629763 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:59.157829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46dd0c01-9b8a-4131-bb34-ef5462629763 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:06:59.158229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46dd0c01-9b8a-4131-bb34-ef5462629763 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:06:59.296110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-46dd0c01-9b8a-4131-bb34-ef5462629763 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:06:59.304672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-46dd0c01-9b8a-4131-bb34-ef5462629763 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159419 May 23 14:06:59.305234 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1888/3700] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:06:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:00.322296 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-49601273-7a66-41cb-9749-6ae523553223 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:00.322931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-49601273-7a66-41cb-9749-6ae523553223 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:00.329910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49601273-7a66-41cb-9749-6ae523553223 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:00.330474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49601273-7a66-41cb-9749-6ae523553223 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:00.331235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49601273-7a66-41cb-9749-6ae523553223 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:00.331673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49601273-7a66-41cb-9749-6ae523553223 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:00.462709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49601273-7a66-41cb-9749-6ae523553223 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:00.470757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-49601273-7a66-41cb-9749-6ae523553223 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152690 May 23 14:07:00.471330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1813/3701] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:01.488171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a8d77755-b351-4c28-8a6e-9f4be5b8e4a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:01.488775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a8d77755-b351-4c28-8a6e-9f4be5b8e4a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:01.495376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8d77755-b351-4c28-8a6e-9f4be5b8e4a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:01.495832 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8d77755-b351-4c28-8a6e-9f4be5b8e4a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:01.496632 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8d77755-b351-4c28-8a6e-9f4be5b8e4a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:01.497079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8d77755-b351-4c28-8a6e-9f4be5b8e4a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:01.628492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8d77755-b351-4c28-8a6e-9f4be5b8e4a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:01.636693 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a8d77755-b351-4c28-8a6e-9f4be5b8e4a2 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152616 May 23 14:07:01.637261 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1889/3702] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:02.654725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7e49773-02b1-4084-82ad-17c3d949a789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:02.655316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7e49773-02b1-4084-82ad-17c3d949a789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:02.662599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7e49773-02b1-4084-82ad-17c3d949a789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:02.663048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7e49773-02b1-4084-82ad-17c3d949a789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:02.663796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7e49773-02b1-4084-82ad-17c3d949a789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:02.664223 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7e49773-02b1-4084-82ad-17c3d949a789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:02.799130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f7e49773-02b1-4084-82ad-17c3d949a789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:02.807089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7e49773-02b1-4084-82ad-17c3d949a789 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156466 May 23 14:07:02.807648 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1814/3703] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:03.824906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f22e1ff4-8dc1-46c6-9ed2-4bceaf33faa9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:03.825543 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f22e1ff4-8dc1-46c6-9ed2-4bceaf33faa9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:03.833500 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f22e1ff4-8dc1-46c6-9ed2-4bceaf33faa9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:03.833852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f22e1ff4-8dc1-46c6-9ed2-4bceaf33faa9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:03.834637 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f22e1ff4-8dc1-46c6-9ed2-4bceaf33faa9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:03.835084 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f22e1ff4-8dc1-46c6-9ed2-4bceaf33faa9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:03.996085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f22e1ff4-8dc1-46c6-9ed2-4bceaf33faa9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:04.005658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f22e1ff4-8dc1-46c6-9ed2-4bceaf33faa9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.184708 May 23 14:07:04.006229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1890/3704] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:03 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:05.023632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b625f0e4-e450-46ae-9a4e-01e229149cb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:05.024251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b625f0e4-e450-46ae-9a4e-01e229149cb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:05.031090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b625f0e4-e450-46ae-9a4e-01e229149cb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:05.031476 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b625f0e4-e450-46ae-9a4e-01e229149cb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:05.032237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b625f0e4-e450-46ae-9a4e-01e229149cb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:05.032708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b625f0e4-e450-46ae-9a4e-01e229149cb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:05.036118 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=88 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:07:05.184107 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b625f0e4-e450-46ae-9a4e-01e229149cb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:05.192859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b625f0e4-e450-46ae-9a4e-01e229149cb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.173704 May 23 14:07:05.193451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1815/3705] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:06.210947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5955c5df-9a23-4798-a718-f42b6a5e2758 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:06.211561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5955c5df-9a23-4798-a718-f42b6a5e2758 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:06.218197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5955c5df-9a23-4798-a718-f42b6a5e2758 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:06.218645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5955c5df-9a23-4798-a718-f42b6a5e2758 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:06.219414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5955c5df-9a23-4798-a718-f42b6a5e2758 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:06.219865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5955c5df-9a23-4798-a718-f42b6a5e2758 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:06.222452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=86 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:07:06.352193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5955c5df-9a23-4798-a718-f42b6a5e2758 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:06.360373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5955c5df-9a23-4798-a718-f42b6a5e2758 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153997 May 23 14:07:06.363072 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1891/3706] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:07.377776 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cf41ebc7-fadb-45fc-a786-f65087bb97e5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:07.378483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cf41ebc7-fadb-45fc-a786-f65087bb97e5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:07.385135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf41ebc7-fadb-45fc-a786-f65087bb97e5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:07.385584 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf41ebc7-fadb-45fc-a786-f65087bb97e5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:07.386344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf41ebc7-fadb-45fc-a786-f65087bb97e5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:07.386774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf41ebc7-fadb-45fc-a786-f65087bb97e5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:07.520679 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf41ebc7-fadb-45fc-a786-f65087bb97e5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:07.528914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cf41ebc7-fadb-45fc-a786-f65087bb97e5 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154893 May 23 14:07:07.529485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1816/3707] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:08.546730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d0c71a10-b353-42e4-866c-9f5a85b48749 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:08.547343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d0c71a10-b353-42e4-866c-9f5a85b48749 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:08.554334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0c71a10-b353-42e4-866c-9f5a85b48749 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:08.554780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0c71a10-b353-42e4-866c-9f5a85b48749 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:08.555539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0c71a10-b353-42e4-866c-9f5a85b48749 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:08.555975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0c71a10-b353-42e4-866c-9f5a85b48749 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:08.692587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0c71a10-b353-42e4-866c-9f5a85b48749 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:08.700849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d0c71a10-b353-42e4-866c-9f5a85b48749 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158462 May 23 14:07:08.701415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1892/3708] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:09.718134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0914f0ca-7e3a-47c2-8358-8051fd896c52 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:09.719249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0914f0ca-7e3a-47c2-8358-8051fd896c52 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:09.727576 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0914f0ca-7e3a-47c2-8358-8051fd896c52 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:09.728021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0914f0ca-7e3a-47c2-8358-8051fd896c52 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:09.728828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0914f0ca-7e3a-47c2-8358-8051fd896c52 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:09.729264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0914f0ca-7e3a-47c2-8358-8051fd896c52 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:09.809078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:07:09.811739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:07:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:07:09.873332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0914f0ca-7e3a-47c2-8358-8051fd896c52 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:09.882580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0914f0ca-7e3a-47c2-8358-8051fd896c52 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.168419 May 23 14:07:09.883172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1817/3709] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:10.900682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2059dee7-f467-4275-b341-34dff9a9a56a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:10.901304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2059dee7-f467-4275-b341-34dff9a9a56a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:10.903727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:07:10.908919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2059dee7-f467-4275-b341-34dff9a9a56a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:10.909367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2059dee7-f467-4275-b341-34dff9a9a56a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:10.910833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2059dee7-f467-4275-b341-34dff9a9a56a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:10.911266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2059dee7-f467-4275-b341-34dff9a9a56a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:11.048815 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2059dee7-f467-4275-b341-34dff9a9a56a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:11.057701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2059dee7-f467-4275-b341-34dff9a9a56a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160841 May 23 14:07:11.058284 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1893/3710] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:10 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:12.076539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cc0459c5-3cb5-4bab-bcd3-a5f6d73434c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:12.077224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cc0459c5-3cb5-4bab-bcd3-a5f6d73434c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:12.079542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:07:12.085513 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc0459c5-3cb5-4bab-bcd3-a5f6d73434c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:12.085958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc0459c5-3cb5-4bab-bcd3-a5f6d73434c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:12.086747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc0459c5-3cb5-4bab-bcd3-a5f6d73434c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:12.087186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc0459c5-3cb5-4bab-bcd3-a5f6d73434c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:12.221795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc0459c5-3cb5-4bab-bcd3-a5f6d73434c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:12.229790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cc0459c5-3cb5-4bab-bcd3-a5f6d73434c3 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157161 May 23 14:07:12.230360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1818/3711] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:13.247089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9aa5de45-ec54-4ae2-b987-249f26158e32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:13.247707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9aa5de45-ec54-4ae2-b987-249f26158e32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:13.254533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9aa5de45-ec54-4ae2-b987-249f26158e32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:13.254990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9aa5de45-ec54-4ae2-b987-249f26158e32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:13.255757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9aa5de45-ec54-4ae2-b987-249f26158e32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:13.256201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9aa5de45-ec54-4ae2-b987-249f26158e32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:13.385857 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9aa5de45-ec54-4ae2-b987-249f26158e32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:13.393680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9aa5de45-ec54-4ae2-b987-249f26158e32 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.150409 May 23 14:07:13.394274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1894/3712] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:14.410772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d6df144-d563-452f-a609-442dddeaaca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:14.411328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d6df144-d563-452f-a609-442dddeaaca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:14.418353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d6df144-d563-452f-a609-442dddeaaca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:14.418866 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d6df144-d563-452f-a609-442dddeaaca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:14.419637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d6df144-d563-452f-a609-442dddeaaca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:14.420073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d6df144-d563-452f-a609-442dddeaaca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:14.558093 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d6df144-d563-452f-a609-442dddeaaca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:14.567139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d6df144-d563-452f-a609-442dddeaaca4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160251 May 23 14:07:14.567704 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1819/3713] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:15.585844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2917f7e3-fc93-46f5-82a7-eb5b3f30fd3c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:15.586432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2917f7e3-fc93-46f5-82a7-eb5b3f30fd3c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:15.592810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2917f7e3-fc93-46f5-82a7-eb5b3f30fd3c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:15.593270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2917f7e3-fc93-46f5-82a7-eb5b3f30fd3c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:15.594049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2917f7e3-fc93-46f5-82a7-eb5b3f30fd3c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:15.594493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2917f7e3-fc93-46f5-82a7-eb5b3f30fd3c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:15.737901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2917f7e3-fc93-46f5-82a7-eb5b3f30fd3c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:15.746152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2917f7e3-fc93-46f5-82a7-eb5b3f30fd3c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165451 May 23 14:07:15.746723 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1895/3714] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:16.763892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9e8805bb-4a94-448e-8254-ca1b826ff800 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:16.764506 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9e8805bb-4a94-448e-8254-ca1b826ff800 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:16.771932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e8805bb-4a94-448e-8254-ca1b826ff800 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:16.772382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e8805bb-4a94-448e-8254-ca1b826ff800 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:16.773171 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e8805bb-4a94-448e-8254-ca1b826ff800 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:16.773631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9e8805bb-4a94-448e-8254-ca1b826ff800 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:16.906221 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9e8805bb-4a94-448e-8254-ca1b826ff800 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:16.915310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9e8805bb-4a94-448e-8254-ca1b826ff800 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155401 May 23 14:07:16.915901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1820/3715] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:16 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:17.933085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0216b4f8-9333-4c48-a9e1-a16609466bd7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:17.933982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0216b4f8-9333-4c48-a9e1-a16609466bd7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:17.940993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0216b4f8-9333-4c48-a9e1-a16609466bd7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:17.941446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0216b4f8-9333-4c48-a9e1-a16609466bd7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:17.942790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0216b4f8-9333-4c48-a9e1-a16609466bd7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:17.943297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0216b4f8-9333-4c48-a9e1-a16609466bd7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:18.237725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0216b4f8-9333-4c48-a9e1-a16609466bd7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:18.249726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0216b4f8-9333-4c48-a9e1-a16609466bd7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.320426 May 23 14:07:18.250315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1896/3716] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:19.271744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cefeb0b3-a2d8-44f9-a4ea-e02b3b8175c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:19.272901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cefeb0b3-a2d8-44f9-a4ea-e02b3b8175c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:19.280286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cefeb0b3-a2d8-44f9-a4ea-e02b3b8175c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:19.280753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cefeb0b3-a2d8-44f9-a4ea-e02b3b8175c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:19.281508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cefeb0b3-a2d8-44f9-a4ea-e02b3b8175c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:19.282214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cefeb0b3-a2d8-44f9-a4ea-e02b3b8175c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:19.415311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cefeb0b3-a2d8-44f9-a4ea-e02b3b8175c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:19.423206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cefeb0b3-a2d8-44f9-a4ea-e02b3b8175c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155876 May 23 14:07:19.423763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1821/3717] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:20.441142 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bc4a0234-af9f-411c-b670-5f112b26650e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:20.441727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bc4a0234-af9f-411c-b670-5f112b26650e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:20.449306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc4a0234-af9f-411c-b670-5f112b26650e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:20.449760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc4a0234-af9f-411c-b670-5f112b26650e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:20.450533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc4a0234-af9f-411c-b670-5f112b26650e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:20.450969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bc4a0234-af9f-411c-b670-5f112b26650e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:20.588969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bc4a0234-af9f-411c-b670-5f112b26650e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:20.597011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bc4a0234-af9f-411c-b670-5f112b26650e tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159748 May 23 14:07:20.597573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1897/3718] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:21.624395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4550378d-ad02-4e76-a0fe-140ab559b900 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:21.625067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4550378d-ad02-4e76-a0fe-140ab559b900 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:21.632180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4550378d-ad02-4e76-a0fe-140ab559b900 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:21.632668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4550378d-ad02-4e76-a0fe-140ab559b900 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:21.633471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4550378d-ad02-4e76-a0fe-140ab559b900 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:21.633907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4550378d-ad02-4e76-a0fe-140ab559b900 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:21.790073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4550378d-ad02-4e76-a0fe-140ab559b900 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:21.798541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4550378d-ad02-4e76-a0fe-140ab559b900 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.180601 May 23 14:07:21.799131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1822/3719] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:22.816432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d5852b6-af83-424f-841d-91b438e48deb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:22.817081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d5852b6-af83-424f-841d-91b438e48deb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:22.824641 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d5852b6-af83-424f-841d-91b438e48deb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:22.825129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d5852b6-af83-424f-841d-91b438e48deb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:22.825903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d5852b6-af83-424f-841d-91b438e48deb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:22.826348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d5852b6-af83-424f-841d-91b438e48deb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:22.956013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7d5852b6-af83-424f-841d-91b438e48deb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:22.964546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d5852b6-af83-424f-841d-91b438e48deb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151938 May 23 14:07:22.965123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1898/3720] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:23.837781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:07:23.838368 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:07:23.982642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-751e9859-7f01-41b6-bb7b-7d4f915a23e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:23.983165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-751e9859-7f01-41b6-bb7b-7d4f915a23e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:23.989750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-751e9859-7f01-41b6-bb7b-7d4f915a23e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:23.990197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-751e9859-7f01-41b6-bb7b-7d4f915a23e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:23.990963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-751e9859-7f01-41b6-bb7b-7d4f915a23e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:23.991398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-751e9859-7f01-41b6-bb7b-7d4f915a23e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:24.123299 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-751e9859-7f01-41b6-bb7b-7d4f915a23e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:24.131536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-751e9859-7f01-41b6-bb7b-7d4f915a23e0 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152869 May 23 14:07:24.133046 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1823/3721] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:23 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:25.149734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fb8cbfe8-ff07-4ac0-bd00-28ca17a7f0a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:25.150469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fb8cbfe8-ff07-4ac0-bd00-28ca17a7f0a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:25.157768 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb8cbfe8-ff07-4ac0-bd00-28ca17a7f0a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:25.158351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb8cbfe8-ff07-4ac0-bd00-28ca17a7f0a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:25.159165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb8cbfe8-ff07-4ac0-bd00-28ca17a7f0a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:25.159669 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb8cbfe8-ff07-4ac0-bd00-28ca17a7f0a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:25.289944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb8cbfe8-ff07-4ac0-bd00-28ca17a7f0a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:25.298711 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fb8cbfe8-ff07-4ac0-bd00-28ca17a7f0a1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153815 May 23 14:07:25.299369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1899/3722] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:26.316392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0105f7f1-d062-47b8-82c2-4cd3aceb8f91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:26.317091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0105f7f1-d062-47b8-82c2-4cd3aceb8f91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:26.324029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0105f7f1-d062-47b8-82c2-4cd3aceb8f91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:26.324479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0105f7f1-d062-47b8-82c2-4cd3aceb8f91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:26.325283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0105f7f1-d062-47b8-82c2-4cd3aceb8f91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:26.325718 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0105f7f1-d062-47b8-82c2-4cd3aceb8f91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:26.474284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0105f7f1-d062-47b8-82c2-4cd3aceb8f91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:26.482990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0105f7f1-d062-47b8-82c2-4cd3aceb8f91 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.170893 May 23 14:07:26.483557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1824/3723] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:27.500366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33d69f43-86f3-439a-865d-d4ec75c356d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:27.500958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33d69f43-86f3-439a-865d-d4ec75c356d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:27.507673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33d69f43-86f3-439a-865d-d4ec75c356d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:27.508160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33d69f43-86f3-439a-865d-d4ec75c356d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:27.509001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33d69f43-86f3-439a-865d-d4ec75c356d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:27.509541 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33d69f43-86f3-439a-865d-d4ec75c356d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:27.645826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33d69f43-86f3-439a-865d-d4ec75c356d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:27.654771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33d69f43-86f3-439a-865d-d4ec75c356d9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158673 May 23 14:07:27.655344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1900/3724] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:28.671875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e5185a78-b737-40f2-86a6-01219e8fc029 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:28.672518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e5185a78-b737-40f2-86a6-01219e8fc029 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:28.679181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5185a78-b737-40f2-86a6-01219e8fc029 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:28.680166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5185a78-b737-40f2-86a6-01219e8fc029 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:28.681301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5185a78-b737-40f2-86a6-01219e8fc029 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:28.681742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5185a78-b737-40f2-86a6-01219e8fc029 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:28.816165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e5185a78-b737-40f2-86a6-01219e8fc029 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:28.825483 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e5185a78-b737-40f2-86a6-01219e8fc029 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157410 May 23 14:07:28.826063 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1825/3725] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:29.843705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a012375f-f366-4b68-bb5e-91989ecdbd9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:29.844329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a012375f-f366-4b68-bb5e-91989ecdbd9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:29.851300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a012375f-f366-4b68-bb5e-91989ecdbd9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:29.852466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a012375f-f366-4b68-bb5e-91989ecdbd9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:29.853300 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a012375f-f366-4b68-bb5e-91989ecdbd9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:29.853746 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a012375f-f366-4b68-bb5e-91989ecdbd9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:30.002908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a012375f-f366-4b68-bb5e-91989ecdbd9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:30.012203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a012375f-f366-4b68-bb5e-91989ecdbd9d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.172276 May 23 14:07:30.012834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1901/3726] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:29 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:31.030489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef50a2a4-722a-4c72-ac50-f3d3f4ff4168 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:31.031071 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ef50a2a4-722a-4c72-ac50-f3d3f4ff4168 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:31.037410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef50a2a4-722a-4c72-ac50-f3d3f4ff4168 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:31.037861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef50a2a4-722a-4c72-ac50-f3d3f4ff4168 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:31.038616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef50a2a4-722a-4c72-ac50-f3d3f4ff4168 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:31.039573 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef50a2a4-722a-4c72-ac50-f3d3f4ff4168 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:31.167546 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ef50a2a4-722a-4c72-ac50-f3d3f4ff4168 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:31.175661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef50a2a4-722a-4c72-ac50-f3d3f4ff4168 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.149086 May 23 14:07:31.176274 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1826/3727] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:32.193296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-231ded17-6873-4dd6-8c22-abe3290b5b22 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:32.193915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-231ded17-6873-4dd6-8c22-abe3290b5b22 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:32.201968 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-231ded17-6873-4dd6-8c22-abe3290b5b22 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:32.202430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-231ded17-6873-4dd6-8c22-abe3290b5b22 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:32.203201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-231ded17-6873-4dd6-8c22-abe3290b5b22 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:32.203646 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-231ded17-6873-4dd6-8c22-abe3290b5b22 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:32.337702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-231ded17-6873-4dd6-8c22-abe3290b5b22 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:32.345923 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-231ded17-6873-4dd6-8c22-abe3290b5b22 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156418 May 23 14:07:32.346495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1902/3728] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:32 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:33.364839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-05e36fe0-b231-4d61-89aa-95484ff6d1b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:33.365449 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-05e36fe0-b231-4d61-89aa-95484ff6d1b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:33.374252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05e36fe0-b231-4d61-89aa-95484ff6d1b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:33.374698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05e36fe0-b231-4d61-89aa-95484ff6d1b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:33.375466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05e36fe0-b231-4d61-89aa-95484ff6d1b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:33.375896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-05e36fe0-b231-4d61-89aa-95484ff6d1b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:33.510856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-05e36fe0-b231-4d61-89aa-95484ff6d1b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:33.519374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-05e36fe0-b231-4d61-89aa-95484ff6d1b9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158566 May 23 14:07:33.519944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1827/3729] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:33 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:34.537355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2321ffaa-69b4-4660-864c-d9428604edcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:34.537965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2321ffaa-69b4-4660-864c-d9428604edcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:34.544932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2321ffaa-69b4-4660-864c-d9428604edcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:34.545387 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2321ffaa-69b4-4660-864c-d9428604edcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:34.546159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2321ffaa-69b4-4660-864c-d9428604edcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:34.546672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2321ffaa-69b4-4660-864c-d9428604edcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:34.678992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2321ffaa-69b4-4660-864c-d9428604edcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:34.687974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2321ffaa-69b4-4660-864c-d9428604edcc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154681 May 23 14:07:34.688584 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1903/3730] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:35.706002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4893e275-d02a-4aaf-92ae-09a768256fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:35.706629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4893e275-d02a-4aaf-92ae-09a768256fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:35.713400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4893e275-d02a-4aaf-92ae-09a768256fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:35.713852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4893e275-d02a-4aaf-92ae-09a768256fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:35.714670 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4893e275-d02a-4aaf-92ae-09a768256fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:35.715159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4893e275-d02a-4aaf-92ae-09a768256fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:35.717732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:07:35.846438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4893e275-d02a-4aaf-92ae-09a768256fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:35.854521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4893e275-d02a-4aaf-92ae-09a768256fc8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153065 May 23 14:07:35.855140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1828/3731] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:35 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:36.871623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a133757f-c464-4330-876a-127325a14ce1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:36.876392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a133757f-c464-4330-876a-127325a14ce1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:36.878719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a133757f-c464-4330-876a-127325a14ce1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:36.879171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a133757f-c464-4330-876a-127325a14ce1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:36.879933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a133757f-c464-4330-876a-127325a14ce1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:36.880368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a133757f-c464-4330-876a-127325a14ce1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:36.882953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:07:37.017794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a133757f-c464-4330-876a-127325a14ce1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:37.026379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a133757f-c464-4330-876a-127325a14ce1 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158827 May 23 14:07:37.026952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1904/3732] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:36 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:38.044660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-58e42b93-27a5-4cfd-8a34-2094666352ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:38.045283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-58e42b93-27a5-4cfd-8a34-2094666352ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:38.052781 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58e42b93-27a5-4cfd-8a34-2094666352ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:38.053232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58e42b93-27a5-4cfd-8a34-2094666352ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:38.053991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58e42b93-27a5-4cfd-8a34-2094666352ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:38.054497 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58e42b93-27a5-4cfd-8a34-2094666352ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:38.198053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-58e42b93-27a5-4cfd-8a34-2094666352ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:38.206673 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-58e42b93-27a5-4cfd-8a34-2094666352ed tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.165893 May 23 14:07:38.207237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1829/3733] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:38 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:39.224162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c7f8cf6-239c-4328-8cf6-741be25ca448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:39.224844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c7f8cf6-239c-4328-8cf6-741be25ca448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:39.231622 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c7f8cf6-239c-4328-8cf6-741be25ca448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:39.232077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c7f8cf6-239c-4328-8cf6-741be25ca448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:39.232884 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c7f8cf6-239c-4328-8cf6-741be25ca448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:39.233330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c7f8cf6-239c-4328-8cf6-741be25ca448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:39.364797 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c7f8cf6-239c-4328-8cf6-741be25ca448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:39.373368 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c7f8cf6-239c-4328-8cf6-741be25ca448 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152956 May 23 14:07:39.373963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1905/3734] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:39 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:40.391224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6bbd65b4-11bc-4345-997c-aa17a8dece39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:40.391833 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6bbd65b4-11bc-4345-997c-aa17a8dece39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:40.399134 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bbd65b4-11bc-4345-997c-aa17a8dece39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:40.399585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bbd65b4-11bc-4345-997c-aa17a8dece39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:40.400345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bbd65b4-11bc-4345-997c-aa17a8dece39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:40.400806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bbd65b4-11bc-4345-997c-aa17a8dece39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:40.527654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6bbd65b4-11bc-4345-997c-aa17a8dece39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:40.536183 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6bbd65b4-11bc-4345-997c-aa17a8dece39 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.148825 May 23 14:07:40.536791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1830/3735] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:40 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:41.553536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec75b274-c91e-45e1-a625-bc86d697ef05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:41.554076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec75b274-c91e-45e1-a625-bc86d697ef05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:41.556437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:07:41.561253 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec75b274-c91e-45e1-a625-bc86d697ef05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:41.561712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec75b274-c91e-45e1-a625-bc86d697ef05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:41.562486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec75b274-c91e-45e1-a625-bc86d697ef05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:41.562932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec75b274-c91e-45e1-a625-bc86d697ef05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:41.692714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec75b274-c91e-45e1-a625-bc86d697ef05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:41.700985 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec75b274-c91e-45e1-a625-bc86d697ef05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151393 May 23 14:07:41.701553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1906/3736] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:41 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:07:42.719613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9d9b4b35-2ede-4f0d-9126-3c62897f5685 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:42.721167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9d9b4b35-2ede-4f0d-9126-3c62897f5685 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:42.723633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:07:42.728382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d9b4b35-2ede-4f0d-9126-3c62897f5685 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:42.728852 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d9b4b35-2ede-4f0d-9126-3c62897f5685 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:42.729660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d9b4b35-2ede-4f0d-9126-3c62897f5685 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:42.730089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9d9b4b35-2ede-4f0d-9126-3c62897f5685 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:42.867969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9d9b4b35-2ede-4f0d-9126-3c62897f5685 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:42.875973 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9d9b4b35-2ede-4f0d-9126-3c62897f5685 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160382 May 23 14:07:42.877332 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1831/3737] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:42 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:43.897959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33160a92-f81b-4e50-8fe0-6c9b6f806769 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:43.899665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33160a92-f81b-4e50-8fe0-6c9b6f806769 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:43.906583 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33160a92-f81b-4e50-8fe0-6c9b6f806769 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:43.907163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33160a92-f81b-4e50-8fe0-6c9b6f806769 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:43.908808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33160a92-f81b-4e50-8fe0-6c9b6f806769 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:43.909263 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33160a92-f81b-4e50-8fe0-6c9b6f806769 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:44.045849 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33160a92-f81b-4e50-8fe0-6c9b6f806769 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:44.054151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33160a92-f81b-4e50-8fe0-6c9b6f806769 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.163696 May 23 14:07:44.054732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1907/3738] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:43 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:45.071126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-177a2222-1131-41e8-8e29-b4a93d4fa1c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:45.071831 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-177a2222-1131-41e8-8e29-b4a93d4fa1c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:45.078645 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-177a2222-1131-41e8-8e29-b4a93d4fa1c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:45.079097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-177a2222-1131-41e8-8e29-b4a93d4fa1c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:45.080423 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-177a2222-1131-41e8-8e29-b4a93d4fa1c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:45.080897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-177a2222-1131-41e8-8e29-b4a93d4fa1c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:45.222156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-177a2222-1131-41e8-8e29-b4a93d4fa1c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:45.230053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-177a2222-1131-41e8-8e29-b4a93d4fa1c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.162854 May 23 14:07:45.230651 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1832/3739] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:45 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:46.247313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f43d2e3-f947-4376-a109-1e6674c95067 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:46.247925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f43d2e3-f947-4376-a109-1e6674c95067 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:46.254246 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f43d2e3-f947-4376-a109-1e6674c95067 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:46.254701 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f43d2e3-f947-4376-a109-1e6674c95067 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:46.255461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f43d2e3-f947-4376-a109-1e6674c95067 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:46.255929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f43d2e3-f947-4376-a109-1e6674c95067 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:46.383796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f43d2e3-f947-4376-a109-1e6674c95067 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:46.391953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f43d2e3-f947-4376-a109-1e6674c95067 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.148627 May 23 14:07:46.392576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1908/3740] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:46 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:47.409469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2ff1a922-b02a-452a-a52d-67b282ef1936 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:47.410069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2ff1a922-b02a-452a-a52d-67b282ef1936 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:47.418511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ff1a922-b02a-452a-a52d-67b282ef1936 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:47.419193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ff1a922-b02a-452a-a52d-67b282ef1936 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:47.420363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ff1a922-b02a-452a-a52d-67b282ef1936 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:47.421073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ff1a922-b02a-452a-a52d-67b282ef1936 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:47.762697 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2ff1a922-b02a-452a-a52d-67b282ef1936 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:47.770856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2ff1a922-b02a-452a-a52d-67b282ef1936 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.365419 May 23 14:07:47.771451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1833/3741] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:47 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:48.790402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-253a74c6-e214-42d6-8330-0e3a51686870 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:48.791029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-253a74c6-e214-42d6-8330-0e3a51686870 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:48.797069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-253a74c6-e214-42d6-8330-0e3a51686870 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:48.797530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-253a74c6-e214-42d6-8330-0e3a51686870 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:48.798297 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-253a74c6-e214-42d6-8330-0e3a51686870 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:48.799303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-253a74c6-e214-42d6-8330-0e3a51686870 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:48.935378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-253a74c6-e214-42d6-8330-0e3a51686870 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:48.944075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-253a74c6-e214-42d6-8330-0e3a51686870 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.158913 May 23 14:07:48.944661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1909/3742] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:48 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:49.962103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-349e7203-d893-45ad-be79-57e7ee5f2591 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:49.962735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-349e7203-d893-45ad-be79-57e7ee5f2591 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:49.969342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-349e7203-d893-45ad-be79-57e7ee5f2591 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:49.969786 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-349e7203-d893-45ad-be79-57e7ee5f2591 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:49.970538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-349e7203-d893-45ad-be79-57e7ee5f2591 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:49.971080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-349e7203-d893-45ad-be79-57e7ee5f2591 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:50.102226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-349e7203-d893-45ad-be79-57e7ee5f2591 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:50.110129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-349e7203-d893-45ad-be79-57e7ee5f2591 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151904 May 23 14:07:50.110684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1834/3743] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:49 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:51.128811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5825d083-843a-41b3-bd2f-8b257690861a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:51.129440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5825d083-843a-41b3-bd2f-8b257690861a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:51.135779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5825d083-843a-41b3-bd2f-8b257690861a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:51.136229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5825d083-843a-41b3-bd2f-8b257690861a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:51.137056 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5825d083-843a-41b3-bd2f-8b257690861a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:51.137496 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5825d083-843a-41b3-bd2f-8b257690861a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:51.267210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5825d083-843a-41b3-bd2f-8b257690861a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:51.276362 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5825d083-843a-41b3-bd2f-8b257690861a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151565 May 23 14:07:51.276962 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1910/3744] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:51 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:52.294558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c1d7a8f3-cdba-4574-9ed9-0e37b3faf50a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:52.295148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c1d7a8f3-cdba-4574-9ed9-0e37b3faf50a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:52.301890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1d7a8f3-cdba-4574-9ed9-0e37b3faf50a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:52.302331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1d7a8f3-cdba-4574-9ed9-0e37b3faf50a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:52.303091 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1d7a8f3-cdba-4574-9ed9-0e37b3faf50a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:52.303518 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1d7a8f3-cdba-4574-9ed9-0e37b3faf50a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:52.431903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c1d7a8f3-cdba-4574-9ed9-0e37b3faf50a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:52.440639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c1d7a8f3-cdba-4574-9ed9-0e37b3faf50a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.149294 May 23 14:07:52.441234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1835/3745] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:52 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:53.458929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a62d4fe-e48a-4566-bbfb-673957c83566 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:53.459530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a62d4fe-e48a-4566-bbfb-673957c83566 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:53.466108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a62d4fe-e48a-4566-bbfb-673957c83566 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:53.466568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a62d4fe-e48a-4566-bbfb-673957c83566 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:53.467358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a62d4fe-e48a-4566-bbfb-673957c83566 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:53.467800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a62d4fe-e48a-4566-bbfb-673957c83566 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:53.597394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a62d4fe-e48a-4566-bbfb-673957c83566 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:53.605329 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a62d4fe-e48a-4566-bbfb-673957c83566 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151367 May 23 14:07:53.605896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1911/3746] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:53 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:54.622571 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-69c4399a-f5d0-481c-8d01-d8a261fb0209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:54.623165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-69c4399a-f5d0-481c-8d01-d8a261fb0209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:54.630456 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c4399a-f5d0-481c-8d01-d8a261fb0209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:54.630901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c4399a-f5d0-481c-8d01-d8a261fb0209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:54.631660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c4399a-f5d0-481c-8d01-d8a261fb0209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:54.632092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-69c4399a-f5d0-481c-8d01-d8a261fb0209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:54.766894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-69c4399a-f5d0-481c-8d01-d8a261fb0209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:54.775708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-69c4399a-f5d0-481c-8d01-d8a261fb0209 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157001 May 23 14:07:54.776290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1836/3747] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:54 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:55.792926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-018659a0-f2fb-4596-92f0-ac8a0aff8d05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:55.793547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-018659a0-f2fb-4596-92f0-ac8a0aff8d05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:55.800048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-018659a0-f2fb-4596-92f0-ac8a0aff8d05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:55.800505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-018659a0-f2fb-4596-92f0-ac8a0aff8d05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:55.801305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-018659a0-f2fb-4596-92f0-ac8a0aff8d05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:55.801745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-018659a0-f2fb-4596-92f0-ac8a0aff8d05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:55.933745 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-018659a0-f2fb-4596-92f0-ac8a0aff8d05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:55.942447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-018659a0-f2fb-4596-92f0-ac8a0aff8d05 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153412 May 23 14:07:55.943013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1912/3748] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:55 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:57.090043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba0c5291-e8e4-49a9-85f0-48fadd68bf1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:57.090678 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba0c5291-e8e4-49a9-85f0-48fadd68bf1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:57.097438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba0c5291-e8e4-49a9-85f0-48fadd68bf1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:57.097881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba0c5291-e8e4-49a9-85f0-48fadd68bf1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:57.098633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba0c5291-e8e4-49a9-85f0-48fadd68bf1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:57.099062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba0c5291-e8e4-49a9-85f0-48fadd68bf1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:57.233849 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba0c5291-e8e4-49a9-85f0-48fadd68bf1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:57.242485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba0c5291-e8e4-49a9-85f0-48fadd68bf1c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.287076 May 23 14:07:57.243068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1837/3749] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:56 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:58.258898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b96ecd92-a4b6-4ad4-a24b-92dd4ebb5189 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:58.259510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b96ecd92-a4b6-4ad4-a24b-92dd4ebb5189 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:58.266146 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b96ecd92-a4b6-4ad4-a24b-92dd4ebb5189 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:58.266605 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b96ecd92-a4b6-4ad4-a24b-92dd4ebb5189 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:58.267379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b96ecd92-a4b6-4ad4-a24b-92dd4ebb5189 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:58.268319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b96ecd92-a4b6-4ad4-a24b-92dd4ebb5189 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:58.402140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b96ecd92-a4b6-4ad4-a24b-92dd4ebb5189 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:58.411027 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b96ecd92-a4b6-4ad4-a24b-92dd4ebb5189 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156145 May 23 14:07:58.411604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1913/3750] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:58 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:07:59.428643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-487a47f3-a008-46d9-9c72-f70cd5a7f6cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:07:59.429249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-487a47f3-a008-46d9-9c72-f70cd5a7f6cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:07:59.435680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487a47f3-a008-46d9-9c72-f70cd5a7f6cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:59.436075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487a47f3-a008-46d9-9c72-f70cd5a7f6cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:59.436887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487a47f3-a008-46d9-9c72-f70cd5a7f6cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:07:59.437318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487a47f3-a008-46d9-9c72-f70cd5a7f6cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:07:59.569284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-487a47f3-a008-46d9-9c72-f70cd5a7f6cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:07:59.577478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-487a47f3-a008-46d9-9c72-f70cd5a7f6cc tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153279 May 23 14:07:59.578044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1838/3751] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:07:59 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:00.595267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31fe2c1a-c6f2-4bbe-afb4-d92a702e01d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:00.595802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-31fe2c1a-c6f2-4bbe-afb4-d92a702e01d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:00.602905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31fe2c1a-c6f2-4bbe-afb4-d92a702e01d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:00.603370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31fe2c1a-c6f2-4bbe-afb4-d92a702e01d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:00.604150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31fe2c1a-c6f2-4bbe-afb4-d92a702e01d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:00.604626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31fe2c1a-c6f2-4bbe-afb4-d92a702e01d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:00.738517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-31fe2c1a-c6f2-4bbe-afb4-d92a702e01d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:00.746569 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31fe2c1a-c6f2-4bbe-afb4-d92a702e01d8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.155267 May 23 14:08:00.747129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1914/3752] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:00 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:01.764078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-08d67273-3dc0-4dce-9382-90db19cce386 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:01.764737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-08d67273-3dc0-4dce-9382-90db19cce386 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:01.772160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08d67273-3dc0-4dce-9382-90db19cce386 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:01.772639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08d67273-3dc0-4dce-9382-90db19cce386 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:01.773397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08d67273-3dc0-4dce-9382-90db19cce386 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:01.773832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-08d67273-3dc0-4dce-9382-90db19cce386 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:01.904307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-08d67273-3dc0-4dce-9382-90db19cce386 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:01.912907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-08d67273-3dc0-4dce-9382-90db19cce386 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152074 May 23 14:08:01.913600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1839/3753] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:01 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:02.930457 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c80e388b-cd82-484e-9e2d-52ad8512238f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:02.931089 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c80e388b-cd82-484e-9e2d-52ad8512238f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:02.937576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80e388b-cd82-484e-9e2d-52ad8512238f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:02.938026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80e388b-cd82-484e-9e2d-52ad8512238f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:02.938788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80e388b-cd82-484e-9e2d-52ad8512238f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:02.939229 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c80e388b-cd82-484e-9e2d-52ad8512238f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:03.070493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c80e388b-cd82-484e-9e2d-52ad8512238f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:03.079166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c80e388b-cd82-484e-9e2d-52ad8512238f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153120 May 23 14:08:03.079733 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1915/3754] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:02 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:04.096450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-063f878b-0559-4af7-86e5-fede85841920 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:04.097087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-063f878b-0559-4af7-86e5-fede85841920 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:04.104144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-063f878b-0559-4af7-86e5-fede85841920 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:04.104618 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-063f878b-0559-4af7-86e5-fede85841920 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:04.105383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-063f878b-0559-4af7-86e5-fede85841920 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:04.105810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-063f878b-0559-4af7-86e5-fede85841920 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:04.242337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-063f878b-0559-4af7-86e5-fede85841920 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:04.250355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-063f878b-0559-4af7-86e5-fede85841920 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157740 May 23 14:08:04.250931 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1840/3755] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:04 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:05.268594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9ce4304-8528-40eb-88a0-324b4d1eef47 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:05.269190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9ce4304-8528-40eb-88a0-324b4d1eef47 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:05.276054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9ce4304-8528-40eb-88a0-324b4d1eef47 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:05.276528 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9ce4304-8528-40eb-88a0-324b4d1eef47 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:05.277376 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9ce4304-8528-40eb-88a0-324b4d1eef47 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:05.277810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9ce4304-8528-40eb-88a0-324b4d1eef47 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:05.419488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9ce4304-8528-40eb-88a0-324b4d1eef47 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:05.427934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9ce4304-8528-40eb-88a0-324b4d1eef47 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.163218 May 23 14:08:05.429484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1916/3756] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:05 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:06.445995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a3f62433-ec4d-456c-a7e7-d51cd22df49a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:06.447207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a3f62433-ec4d-456c-a7e7-d51cd22df49a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:06.453412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3f62433-ec4d-456c-a7e7-d51cd22df49a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:06.453859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3f62433-ec4d-456c-a7e7-d51cd22df49a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:06.454619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3f62433-ec4d-456c-a7e7-d51cd22df49a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:06.455056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3f62433-ec4d-456c-a7e7-d51cd22df49a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:06.457728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:06.595466 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a3f62433-ec4d-456c-a7e7-d51cd22df49a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:06.604465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a3f62433-ec4d-456c-a7e7-d51cd22df49a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.162367 May 23 14:08:06.605342 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1841/3757] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:06 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:07.622821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f4f1e0e-e4e8-47c6-bfa8-2e3590a9c95c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:07.623438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f4f1e0e-e4e8-47c6-bfa8-2e3590a9c95c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:07.630182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f4f1e0e-e4e8-47c6-bfa8-2e3590a9c95c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:07.630633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f4f1e0e-e4e8-47c6-bfa8-2e3590a9c95c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:07.631424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f4f1e0e-e4e8-47c6-bfa8-2e3590a9c95c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:07.631861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f4f1e0e-e4e8-47c6-bfa8-2e3590a9c95c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:07.634903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=78 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:07.775771 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f4f1e0e-e4e8-47c6-bfa8-2e3590a9c95c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:07.784222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f4f1e0e-e4e8-47c6-bfa8-2e3590a9c95c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.166076 May 23 14:08:07.792356 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1917/3758] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:07 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:08.802360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e0504a3-444f-49e9-a804-8fdb01bcf729 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:08.802967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e0504a3-444f-49e9-a804-8fdb01bcf729 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:08.810029 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e0504a3-444f-49e9-a804-8fdb01bcf729 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:08.810579 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e0504a3-444f-49e9-a804-8fdb01bcf729 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:08.811297 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e0504a3-444f-49e9-a804-8fdb01bcf729 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:08.811764 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e0504a3-444f-49e9-a804-8fdb01bcf729 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:08.944246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6e0504a3-444f-49e9-a804-8fdb01bcf729 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:08.953140 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e0504a3-444f-49e9-a804-8fdb01bcf729 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.154646 May 23 14:08:08.953733 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1842/3759] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:08 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:09.972505 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9cccd05d-9030-4ecc-8522-14f417295917 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:09.973156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9cccd05d-9030-4ecc-8522-14f417295917 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:09.980621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cccd05d-9030-4ecc-8522-14f417295917 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:09.981088 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cccd05d-9030-4ecc-8522-14f417295917 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:09.981873 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cccd05d-9030-4ecc-8522-14f417295917 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:09.982333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9cccd05d-9030-4ecc-8522-14f417295917 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:10.125033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9cccd05d-9030-4ecc-8522-14f417295917 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:10.133293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9cccd05d-9030-4ecc-8522-14f417295917 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164986 May 23 14:08:10.138792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1918/3760] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:09 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:11.158994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b4fa836-08c5-4451-b741-034ba05ce0a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:11.159594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b4fa836-08c5-4451-b741-034ba05ce0a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:11.166918 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b4fa836-08c5-4451-b741-034ba05ce0a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:11.167372 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b4fa836-08c5-4451-b741-034ba05ce0a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:11.168145 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b4fa836-08c5-4451-b741-034ba05ce0a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:11.168613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b4fa836-08c5-4451-b741-034ba05ce0a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:11.306503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b4fa836-08c5-4451-b741-034ba05ce0a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:11.315126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b4fa836-08c5-4451-b741-034ba05ce0a4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160040 May 23 14:08:11.315687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1843/3761] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:11 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:12.333466 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4205bc52-3a16-4f21-bee6-49c1c78d6df9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:12.334108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4205bc52-3a16-4f21-bee6-49c1c78d6df9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:12.336333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:12.342081 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4205bc52-3a16-4f21-bee6-49c1c78d6df9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:12.342542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4205bc52-3a16-4f21-bee6-49c1c78d6df9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:12.343327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4205bc52-3a16-4f21-bee6-49c1c78d6df9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:12.343775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4205bc52-3a16-4f21-bee6-49c1c78d6df9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:12.477639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4205bc52-3a16-4f21-bee6-49c1c78d6df9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:12.485811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4205bc52-3a16-4f21-bee6-49c1c78d6df9 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156237 May 23 14:08:12.486393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1919/3762] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:12 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:13.503611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fa1d6744-491b-42bd-bf1a-4fbf08bfdd9a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:13.504197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fa1d6744-491b-42bd-bf1a-4fbf08bfdd9a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:13.506537 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=26 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:13.512315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa1d6744-491b-42bd-bf1a-4fbf08bfdd9a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:13.512807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa1d6744-491b-42bd-bf1a-4fbf08bfdd9a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:13.513593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa1d6744-491b-42bd-bf1a-4fbf08bfdd9a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:13.514031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fa1d6744-491b-42bd-bf1a-4fbf08bfdd9a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:13.664979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fa1d6744-491b-42bd-bf1a-4fbf08bfdd9a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:13.673448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fa1d6744-491b-42bd-bf1a-4fbf08bfdd9a tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.173797 May 23 14:08:13.674033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1844/3763] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:13 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:14.690574 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-73de8f9c-efc6-433f-9ab5-a641f09ab874 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:14.691178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-73de8f9c-efc6-433f-9ab5-a641f09ab874 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:14.698899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73de8f9c-efc6-433f-9ab5-a641f09ab874 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:14.699360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73de8f9c-efc6-433f-9ab5-a641f09ab874 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:14.700145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73de8f9c-efc6-433f-9ab5-a641f09ab874 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:14.700618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73de8f9c-efc6-433f-9ab5-a641f09ab874 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:14.835570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-73de8f9c-efc6-433f-9ab5-a641f09ab874 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:14.844227 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-73de8f9c-efc6-433f-9ab5-a641f09ab874 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.157611 May 23 14:08:14.844833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1920/3764] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:14 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:15.862621 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a4c2880-81d8-474f-87b8-c8676ebdd368 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:15.863252 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a4c2880-81d8-474f-87b8-c8676ebdd368 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:15.869884 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a4c2880-81d8-474f-87b8-c8676ebdd368 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:15.870331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a4c2880-81d8-474f-87b8-c8676ebdd368 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:15.871088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a4c2880-81d8-474f-87b8-c8676ebdd368 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:15.871519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a4c2880-81d8-474f-87b8-c8676ebdd368 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:16.010736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a4c2880-81d8-474f-87b8-c8676ebdd368 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:16.019105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a4c2880-81d8-474f-87b8-c8676ebdd368 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160421 May 23 14:08:16.019701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1845/3765] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:15 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:17.037337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e62cfd69-a4b0-4a0e-a814-49b38bdc0690 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:17.037921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e62cfd69-a4b0-4a0e-a814-49b38bdc0690 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:17.046189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e62cfd69-a4b0-4a0e-a814-49b38bdc0690 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:17.046658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e62cfd69-a4b0-4a0e-a814-49b38bdc0690 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:17.047455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e62cfd69-a4b0-4a0e-a814-49b38bdc0690 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:17.047911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e62cfd69-a4b0-4a0e-a814-49b38bdc0690 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:17.199899 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e62cfd69-a4b0-4a0e-a814-49b38bdc0690 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:17.208328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e62cfd69-a4b0-4a0e-a814-49b38bdc0690 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.174991 May 23 14:08:17.208957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1921/3766] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:17 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:18.226172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f0e0d61a-5d12-4ab2-967f-c870c33ceeb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:18.226772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f0e0d61a-5d12-4ab2-967f-c870c33ceeb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:18.235998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0e0d61a-5d12-4ab2-967f-c870c33ceeb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:18.236457 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0e0d61a-5d12-4ab2-967f-c870c33ceeb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:18.237271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0e0d61a-5d12-4ab2-967f-c870c33ceeb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:18.237714 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f0e0d61a-5d12-4ab2-967f-c870c33ceeb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:18.378369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f0e0d61a-5d12-4ab2-967f-c870c33ceeb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:18.387317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f0e0d61a-5d12-4ab2-967f-c870c33ceeb4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.164942 May 23 14:08:18.387896 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1846/3767] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:18 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:19.405665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d21f6d5-635e-46f6-8fd1-c215f3389fe4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:19.406291 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d21f6d5-635e-46f6-8fd1-c215f3389fe4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:19.412307 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d21f6d5-635e-46f6-8fd1-c215f3389fe4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:19.412812 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d21f6d5-635e-46f6-8fd1-c215f3389fe4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:19.413585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d21f6d5-635e-46f6-8fd1-c215f3389fe4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:19.414060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d21f6d5-635e-46f6-8fd1-c215f3389fe4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:19.544133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7d21f6d5-635e-46f6-8fd1-c215f3389fe4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:19.552218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d21f6d5-635e-46f6-8fd1-c215f3389fe4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151875 May 23 14:08:19.552811 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1922/3768] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:19 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:20.569745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5c6a2b1a-ffd0-4ac2-a7ac-75221867bd57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:20.570357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5c6a2b1a-ffd0-4ac2-a7ac-75221867bd57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:20.577883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c6a2b1a-ffd0-4ac2-a7ac-75221867bd57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:20.578337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c6a2b1a-ffd0-4ac2-a7ac-75221867bd57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:20.579097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c6a2b1a-ffd0-4ac2-a7ac-75221867bd57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:20.579539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5c6a2b1a-ffd0-4ac2-a7ac-75221867bd57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:20.708904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5c6a2b1a-ffd0-4ac2-a7ac-75221867bd57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:20.717472 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5c6a2b1a-ffd0-4ac2-a7ac-75221867bd57 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151554 May 23 14:08:20.718135 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1847/3769] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:20 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:21.735286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-002dfaee-71af-453d-8f7f-9a024c432406 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:21.735920 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-002dfaee-71af-453d-8f7f-9a024c432406 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:21.742448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-002dfaee-71af-453d-8f7f-9a024c432406 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:21.742903 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-002dfaee-71af-453d-8f7f-9a024c432406 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:21.743674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-002dfaee-71af-453d-8f7f-9a024c432406 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:21.744113 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-002dfaee-71af-453d-8f7f-9a024c432406 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:21.874808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-002dfaee-71af-453d-8f7f-9a024c432406 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:21.882824 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-002dfaee-71af-453d-8f7f-9a024c432406 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.151387 May 23 14:08:21.883390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1923/3770] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:21 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:08:22.524625 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:08:22.525206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:08:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:08:22.899897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c315ae12-496d-40eb-b053-b3cfc1a73dcd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:22.900505 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c315ae12-496d-40eb-b053-b3cfc1a73dcd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:22.907834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c315ae12-496d-40eb-b053-b3cfc1a73dcd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:22.908290 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c315ae12-496d-40eb-b053-b3cfc1a73dcd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:22.909081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c315ae12-496d-40eb-b053-b3cfc1a73dcd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:22.909514 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c315ae12-496d-40eb-b053-b3cfc1a73dcd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:23.051015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c315ae12-496d-40eb-b053-b3cfc1a73dcd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:23.059643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c315ae12-496d-40eb-b053-b3cfc1a73dcd tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.163525 May 23 14:08:23.060153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1848/3771] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:22 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:24.078157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-583ad052-18ee-401d-befe-76a273e6e599 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:24.078739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-583ad052-18ee-401d-befe-76a273e6e599 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:24.085252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-583ad052-18ee-401d-befe-76a273e6e599 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:24.085713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-583ad052-18ee-401d-befe-76a273e6e599 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:24.086481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-583ad052-18ee-401d-befe-76a273e6e599 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:24.086926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-583ad052-18ee-401d-befe-76a273e6e599 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:24.225465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-583ad052-18ee-401d-befe-76a273e6e599 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:24.234109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-583ad052-18ee-401d-befe-76a273e6e599 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160600 May 23 14:08:24.234688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1924/3772] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:24 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:25.251867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b58db330-513e-40a3-8333-0ec0f8cd58fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:25.252468 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b58db330-513e-40a3-8333-0ec0f8cd58fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:25.259276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b58db330-513e-40a3-8333-0ec0f8cd58fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:25.259797 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b58db330-513e-40a3-8333-0ec0f8cd58fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:25.260488 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b58db330-513e-40a3-8333-0ec0f8cd58fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:25.261713 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b58db330-513e-40a3-8333-0ec0f8cd58fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:25.394009 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b58db330-513e-40a3-8333-0ec0f8cd58fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:25.401650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b58db330-513e-40a3-8333-0ec0f8cd58fb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.153563 May 23 14:08:25.402305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1849/3773] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:25 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:26.418071 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e6683b32-1e92-4897-b36f-5725ff6ebe38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:26.418850 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e6683b32-1e92-4897-b36f-5725ff6ebe38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:26.425620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6683b32-1e92-4897-b36f-5725ff6ebe38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:26.426079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6683b32-1e92-4897-b36f-5725ff6ebe38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:26.426862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6683b32-1e92-4897-b36f-5725ff6ebe38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:26.427303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6683b32-1e92-4897-b36f-5725ff6ebe38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:26.565169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6683b32-1e92-4897-b36f-5725ff6ebe38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:26.573551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e6683b32-1e92-4897-b36f-5725ff6ebe38 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.159327 May 23 14:08:26.574442 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1925/3774] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:26 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:08:27.597460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-321dab09-7ae8-4ea3-ab56-f546fab98617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:27.598098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-321dab09-7ae8-4ea3-ab56-f546fab98617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:27.604880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-321dab09-7ae8-4ea3-ab56-f546fab98617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:27.605327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-321dab09-7ae8-4ea3-ab56-f546fab98617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:27.606756 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-321dab09-7ae8-4ea3-ab56-f546fab98617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:27.607186 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-321dab09-7ae8-4ea3-ab56-f546fab98617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:27.741499 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-321dab09-7ae8-4ea3-ab56-f546fab98617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:27.749859 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-321dab09-7ae8-4ea3-ab56-f546fab98617 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.156342 May 23 14:08:27.750795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1850/3775] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:27 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:28.768150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d358e6be-985a-446a-9797-b3a74d30fd34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:28.768826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d358e6be-985a-446a-9797-b3a74d30fd34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:28.775680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d358e6be-985a-446a-9797-b3a74d30fd34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:28.776137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d358e6be-985a-446a-9797-b3a74d30fd34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:28.776949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d358e6be-985a-446a-9797-b3a74d30fd34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:28.777399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d358e6be-985a-446a-9797-b3a74d30fd34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:29.180547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d358e6be-985a-446a-9797-b3a74d30fd34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:29.189434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d358e6be-985a-446a-9797-b3a74d30fd34 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.425825 May 23 14:08:29.190013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1926/3776] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:28 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:08:30.207419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-376694f8-bc70-4fd7-86d0-aff3665a88b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:30.208030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-376694f8-bc70-4fd7-86d0-aff3665a88b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:30.214605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-376694f8-bc70-4fd7-86d0-aff3665a88b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:30.214979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-376694f8-bc70-4fd7-86d0-aff3665a88b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:30.215796 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-376694f8-bc70-4fd7-86d0-aff3665a88b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:30.216240 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-376694f8-bc70-4fd7-86d0-aff3665a88b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:30.347991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-376694f8-bc70-4fd7-86d0-aff3665a88b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:30.356807 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-376694f8-bc70-4fd7-86d0-aff3665a88b4 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.152454 May 23 14:08:30.357382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1851/3777] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:30 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:31.373889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-44e9e701-0a11-4b2f-9a03-ea5e0240a48d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:31.375051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-44e9e701-0a11-4b2f-9a03-ea5e0240a48d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:31.381527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44e9e701-0a11-4b2f-9a03-ea5e0240a48d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:31.382012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44e9e701-0a11-4b2f-9a03-ea5e0240a48d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:31.382754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44e9e701-0a11-4b2f-9a03-ea5e0240a48d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:31.383201 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-44e9e701-0a11-4b2f-9a03-ea5e0240a48d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:31.519665 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-44e9e701-0a11-4b2f-9a03-ea5e0240a48d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:31.530290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-44e9e701-0a11-4b2f-9a03-ea5e0240a48d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.160298 May 23 14:08:31.531175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1927/3778] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:31 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:32.548337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0f26e24a-a0c7-46e1-bd12-0516d742080f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:32.548983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0f26e24a-a0c7-46e1-bd12-0516d742080f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:32.555552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f26e24a-a0c7-46e1-bd12-0516d742080f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:32.561971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f26e24a-a0c7-46e1-bd12-0516d742080f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:32.561971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f26e24a-a0c7-46e1-bd12-0516d742080f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:32.561971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f26e24a-a0c7-46e1-bd12-0516d742080f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:32.696460 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0f26e24a-a0c7-46e1-bd12-0516d742080f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:32.705981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0f26e24a-a0c7-46e1-bd12-0516d742080f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.162594 May 23 14:08:32.706569 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1852/3779] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:32 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:33.052515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56f3b4ac-bb61-4dfb-99e2-6dc7a5e9073e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd145be5-81a6-4321-92ac-1593823ae0fb"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:33.053672 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56f3b4ac-bb61-4dfb-99e2-6dc7a5e9073e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:33.060557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56f3b4ac-bb61-4dfb-99e2-6dc7a5e9073e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:33.063869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56f3b4ac-bb61-4dfb-99e2-6dc7a5e9073e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:33.063869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56f3b4ac-bb61-4dfb-99e2-6dc7a5e9073e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:33.063869 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56f3b4ac-bb61-4dfb-99e2-6dc7a5e9073e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:33.540775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-87c47925-d7f1-4526-88c6-3f6e9661a7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:33.541294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-87c47925-d7f1-4526-88c6-3f6e9661a7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:33.549003 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87c47925-d7f1-4526-88c6-3f6e9661a7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:33.551111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87c47925-d7f1-4526-88c6-3f6e9661a7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:33.551111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87c47925-d7f1-4526-88c6-3f6e9661a7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:33.551111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-87c47925-d7f1-4526-88c6-3f6e9661a7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:33.574738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-87c47925-d7f1-4526-88c6-3f6e9661a7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lazy-loading 'flavor' on Instance uuid ce6a8553-8450-4844-96db-c1e6124148f7 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:08:34.382405 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-87c47925-d7f1-4526-88c6-3f6e9661a7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/action" status: 202 len: 0 microversion: 2.20 time: 0.845473 May 23 14:08:34.386210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1853/3780] 10.222.0.70 () {62 vars in 1318 bytes} [Mon May 23 14:08:33 2022] POST /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/action => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 14:08:34.388630 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bae41a76-8f4e-43d5-9453-91791551fdaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:34.389755 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bae41a76-8f4e-43d5-9453-91791551fdaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: 6ea1331e-b180-41c8-910a-04b7cff4a9f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:34.396805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bae41a76-8f4e-43d5-9453-91791551fdaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:34.397276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bae41a76-8f4e-43d5-9453-91791551fdaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:34.400619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bae41a76-8f4e-43d5-9453-91791551fdaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:34.400619 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bae41a76-8f4e-43d5-9453-91791551fdaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:34.545914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bae41a76-8f4e-43d5-9453-91791551fdaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:34.554570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bae41a76-8f4e-43d5-9453-91791551fdaf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7" status: 200 len: 1737 microversion: 2.1 time: 0.170380 May 23 14:08:34.555211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1854/3781] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:34 2022] GET /compute/v2.1/servers/6ea1331e-b180-41c8-910a-04b7cff4a9f7 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:08:34.559635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:34.560238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:34.567567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:34.568016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:34.568839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:34.569281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:34.704624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:34.706903 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:34.713356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:34.715068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:34.716149 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2106aa7f-fa67-41aa-a316-ffd570b1960d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.160111 May 23 14:08:34.716795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1855/3782] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:34 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:34.722152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9207f16-8e9b-48a8-ba07-3fa119690b8f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '.version_select at 0x7effb78903a0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:34.867582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9207f16-8e9b-48a8-ba07-3fa119690b8f tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-164593863" status: 202 len: 0 microversion: 2.1 time: 0.149297 May 23 14:08:34.868182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1856/3783] 10.222.0.70 () {58 vars in 1217 bytes} [Mon May 23 14:08:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-164593863 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:08:34.873566 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0bf7daa5-7cd4-4889-a3a2-7a07384860dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:34.874237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0bf7daa5-7cd4-4889-a3a2-7a07384860dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:34.884976 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bf7daa5-7cd4-4889-a3a2-7a07384860dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:34.885437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bf7daa5-7cd4-4889-a3a2-7a07384860dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:34.886232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bf7daa5-7cd4-4889-a3a2-7a07384860dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:34.886694 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0bf7daa5-7cd4-4889-a3a2-7a07384860dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:34.914378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0bf7daa5-7cd4-4889-a3a2-7a07384860dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:08:35.062348 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.api [None req-0bf7daa5-7cd4-4889-a3a2-7a07384860dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Performing DB retry for function nova.db.main.api.instance_update_and_get_original {{(pid=124830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 23 14:08:35.509037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56f3b4ac-bb61-4dfb-99e2-6dc7a5e9073e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.460306 May 23 14:08:35.510391 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1928/3784] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 14:08:33 2022] POST /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 194 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:35.737770 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:35.738906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:35.747689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:35.751659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:35.751659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:35.751659 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:35.902370 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:35.912682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:35.914208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:35.915426 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bcb704e0-7057-4393-be56-da4d116515fa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.183621 May 23 14:08:35.916193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1929/3785] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:35 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:08:36.076959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0bf7daa5-7cd4-4889-a3a2-7a07384860dd tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 204 len: 0 microversion: 2.1 time: 1.207530 May 23 14:08:36.077527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1857/3786] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:08:34 2022] DELETE /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 0 bytes in 1209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 14:08:36.086594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:36.087214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] [instance: 2618bd92-79d0-43b5-8067-c26548f759c3] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:36.093713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:36.095594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:36.096392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:36.096879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:36.111268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] HTTP exception thrown: Instance 2618bd92-79d0-43b5-8067-c26548f759c3 could not be found. May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Request method failure captured: May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 HTTP/1.1 May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zL3O8aGlUhmGawlSY5yyW1yR9CzTOwASfzoPOqo6J80W8zAchwKh2Ngmd8XlvZcahyug6djJlKvjdVKX9jO1hw6FJsgdDmjWos7NQcL0jxyny_fYHrXPLzLX0KmnND84kSxy4Mu-lS3rEsnnm6-nSjD-Gc-9lw1oUi3iPQrcYpvr0 May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 6bb9e74e9b64480a80d45a03945ea51f May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeTestJSON-1226336556 May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:08:36.112983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6bb9e74e9b64480a80d45a03945ea51f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6bb9e74e9b64480a80d45a03945ea51f"}]}] May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeTestJSON-1226336556 May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 6bb9e74e9b64480a80d45a03945ea51f May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1226336556 May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeTestJSON-1226336556-project May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: a58edb91d7b641298e40dd356eec9eac May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeTestJSON-1226336556-project May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance 2618bd92-79d0-43b5-8067-c26548f759c3 could not be found. May 23 14:08:36.115078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '2618bd92-79d0-43b5-8067-c26548f759c3'} May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2618bd92-79d0-43b5-8067-c26548f759c3 could not be found. May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:08:36.116116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2618bd92-79d0-43b5-8067-c26548f759c3 could not be found. May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2618bd92-79d0-43b5-8067-c26548f759c3 could not be found. May 23 14:08:36.117844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:36.119381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] Returning 404 to user: Instance 2618bd92-79d0-43b5-8067-c26548f759c3 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:08:36.119381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b70b823c-5ff0-4533-bbb5-b5f40b24f76d tempest-AttachVolumeTestJSON-1226336556 tempest-AttachVolumeTestJSON-1226336556-project] 10.222.0.70 "GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3" status: 404 len: 111 microversion: 2.1 time: 0.032172 May 23 14:08:36.119381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1930/3787] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:08:36 2022] GET /compute/v2.1/servers/2618bd92-79d0-43b5-8067-c26548f759c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:08:36.582089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-0a53d584-f934-4926-9457-92180fc71fec req-887f2efb-7e73-4eb0-9f54-0a03dc112404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea1331e-b180-41c8-910a-04b7cff4a9f7", "tag": "b04be98e-e124-43f9-b990-a67a4ab0ea9f"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:36.606293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0a53d584-f934-4926-9457-92180fc71fec req-887f2efb-7e73-4eb0-9f54-0a03dc112404 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:36.606951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0a53d584-f934-4926-9457-92180fc71fec req-887f2efb-7e73-4eb0-9f54-0a03dc112404 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:36.624013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-0a53d584-f934-4926-9457-92180fc71fec req-887f2efb-7e73-4eb0-9f54-0a03dc112404 service nova] Creating event network-changed:b04be98e-e124-43f9-b990-a67a4ab0ea9f for instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 on hv-cinder-82549 May 23 14:08:36.642030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-0a53d584-f934-4926-9457-92180fc71fec req-887f2efb-7e73-4eb0-9f54-0a03dc112404 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145153 May 23 14:08:36.642643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1858/3788] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:36.934289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:36.941063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:36.943704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:36.944306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:36.945192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:36.945694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:37.228385 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:37.243997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:37.252992 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:37.254193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b2fcbc7-1780-4078-a395-0c76f3f8a08b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.323990 May 23 14:08:37.254919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1931/3789] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:36 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:37.983729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-a16b6643-8155-4f15-861c-25970028cf0a req-0ed5e82d-b109-41ad-9deb-308bf3a0a258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ddd2ac-4582-4472-a43f-e3a8b4944ed2", "name": "network-vif-unplugged", "status": "completed", "tag": "c4681035-db92-4c8b-8c08-d28d81ee09fa"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:37.994772 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a16b6643-8155-4f15-861c-25970028cf0a req-0ed5e82d-b109-41ad-9deb-308bf3a0a258 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:37.995592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a16b6643-8155-4f15-861c-25970028cf0a req-0ed5e82d-b109-41ad-9deb-308bf3a0a258 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:38.012816 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-a16b6643-8155-4f15-861c-25970028cf0a req-0ed5e82d-b109-41ad-9deb-308bf3a0a258 service nova] Creating event network-vif-unplugged:c4681035-db92-4c8b-8c08-d28d81ee09fa for instance 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 on hv-cinder-82549 May 23 14:08:38.019758 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-a16b6643-8155-4f15-861c-25970028cf0a req-0ed5e82d-b109-41ad-9deb-308bf3a0a258 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150553 May 23 14:08:38.021148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1859/3790] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:08:38.273609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:38.275709 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:38.286001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:38.310047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:38.311010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:38.311468 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:38.321852 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:38.508829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:38.518296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:38.520204 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:38.521689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48107fa7-5155-433b-835c-b8db5ba6da4a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.252912 May 23 14:08:38.522252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1932/3791] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:38 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:38.707570 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-746c5fe6-030e-4691-b2b4-235c9ccf512c req-8f864765-9670-4a9d-8e4b-f74639dd8fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f051b3-679a-43af-909b-a4edda1984fa", "name": "network-vif-deleted", "tag": "134a119a-a4cc-402e-a0e6-6aa02c073149"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:38.725838 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-746c5fe6-030e-4691-b2b4-235c9ccf512c req-8f864765-9670-4a9d-8e4b-f74639dd8fef service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:38.727382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-746c5fe6-030e-4691-b2b4-235c9ccf512c req-8f864765-9670-4a9d-8e4b-f74639dd8fef service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:38.764545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-746c5fe6-030e-4691-b2b4-235c9ccf512c req-8f864765-9670-4a9d-8e4b-f74639dd8fef service nova] Creating event network-vif-deleted:134a119a-a4cc-402e-a0e6-6aa02c073149 for instance 81f051b3-679a-43af-909b-a4edda1984fa on hv-cinder-82549 May 23 14:08:38.771333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-746c5fe6-030e-4691-b2b4-235c9ccf512c req-8f864765-9670-4a9d-8e4b-f74639dd8fef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069189 May 23 14:08:38.772249 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1860/3792] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:39.508163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-cf3b4e7b-696a-408d-9909-5b3c606aca36 req-4ead6516-c4e3-4d4e-b0cb-254bafe53e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ddd2ac-4582-4472-a43f-e3a8b4944ed2", "name": "network-vif-deleted", "tag": "c4681035-db92-4c8b-8c08-d28d81ee09fa"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:39.522130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-cf3b4e7b-696a-408d-9909-5b3c606aca36 req-4ead6516-c4e3-4d4e-b0cb-254bafe53e34 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:39.522973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-cf3b4e7b-696a-408d-9909-5b3c606aca36 req-4ead6516-c4e3-4d4e-b0cb-254bafe53e34 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:39.541665 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:39.542943 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:39.543597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-cf3b4e7b-696a-408d-9909-5b3c606aca36 req-4ead6516-c4e3-4d4e-b0cb-254bafe53e34 service nova] Creating event network-vif-deleted:c4681035-db92-4c8b-8c08-d28d81ee09fa for instance 05ddd2ac-4582-4472-a43f-e3a8b4944ed2 on hv-cinder-82549 May 23 14:08:39.551169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-cf3b4e7b-696a-408d-9909-5b3c606aca36 req-4ead6516-c4e3-4d4e-b0cb-254bafe53e34 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238506 May 23 14:08:39.552604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1933/3793] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:08:39.555380 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:39.556056 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:39.557158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:39.557591 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:40.098997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:40.107042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:40.108553 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:40.110303 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-526011e4-0daf-4371-86d9-a823dd60267a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.572498 May 23 14:08:40.111156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1861/3794] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:39 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:40.860552 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-975cfc9b-ccf1-40da-815b-1bf9bbfa3520 req-a688a29f-e48a-48d5-8852-8abebab29eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea1331e-b180-41c8-910a-04b7cff4a9f7", "name": "network-vif-deleted", "tag": "b04be98e-e124-43f9-b990-a67a4ab0ea9f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:40.873036 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-975cfc9b-ccf1-40da-815b-1bf9bbfa3520 req-a688a29f-e48a-48d5-8852-8abebab29eb9 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:40.873717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-975cfc9b-ccf1-40da-815b-1bf9bbfa3520 req-a688a29f-e48a-48d5-8852-8abebab29eb9 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:40.887062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-975cfc9b-ccf1-40da-815b-1bf9bbfa3520 req-a688a29f-e48a-48d5-8852-8abebab29eb9 service nova] Creating event network-vif-deleted:b04be98e-e124-43f9-b990-a67a4ab0ea9f for instance 6ea1331e-b180-41c8-910a-04b7cff4a9f7 on hv-cinder-82549 May 23 14:08:40.893120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-975cfc9b-ccf1-40da-815b-1bf9bbfa3520 req-a688a29f-e48a-48d5-8852-8abebab29eb9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037770 May 23 14:08:40.896301 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1934/3795] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:41.130305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:41.133698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:41.138608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:41.139067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:41.139880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:41.140313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:41.347326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:41.356117 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:41.357684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:41.358939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-93d7b031-5547-4c92-ad35-0804f3a07e4b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.234062 May 23 14:08:41.359490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1862/3796] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:41 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:42.379984 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:42.381372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:42.383522 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=32 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:42.388752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:42.389216 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:42.390003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:42.390444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:42.553933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:42.563889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:42.567016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:42.568221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7e3241d-0d54-44a1-b2cb-70974e43c173 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.193697 May 23 14:08:42.579714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1935/3797] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:42 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:08:42.992613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-bb6c443e-2dee-48a4-8867-d001aecbcd3f req-259d31b6-1af7-4098-af6d-1b38011305b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d8069e-32b9-4e3b-aabc-a8bf5bd66c55", "name": "network-vif-deleted", "tag": "f2d47605-ebc6-41ec-9a5e-d82223b3b591"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:43.001559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-bb6c443e-2dee-48a4-8867-d001aecbcd3f req-259d31b6-1af7-4098-af6d-1b38011305b5 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:43.002157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-bb6c443e-2dee-48a4-8867-d001aecbcd3f req-259d31b6-1af7-4098-af6d-1b38011305b5 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:43.017774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-bb6c443e-2dee-48a4-8867-d001aecbcd3f req-259d31b6-1af7-4098-af6d-1b38011305b5 service nova] Creating event network-vif-deleted:f2d47605-ebc6-41ec-9a5e-d82223b3b591 for instance 72d8069e-32b9-4e3b-aabc-a8bf5bd66c55 on hv-cinder-82549 May 23 14:08:43.023385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-bb6c443e-2dee-48a4-8867-d001aecbcd3f req-259d31b6-1af7-4098-af6d-1b38011305b5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034954 May 23 14:08:43.023963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1863/3798] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:43.553441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fd1a4d8e-6d81-4ae1-81b8-0471754d943f tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Action: 'create', calling method: .version_select at 0x7effb20e9af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-265929119"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:43.587394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:43.588085 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:43.590088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:43.594934 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:43.595946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:43.596731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:43.597163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:43.738966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:43.746874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:43.748386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:43.749585 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7e36ca04-d033-4070-ae71-1a2c4d5b8c54 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.166369 May 23 14:08:43.750367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1864/3799] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:43 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:08:44.199382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fd1a4d8e-6d81-4ae1-81b8-0471754d943f tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.758560 May 23 14:08:44.200334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1936/3800] 10.222.0.70 () {60 vars in 1154 bytes} [Mon May 23 14:08:43 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 761 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 14:08:44.211993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75acf525-c8f2-41b3-82ab-448a47aded07 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb789f280>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:44.277174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75acf525-c8f2-41b3-82ab-448a47aded07 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 200 len: 344 microversion: 2.1 time: 0.069057 May 23 14:08:44.277965 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1865/3801] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:08:44 2022] GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:44.768973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:44.769595 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:44.779102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:44.779561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:44.780336 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:44.780813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:44.930886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:44.938804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:44.940948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:44.942139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1bab9e1-ce5d-46d0-964a-3ffb6861e070 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.177698 May 23 14:08:44.942679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1937/3802] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:44 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:45.290698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-032753e1-b2a4-4015-8778-4330efb011c6 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb3b75310>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:45.337641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-032753e1-b2a4-4015-8778-4330efb011c6 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 200 len: 344 microversion: 2.1 time: 0.051202 May 23 14:08:45.338217 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1866/3803] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:08:45 2022] GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:45.960868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:45.961487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:45.967969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:45.968424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:45.969239 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:45.969682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:46.105515 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:46.114335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:46.115792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:46.117000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15a075fa-5c66-4d83-9a68-eef305b4834a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.160036 May 23 14:08:46.120712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1938/3804] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:45 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:46.351322 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d5d6ea5d-7cfd-48b1-b78d-3b3534c84b40 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb78ccdc0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:46.407272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d5d6ea5d-7cfd-48b1-b78d-3b3534c84b40 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 200 len: 344 microversion: 2.1 time: 0.060457 May 23 14:08:46.407839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1867/3805] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:08:46 2022] GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:47.137110 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:47.137721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:47.146107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:47.146564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:47.147425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:47.147979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:47.297327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:47.310621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:47.312188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:47.313382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d7901fcc-45ee-40ea-82b2-e6fb47cc655e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.182161 May 23 14:08:47.314047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1939/3806] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:47 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:47.421801 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9a8b6ff8-7bc0-46ea-a8bd-29f73a2ba0c0 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb78ccca0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:47.478032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9a8b6ff8-7bc0-46ea-a8bd-29f73a2ba0c0 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 200 len: 344 microversion: 2.1 time: 0.060046 May 23 14:08:47.478032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1868/3807] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:08:47 2022] GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:48.103352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd145be5-81a6-4321-92ac-1593823ae0fb"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:48.104472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:48.110573 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:48.111025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:48.112397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:48.112883 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:48.200495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Invalid volume: volume bd145be5-81a6-4321-92ac-1593823ae0fb is already attached to instances: 90125c19-518a-4c0d-a38d-49062d11796e May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: POST /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments HTTP/1.1 May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 74 May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:08:48.202325 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {"volumeAttachment": {"volumeId": "bd145be5-81a6-4321-92ac-1593823ae0fb"}} May 23 14:08:48.203940 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Invalid volume: volume bd145be5-81a6-4321-92ac-1593823ae0fb is already attached to instances: 90125c19-518a-4c0d-a38d-49062d11796e May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '90125c19-518a-4c0d-a38d-49062d11796e', 'body': {'volumeAttachment': {'volumeId': 'bd145be5-81a6-4321-92ac-1593823ae0fb'}}} May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bd145be5-81a6-4321-92ac-1593823ae0fb is already attached to instances: 90125c19-518a-4c0d-a38d-49062d11796e May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:48.208753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bd145be5-81a6-4321-92ac-1593823ae0fb is already attached to instances: 90125c19-518a-4c0d-a38d-49062d11796e May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:08:48.210779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:08:48.212589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:08:48.212589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:08:48.212589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:08:48.212589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bd145be5-81a6-4321-92ac-1593823ae0fb is already attached to instances: 90125c19-518a-4c0d-a38d-49062d11796e May 23 14:08:48.212589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:08:48.212589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 400 to user: Invalid volume: volume bd145be5-81a6-4321-92ac-1593823ae0fb is already attached to instances: 90125c19-518a-4c0d-a38d-49062d11796e {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:08:48.212589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ca930a78-8cd7-45a5-8cf4-2c88879dcb1a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104776 May 23 14:08:48.212589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1940/3808] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 14:08:48 2022] POST /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 14:08:48.271586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ac73c52e-10fb-4099-bfdd-9d4dd48f0cc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:48.272113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ac73c52e-10fb-4099-bfdd-9d4dd48f0cc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:48.278395 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac73c52e-10fb-4099-bfdd-9d4dd48f0cc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:48.283811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac73c52e-10fb-4099-bfdd-9d4dd48f0cc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:48.283811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac73c52e-10fb-4099-bfdd-9d4dd48f0cc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:48.283811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac73c52e-10fb-4099-bfdd-9d4dd48f0cc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:48.331598 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:48.332447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:48.339750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:48.340275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:48.341326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:48.341854 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:48.368050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-ac73c52e-10fb-4099-bfdd-9d4dd48f0cc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lazy-loading 'services' on Instance uuid 90125c19-518a-4c0d-a38d-49062d11796e {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:08:48.486016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:48.494154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:48.495717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:48.496911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9916c035-60b7-4988-8797-e53ca5eda5e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.169356 May 23 14:08:48.497458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1941/3809] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:48 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:08:48.501808 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6461b498-ec5d-4739-8445-0cc623e3c426 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb20114c0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:48.552048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6461b498-ec5d-4739-8445-0cc623e3c426 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 200 len: 345 microversion: 2.1 time: 0.053502 May 23 14:08:48.552948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1942/3810] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:08:48 2022] GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:48.563432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ed2cc91-8c74-4b3f-8788-d02fc51b463d tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Action: 'create', calling method: .version_select at 0x7effb1c26280>, body: {"snapshot": {"volume_id": "8f105d78-28be-4abb-9b00-dc318640aa86", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1873240746"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:08:48.652320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ac73c52e-10fb-4099-bfdd-9d4dd48f0cc0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments/bd145be5-81a6-4321-92ac-1593823ae0fb" status: 202 len: 0 microversion: 2.1 time: 0.388518 May 23 14:08:48.652968 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1869/3811] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 14:08:48 2022] DELETE /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments/bd145be5-81a6-4321-92ac-1593823ae0fb => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:08:48.662480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-759e63a6-fbad-4097-addc-cbbb8f4b16c7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:48.663634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-759e63a6-fbad-4097-addc-cbbb8f4b16c7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:48.669962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-759e63a6-fbad-4097-addc-cbbb8f4b16c7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:48.670410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-759e63a6-fbad-4097-addc-cbbb8f4b16c7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:48.671174 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-759e63a6-fbad-4097-addc-cbbb8f4b16c7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:48.671611 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-759e63a6-fbad-4097-addc-cbbb8f4b16c7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:48.704674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-759e63a6-fbad-4097-addc-cbbb8f4b16c7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047023 May 23 14:08:48.706557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1870/3812] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:48 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:08:49.060276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ed2cc91-8c74-4b3f-8788-d02fc51b463d tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.500295 May 23 14:08:49.060905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1943/3813] 10.222.0.70 () {60 vars in 1161 bytes} [Mon May 23 14:08:48 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:08:49.077027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dc4021c0-db6a-49e8-b092-22079fc5120c tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb789fc10>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:49.117940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dc4021c0-db6a-49e8-b092-22079fc5120c tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.049131 May 23 14:08:49.118773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1871/3814] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:49 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:49.131905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d667ad10-9992-4249-ba1a-23bf7090add1 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb794c9d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:49.162623 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d667ad10-9992-4249-ba1a-23bf7090add1 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035587 May 23 14:08:49.163187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1944/3815] 10.222.0.70 () {58 vars in 1139 bytes} [Mon May 23 14:08:49 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:49.173188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8fe40d2-87dd-46a2-b57f-a1637b6ee914 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb4ea9af0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:49.219835 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8fe40d2-87dd-46a2-b57f-a1637b6ee914 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.050490 May 23 14:08:49.220399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1872/3816] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:49 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:49.516327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:49.516911 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:49.523835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:49.524514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:49.525694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:49.526357 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:49.675726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:49.683748 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:49.685285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:49.686445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4cc115fc-5543-4042-90c6-71d15ca1c55a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.174291 May 23 14:08:49.686999 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1945/3817] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:49 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:49.717933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fcb403b9-a534-401e-808f-8f43a00146bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:49.718962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fcb403b9-a534-401e-808f-8f43a00146bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:49.726787 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcb403b9-a534-401e-808f-8f43a00146bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:49.727233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcb403b9-a534-401e-808f-8f43a00146bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:49.727991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcb403b9-a534-401e-808f-8f43a00146bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:49.728469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcb403b9-a534-401e-808f-8f43a00146bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:49.758382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fcb403b9-a534-401e-808f-8f43a00146bc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 May 23 14:08:49.758947 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1873/3818] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:49 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:50.231358 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a657403d-d949-485d-a121-d841c87d1eab tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb1f01430>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:50.261222 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a657403d-d949-485d-a121-d841c87d1eab tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.033729 May 23 14:08:50.261780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1946/3819] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:50 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:50.704759 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:50.706120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:50.713788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:50.714582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:50.715975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:50.716608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:50.770841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-86e52bb5-2484-438a-b091-aa19e8ba18a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:50.771829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-86e52bb5-2484-438a-b091-aa19e8ba18a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:50.781144 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86e52bb5-2484-438a-b091-aa19e8ba18a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:50.781589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86e52bb5-2484-438a-b091-aa19e8ba18a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:50.782422 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86e52bb5-2484-438a-b091-aa19e8ba18a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:50.782862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86e52bb5-2484-438a-b091-aa19e8ba18a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:50.812955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-86e52bb5-2484-438a-b091-aa19e8ba18a6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 May 23 14:08:50.813524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1947/3820] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:50 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:08:50.849686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:50.858115 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:50.859610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:50.860792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a2cee56b-4c3a-4402-a25c-86357f236901 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.160112 May 23 14:08:50.862958 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1874/3821] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:50 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:51.273156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a830812-5116-4714-8cac-cd389c252de3 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb1f01d30>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:51.304154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a830812-5116-4714-8cac-cd389c252de3 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.034876 May 23 14:08:51.304750 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1948/3822] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:51 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:51.826949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf4a8d0a-8026-488b-a49a-6d5527121265 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:51.827848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf4a8d0a-8026-488b-a49a-6d5527121265 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:51.835354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf4a8d0a-8026-488b-a49a-6d5527121265 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:51.835659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf4a8d0a-8026-488b-a49a-6d5527121265 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:51.836437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf4a8d0a-8026-488b-a49a-6d5527121265 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:51.836901 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf4a8d0a-8026-488b-a49a-6d5527121265 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:51.867210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf4a8d0a-8026-488b-a49a-6d5527121265 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 May 23 14:08:51.867899 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1875/3823] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:51 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:51.879820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:51.880434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:51.886604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:51.887126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:51.887826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:51.888323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:52.027295 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:52.035708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:52.037270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:52.038445 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a481454-0965-46ce-9f5b-4e460a7e834e tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.163279 May 23 14:08:52.038988 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1949/3824] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:51 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:52.321369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-846f86e0-5b15-4529-84c5-16c9a08ff16f tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb25be1f0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:52.352975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-846f86e0-5b15-4529-84c5-16c9a08ff16f tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.035892 May 23 14:08:52.353541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1876/3825] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:52 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:52.879123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-99b2a126-a1b1-41a5-b72f-ae7975bc4172 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:52.880191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-99b2a126-a1b1-41a5-b72f-ae7975bc4172 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:52.888024 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99b2a126-a1b1-41a5-b72f-ae7975bc4172 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:52.888477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99b2a126-a1b1-41a5-b72f-ae7975bc4172 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:52.889294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99b2a126-a1b1-41a5-b72f-ae7975bc4172 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:52.889737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99b2a126-a1b1-41a5-b72f-ae7975bc4172 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:52.921588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-99b2a126-a1b1-41a5-b72f-ae7975bc4172 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046342 May 23 14:08:52.922153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1950/3826] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:52 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:08:53.058165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:53.058780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:53.065352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:53.065885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:53.066709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:53.067143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:53.231578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:53.240851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:53.242467 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:53.243660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a24d854-1599-4d22-966e-feeec178cfeb tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.190682 May 23 14:08:53.244261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1877/3827] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:53 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:53.364635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae4fbdd9-57dd-4efe-8756-da6d63dce629 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb794c550>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:53.404860 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae4fbdd9-57dd-4efe-8756-da6d63dce629 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.044338 May 23 14:08:53.405443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1951/3828] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:53 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:53.934810 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a6fea8d-aca5-4166-a771-5de922a5b10d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:53.935723 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a6fea8d-aca5-4166-a771-5de922a5b10d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:53.942024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a6fea8d-aca5-4166-a771-5de922a5b10d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:53.942465 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a6fea8d-aca5-4166-a771-5de922a5b10d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:53.943214 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a6fea8d-aca5-4166-a771-5de922a5b10d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:53.943643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a6fea8d-aca5-4166-a771-5de922a5b10d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:53.973318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a6fea8d-aca5-4166-a771-5de922a5b10d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042407 May 23 14:08:53.973875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1878/3829] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:53 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:54.262486 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:54.263098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:54.269739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:54.270186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:54.270953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:54.271393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:54.409606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:54.419153 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4cfe656-78a4-4cd7-81dc-6c5b2a25626c tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb3b754c0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:54.423577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:54.426278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:54.427980 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-451b17f8-df26-4733-8d04-475a1d9f8883 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.169791 May 23 14:08:54.428820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1952/3830] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:54 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:54.451360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4cfe656-78a4-4cd7-81dc-6c5b2a25626c tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.037843 May 23 14:08:54.451929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1879/3831] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:54 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:08:54.985359 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3e0edb04-4749-48be-8a16-f32a78cb1285 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:54.986294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3e0edb04-4749-48be-8a16-f32a78cb1285 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:54.993095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e0edb04-4749-48be-8a16-f32a78cb1285 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:54.993546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e0edb04-4749-48be-8a16-f32a78cb1285 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:54.994327 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e0edb04-4749-48be-8a16-f32a78cb1285 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:54.994767 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3e0edb04-4749-48be-8a16-f32a78cb1285 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:55.024964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3e0edb04-4749-48be-8a16-f32a78cb1285 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 May 23 14:08:55.025538 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1953/3832] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:54 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:55.447479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:55.448033 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:55.455948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:55.456538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:55.457360 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:55.457793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:55.464880 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ad71bd39-3543-4b33-84f6-f75c8cb41106 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb7915ee0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:55.501840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ad71bd39-3543-4b33-84f6-f75c8cb41106 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.040821 May 23 14:08:55.502309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1954/3833] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:55 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:08:55.594917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:55.604102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:55.605760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:55.606812 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f245318-2496-4b3d-a4a0-8ebd6725a1a2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.164099 May 23 14:08:55.607386 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1880/3834] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:55 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:56.038083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aacb4e60-5374-40a4-a3aa-c27a6061fcde tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:56.038919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aacb4e60-5374-40a4-a3aa-c27a6061fcde tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:56.046188 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aacb4e60-5374-40a4-a3aa-c27a6061fcde tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:56.046636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aacb4e60-5374-40a4-a3aa-c27a6061fcde tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:56.047396 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aacb4e60-5374-40a4-a3aa-c27a6061fcde tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:56.047828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aacb4e60-5374-40a4-a3aa-c27a6061fcde tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:56.078604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aacb4e60-5374-40a4-a3aa-c27a6061fcde tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 May 23 14:08:56.079190 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1955/3835] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:56 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:56.514894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ec2c47f9-4dea-42a7-a968-2253d2018434 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb79019d0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:56.545523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ec2c47f9-4dea-42a7-a968-2253d2018434 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 288 microversion: 2.1 time: 0.035510 May 23 14:08:56.546069 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1881/3836] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:56 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:08:56.557092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f6676cd-c3be-481e-af1d-300909b41d40 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb1c26820>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:56.625394 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:56.626002 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:56.632406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:56.632894 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:56.633657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:56.634092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:56.694876 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f6676cd-c3be-481e-af1d-300909b41d40 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 202 len: 0 microversion: 2.1 time: 0.141494 May 23 14:08:56.695564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1956/3837] 10.222.0.70 () {58 vars in 1253 bytes} [Mon May 23 14:08:56 2022] DELETE /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:08:56.705109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e23759f3-b890-40f0-a3ff-123273da5324 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb1c7bc10>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:56.741471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e23759f3-b890-40f0-a3ff-123273da5324 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.041374 May 23 14:08:56.746212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1957/3838] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:56 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:56.786245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:56.789825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:56.794773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:56.796291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:56.797538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b29f7a2c-ba65-43ca-9894-cb174dc8989c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.176067 May 23 14:08:56.798104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1882/3839] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:56 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:08:57.090614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02352e13-8d7e-46f9-be0d-50370b54476f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:57.091602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02352e13-8d7e-46f9-be0d-50370b54476f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:57.099303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02352e13-8d7e-46f9-be0d-50370b54476f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:57.099761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02352e13-8d7e-46f9-be0d-50370b54476f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:57.100603 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02352e13-8d7e-46f9-be0d-50370b54476f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:57.101054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02352e13-8d7e-46f9-be0d-50370b54476f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:57.132012 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02352e13-8d7e-46f9-be0d-50370b54476f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045442 May 23 14:08:57.132576 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1958/3840] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:57 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:57.756014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-34551537-20ec-4828-9751-df974a895b23 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb7915670>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:57.786180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-34551537-20ec-4828-9751-df974a895b23 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.034794 May 23 14:08:57.786750 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1883/3841] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:57 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:57.817224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:57.817769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:57.824139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:57.824611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:57.825636 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:57.826068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:58.146280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8801860-5184-4be9-9c0c-a4ffc7fb996c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:58.147219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8801860-5184-4be9-9c0c-a4ffc7fb996c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:58.154666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8801860-5184-4be9-9c0c-a4ffc7fb996c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:58.155185 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8801860-5184-4be9-9c0c-a4ffc7fb996c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:58.156143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8801860-5184-4be9-9c0c-a4ffc7fb996c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:58.156724 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8801860-5184-4be9-9c0c-a4ffc7fb996c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:58.202500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8801860-5184-4be9-9c0c-a4ffc7fb996c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060395 May 23 14:08:58.203826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1884/3842] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:58 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:58.230051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:58.239220 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:58.240809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:58.242035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae6b1b0a-ac0d-4cde-a5ff-b82504b7c572 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.429588 May 23 14:08:58.242592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1959/3843] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:57 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:08:58.797581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7b15d7e-2a60-4809-903e-73de8c890185 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb2744ee0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:58.827293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7b15d7e-2a60-4809-903e-73de8c890185 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.033529 May 23 14:08:58.827856 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1885/3844] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:58 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:59.215664 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7aa4bf68-1c9b-4300-b70a-f98dc390b705 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:59.216606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7aa4bf68-1c9b-4300-b70a-f98dc390b705 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:59.223561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aa4bf68-1c9b-4300-b70a-f98dc390b705 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:59.224051 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aa4bf68-1c9b-4300-b70a-f98dc390b705 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:59.224949 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aa4bf68-1c9b-4300-b70a-f98dc390b705 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:59.225394 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aa4bf68-1c9b-4300-b70a-f98dc390b705 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:59.227991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:08:59.257624 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7aa4bf68-1c9b-4300-b70a-f98dc390b705 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 May 23 14:08:59.258026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1960/3845] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:08:59 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:08:59.261641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:59.262248 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:08:59.268378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:59.268850 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:59.269653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:08:59.270081 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:08:59.418203 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:59.427707 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:59.429311 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:08:59.430501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-47b75ccd-8052-46d6-aed2-e3e8848a3f1b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.173308 May 23 14:08:59.431064 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1886/3846] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:08:59 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:08:59.839294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef8c0e0f-7a7e-4d96-b287-7d21c6abe18e tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb1ddcee0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:08:59.870011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef8c0e0f-7a7e-4d96-b287-7d21c6abe18e tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.034632 May 23 14:08:59.870578 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1961/3847] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:08:59 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:09:00.268292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7a328bc7-e268-472f-93ac-1d09f3f04702 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:00.269250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7a328bc7-e268-472f-93ac-1d09f3f04702 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:00.275727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a328bc7-e268-472f-93ac-1d09f3f04702 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:00.276176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a328bc7-e268-472f-93ac-1d09f3f04702 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:00.277006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a328bc7-e268-472f-93ac-1d09f3f04702 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:00.277446 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a328bc7-e268-472f-93ac-1d09f3f04702 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:00.309267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7a328bc7-e268-472f-93ac-1d09f3f04702 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 May 23 14:09:00.309867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1887/3848] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:09:00 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:09:00.449493 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:00.450037 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:00.456474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:00.457140 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:00.458141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:00.458588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:00.599900 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:00.608613 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:00.610519 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:00.611708 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d304899f-34ae-45c2-9cb0-6705b034d153 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.166759 May 23 14:09:00.612249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1962/3849] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:00 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:00.882419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e07612c3-8a9d-45b4-a58c-f732d3d03da5 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb789f310>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:00.915490 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e07612c3-8a9d-45b4-a58c-f732d3d03da5 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 200 len: 287 microversion: 2.1 time: 0.037383 May 23 14:09:00.916072 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1888/3850] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:09:00 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:09:01.325866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5c0fad01-62ce-411f-84c4-ec163de2c898 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:01.325866 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5c0fad01-62ce-411f-84c4-ec163de2c898 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:01.330031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c0fad01-62ce-411f-84c4-ec163de2c898 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:01.330487 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c0fad01-62ce-411f-84c4-ec163de2c898 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:01.331431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c0fad01-62ce-411f-84c4-ec163de2c898 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:01.331901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c0fad01-62ce-411f-84c4-ec163de2c898 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:01.361732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5c0fad01-62ce-411f-84c4-ec163de2c898 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044324 May 23 14:09:01.362304 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1963/3851] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:09:01 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 14:09:01.423944 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15a46c49-c7af-4e15-8446-8f7159e60d9d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:01.424474 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-15a46c49-c7af-4e15-8446-8f7159e60d9d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:01.431152 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15a46c49-c7af-4e15-8446-8f7159e60d9d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:01.431600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15a46c49-c7af-4e15-8446-8f7159e60d9d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:01.432365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15a46c49-c7af-4e15-8446-8f7159e60d9d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:01.432824 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15a46c49-c7af-4e15-8446-8f7159e60d9d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:01.465749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-15a46c49-c7af-4e15-8446-8f7159e60d9d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:09:01.630851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:01.631501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:01.638257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:01.638716 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:01.639495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:01.639937 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:01.817606 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:01.826604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:01.828214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:01.829529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-794fb866-25a1-4574-bbac-7bbac45d59f9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1745 microversion: 2.20 time: 0.203365 May 23 14:09:01.830102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1964/3852] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:01 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1745 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:09:01.856067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-15a46c49-c7af-4e15-8446-8f7159e60d9d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 204 len: 0 microversion: 2.1 time: 0.435420 May 23 14:09:01.856780 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1889/3853] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:09:01 2022] DELETE /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 14:09:01.866075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91ae32f3-c5c6-44f7-91f4-889670148877 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:01.866948 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-91ae32f3-c5c6-44f7-91f4-889670148877 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:01.874710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91ae32f3-c5c6-44f7-91f4-889670148877 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:01.875306 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91ae32f3-c5c6-44f7-91f4-889670148877 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:01.876191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91ae32f3-c5c6-44f7-91f4-889670148877 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:01.876783 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91ae32f3-c5c6-44f7-91f4-889670148877 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:01.928326 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e07ba6b-2f29-49f2-ad21-b44c8f3349b8 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb789fc10>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:01.954841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-2e07ba6b-2f29-49f2-ad21-b44c8f3349b8 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] HTTP exception thrown: Snapshot 2b803df9-86f5-468a-90f6-bf9fa5d31b99 could not be found. May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e07ba6b-2f29-49f2-ad21-b44c8f3349b8 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Request method failure captured: May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 HTTP/1.1 May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii5VrcMNEQdd84YuShQlA0N8Hv8l5nm-0FQXHNKPVPimHQW9k8xgThwasysdbtn6msMuMqZ8rsNUaAO0JN3qz8d8QjnrpFRpXW-PNhRH9cg_3IX0EXXHr0YC16Cua1CtWzbpQsINjatJiGPLZolIjmogI9-IBvR2DBuYQERrvvM3Ga7k May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 9598a5227dfe4afaa88ba746097f9692 May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:09:01.958265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9598a5227dfe4afaa88ba746097f9692"}]}] May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 9598a5227dfe4afaa88ba746097f9692 May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesSnapshotsTestJSON-299753465-project May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 51ad4e3e2edb41c5bee9bd61025c6cdc May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299753465-project May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Snapshot 2b803df9-86f5-468a-90f6-bf9fa5d31b99 could not be found. May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '2b803df9-86f5-468a-90f6-bf9fa5d31b99'} May 23 14:09:01.960084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2b803df9-86f5-468a-90f6-bf9fa5d31b99 could not be found. (HTTP 404) (Request-ID: req-12c5eb86-ae5e-4c2f-983e-591550b42901) May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:01.961233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 14:09:01.962820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2b803df9-86f5-468a-90f6-bf9fa5d31b99 could not be found. May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 14:09:01.964469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2b803df9-86f5-468a-90f6-bf9fa5d31b99 could not be found. May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2b803df9-86f5-468a-90f6-bf9fa5d31b99 could not be found. May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e07ba6b-2f29-49f2-ad21-b44c8f3349b8 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Returning 404 to user: Snapshot 2b803df9-86f5-468a-90f6-bf9fa5d31b99 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:09:01.966084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e07ba6b-2f29-49f2-ad21-b44c8f3349b8 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99" status: 404 len: 111 microversion: 2.1 time: 0.036071 May 23 14:09:01.967238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1890/3854] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 23 14:09:01 2022] GET /compute/v2.1/os-snapshots/2b803df9-86f5-468a-90f6-bf9fa5d31b99 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 14:09:01.968078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-91a6d2e7-bede-46dc-92d4-fbf0e2c7b8ec tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb293fd30>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:02.017743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-91ae32f3-c5c6-44f7-91f4-889670148877 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:02.025667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-91ae32f3-c5c6-44f7-91f4-889670148877 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1681 microversion: 2.1 time: 0.164148 May 23 14:09:02.026238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1965/3855] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:01 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:02.221040 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-91a6d2e7-bede-46dc-92d4-fbf0e2c7b8ec tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 202 len: 0 microversion: 2.1 time: 0.256348 May 23 14:09:02.221605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1891/3856] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 14:09:01 2022] DELETE /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:09:02.229740 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c57f0a3f-cade-4787-89ff-329a0bd9baf5 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb1c26f70>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:02.278556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c57f0a3f-cade-4787-89ff-329a0bd9baf5 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 200 len: 344 microversion: 2.1 time: 0.052553 May 23 14:09:02.279162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1966/3857] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:09:02 2022] GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:09:02.850640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:02.851397 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:02.857484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:02.857923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:02.858710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:02.859138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:02.999301 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:03.007983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:03.009839 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:03.011047 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d9075b6-9096-403d-ba40-56944cded66f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1745 microversion: 2.20 time: 0.165395 May 23 14:09:03.011597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1892/3858] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:02 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:03.046120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2d1ebb46-c8fc-4847-94f5-be0d41c245af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:03.046910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2d1ebb46-c8fc-4847-94f5-be0d41c245af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:03.054959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d1ebb46-c8fc-4847-94f5-be0d41c245af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:03.055458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d1ebb46-c8fc-4847-94f5-be0d41c245af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:03.056293 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d1ebb46-c8fc-4847-94f5-be0d41c245af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:03.056759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2d1ebb46-c8fc-4847-94f5-be0d41c245af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:03.200793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2d1ebb46-c8fc-4847-94f5-be0d41c245af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:03.210149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2d1ebb46-c8fc-4847-94f5-be0d41c245af tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1681 microversion: 2.1 time: 0.170059 May 23 14:09:03.210720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1967/3859] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:03 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:03.291601 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92aaa653-a43e-4dfd-bc3c-f0e54d021894 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb7901ee0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:03.321762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-92aaa653-a43e-4dfd-bc3c-f0e54d021894 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] HTTP exception thrown: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92aaa653-a43e-4dfd-bc3c-f0e54d021894 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Request method failure captured: May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 HTTP/1.1 May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii5VrcMNEQdd84YuShQlA0N8Hv8l5nm-0FQXHNKPVPimHQW9k8xgThwasysdbtn6msMuMqZ8rsNUaAO0JN3qz8d8QjnrpFRpXW-PNhRH9cg_3IX0EXXHr0YC16Cua1CtWzbpQsINjatJiGPLZolIjmogI9-IBvR2DBuYQERrvvM3Ga7k May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 9598a5227dfe4afaa88ba746097f9692 May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:09:03.324041 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9598a5227dfe4afaa88ba746097f9692"}]}] May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 9598a5227dfe4afaa88ba746097f9692 May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesSnapshotsTestJSON-299753465-project May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 51ad4e3e2edb41c5bee9bd61025c6cdc May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299753465-project May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '8f105d78-28be-4abb-9b00-dc318640aa86'} May 23 14:09:03.326373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. (HTTP 404) (Request-ID: req-62328a49-1a23-4938-bdc7-ab67f343dbd1) May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:03.327615 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 14:09:03.329146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 14:09:03.330508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92aaa653-a43e-4dfd-bc3c-f0e54d021894 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Returning 404 to user: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-92aaa653-a43e-4dfd-bc3c-f0e54d021894 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 404 len: 109 microversion: 2.1 time: 0.037998 May 23 14:09:03.332486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1893/3860] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:09:03 2022] GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:09:03.341497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20575fb5-a02f-41c1-a02e-c8e2d12ce338 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb1c26700>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:03.369469 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-20575fb5-a02f-41c1-a02e-c8e2d12ce338 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] HTTP exception thrown: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20575fb5-a02f-41c1-a02e-c8e2d12ce338 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Request method failure captured: May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 HTTP/1.1 May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii5VrcMNEQdd84YuShQlA0N8Hv8l5nm-0FQXHNKPVPimHQW9k8xgThwasysdbtn6msMuMqZ8rsNUaAO0JN3qz8d8QjnrpFRpXW-PNhRH9cg_3IX0EXXHr0YC16Cua1CtWzbpQsINjatJiGPLZolIjmogI9-IBvR2DBuYQERrvvM3Ga7k May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 9598a5227dfe4afaa88ba746097f9692 May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:09:03.371441 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9598a5227dfe4afaa88ba746097f9692"}]}] May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 9598a5227dfe4afaa88ba746097f9692 May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotsTestJSON-299753465-project May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 51ad4e3e2edb41c5bee9bd61025c6cdc May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299753465-project May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '8f105d78-28be-4abb-9b00-dc318640aa86'} May 23 14:09:03.374171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. (HTTP 404) (Request-ID: req-f7e1d773-52dd-4c09-b556-de0ba3f0b2be) May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:03.376098 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 14:09:03.381360 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 14:09:03.382901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20575fb5-a02f-41c1-a02e-c8e2d12ce338 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Returning 404 to user: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-20575fb5-a02f-41c1-a02e-c8e2d12ce338 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 404 len: 109 microversion: 2.1 time: 0.035560 May 23 14:09:03.384548 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1968/3861] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 14:09:03 2022] DELETE /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:09:03.385767 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-79626916-57c5-4557-9bbb-d9640b167d98 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Calling method '.version_select at 0x7effb78cca60>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:03.414410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-79626916-57c5-4557-9bbb-d9640b167d98 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] HTTP exception thrown: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-79626916-57c5-4557-9bbb-d9640b167d98 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Request method failure captured: May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 HTTP/1.1 May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii5VrcMNEQdd84YuShQlA0N8Hv8l5nm-0FQXHNKPVPimHQW9k8xgThwasysdbtn6msMuMqZ8rsNUaAO0JN3qz8d8QjnrpFRpXW-PNhRH9cg_3IX0EXXHr0YC16Cua1CtWzbpQsINjatJiGPLZolIjmogI9-IBvR2DBuYQERrvvM3Ga7k May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 9598a5227dfe4afaa88ba746097f9692 May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:09:03.416359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9598a5227dfe4afaa88ba746097f9692"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9598a5227dfe4afaa88ba746097f9692"}]}] May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 9598a5227dfe4afaa88ba746097f9692 May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299753465 May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesSnapshotsTestJSON-299753465-project May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 51ad4e3e2edb41c5bee9bd61025c6cdc May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299753465-project May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '8f105d78-28be-4abb-9b00-dc318640aa86'} May 23 14:09:03.418073 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. (HTTP 404) (Request-ID: req-07a9163b-368f-4f58-b3bd-ef9fd6b49f6a) May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:03.419013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 14:09:03.420455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 14:09:03.421997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-79626916-57c5-4557-9bbb-d9640b167d98 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] Returning 404 to user: Volume 8f105d78-28be-4abb-9b00-dc318640aa86 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-79626916-57c5-4557-9bbb-d9640b167d98 tempest-VolumesSnapshotsTestJSON-299753465 tempest-VolumesSnapshotsTestJSON-299753465-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86" status: 404 len: 109 microversion: 2.1 time: 0.039058 May 23 14:09:03.423478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1894/3862] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:09:03 2022] GET /compute/v2.1/os-volumes/8f105d78-28be-4abb-9b00-dc318640aa86 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:09:04.030491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:04.036451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:04.049162 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:04.049796 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:04.051312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:04.052126 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:04.230554 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-346eedd6-41d1-46b6-b506-26fdee302913 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:04.231188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-346eedd6-41d1-46b6-b506-26fdee302913 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:04.240177 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-346eedd6-41d1-46b6-b506-26fdee302913 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:04.240815 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-346eedd6-41d1-46b6-b506-26fdee302913 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:04.241771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-346eedd6-41d1-46b6-b506-26fdee302913 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:04.243075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-346eedd6-41d1-46b6-b506-26fdee302913 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:04.379274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:04.388961 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:04.391607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:04.393004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e70ae482-274c-40da-82ff-1b98673bb841 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1745 microversion: 2.20 time: 0.367258 May 23 14:09:04.393634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1969/3863] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:04 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1745 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:04.455962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-346eedd6-41d1-46b6-b506-26fdee302913 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:04.465253 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-346eedd6-41d1-46b6-b506-26fdee302913 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1681 microversion: 2.1 time: 0.240056 May 23 14:09:04.466038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1895/3864] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:04 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:09:04.891775 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-10f63c18-ceb9-4962-ad72-98a261275d52 req-9bc82fda-1806-4090-b595-344a4e48cae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90125c19-518a-4c0d-a38d-49062d11796e", "name": "network-vif-deleted", "tag": "20f9d7dd-294d-470d-a93d-2e0a58b960e2"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:04.903660 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-10f63c18-ceb9-4962-ad72-98a261275d52 req-9bc82fda-1806-4090-b595-344a4e48cae0 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:04.904532 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-10f63c18-ceb9-4962-ad72-98a261275d52 req-9bc82fda-1806-4090-b595-344a4e48cae0 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:04.949123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-10f63c18-ceb9-4962-ad72-98a261275d52 req-9bc82fda-1806-4090-b595-344a4e48cae0 service nova] Creating event network-vif-deleted:20f9d7dd-294d-470d-a93d-2e0a58b960e2 for instance 90125c19-518a-4c0d-a38d-49062d11796e on hv-cinder-82549 May 23 14:09:04.949123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-10f63c18-ceb9-4962-ad72-98a261275d52 req-9bc82fda-1806-4090-b595-344a4e48cae0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058873 May 23 14:09:04.949123 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1970/3865] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:09:05.425271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:05.425775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:05.440558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:05.441799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:05.443019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:05.443742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:05.484009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:05.485611 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:05.493484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:05.499249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:05.499249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:05.499249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:05.550629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:05.551706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:05.552453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lazy-loading 'fault' on Instance uuid 90125c19-518a-4c0d-a38d-49062d11796e {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:09:05.612421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:05.622395 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85f57b78-7381-4469-a4ea-85abb4c121fe tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 200 len: 1332 microversion: 2.1 time: 0.142452 May 23 14:09:05.624727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1971/3866] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:05 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 1332 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:09:05.635699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:05.643157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:05.646007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:05.647454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c0020cc3-71a4-4756-88ce-073bffc2a6b4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1745 microversion: 2.20 time: 0.238675 May 23 14:09:05.648035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1896/3867] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:05 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:09:05.862225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-4b2936f7-5197-4715-b479-85257f747fdd req-328c9177-85f5-4d93-aed1-60444065bb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6a8553-8450-4844-96db-c1e6124148f7", "name": "network-vif-plugged", "status": "completed", "tag": "fb68c5de-2cf4-41d5-9537-632b1b17098e"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:05.872366 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4b2936f7-5197-4715-b479-85257f747fdd req-328c9177-85f5-4d93-aed1-60444065bb94 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:05.877346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4b2936f7-5197-4715-b479-85257f747fdd req-328c9177-85f5-4d93-aed1-60444065bb94 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:05.891840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-4b2936f7-5197-4715-b479-85257f747fdd req-328c9177-85f5-4d93-aed1-60444065bb94 service nova] Creating event network-vif-plugged:fb68c5de-2cf4-41d5-9537-632b1b17098e for instance ce6a8553-8450-4844-96db-c1e6124148f7 on hv-cinder-82549 May 23 14:09:05.897798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-4b2936f7-5197-4715-b479-85257f747fdd req-328c9177-85f5-4d93-aed1-60444065bb94 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039473 May 23 14:09:05.899200 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1972/3868] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:09:06.646015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:06.646622 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:06.662273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:06.662997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:06.663974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:06.664414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:06.671564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:06.672778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:06.680511 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e HTTP/1.1 May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:09:06.682557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:09:06.685921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '90125c19-518a-4c0d-a38d-49062d11796e'} May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:09:06.687696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:09:06.690845 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:09:06.697294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:09:06.697294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-868eac17-a98e-4834-95ec-52616fd3f8e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 404 len: 111 microversion: 2.1 time: 0.042577 May 23 14:09:06.697294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1897/3869] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:06 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 14:09:06.697829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:06.698049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5cc44925-38c4-489d-be3a-ccc407df9b96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '.version_select at 0x7effb79285e0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:06.698233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:06.699059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:06.699912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:06.810586 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5cc44925-38c4-489d-be3a-ccc407df9b96 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240932084" status: 202 len: 0 microversion: 2.1 time: 0.117920 May 23 14:09:06.811244 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1898/3870] 10.222.0.70 () {58 vars in 1220 bytes} [Mon May 23 14:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240932084 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:09:06.869945 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:06.879537 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:06.881177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:06.884518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-681db522-828b-42d5-835f-6442487c59e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.218848 May 23 14:09:06.884518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1973/3871] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:06 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:07.904832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:07.905692 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:07.915902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:07.921642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:07.923039 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:07.923589 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:07.987556 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c281ba5e-2c8c-4b89-8919-92b968c1c763 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: .version_select at 0x7effb794cee0>, body: {"keypair": {"name": "tempest-keypair-1724050609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpMRZRO016pEoZOK94/I+ApfL8F5qjGvqGYfiUrm6/seNZxWMtD0M4De8dR53CfaXwB0b3EJSDs/BiBoq9C8n9ixb0cWnujFHq5ZiAok3wwAbz3/icMTdvJ8AN7Ax9Jew=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:08.023853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-c281ba5e-2c8c-4b89-8919-92b968c1c763 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for project 7649fa9a0ae4411aabf060f99e691520. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:09:08.028752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-c281ba5e-2c8c-4b89-8919-92b968c1c763 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for user cf30fa512142489a8dea40ce426a5f36 and project 7649fa9a0ae4411aabf060f99e691520. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:09:08.161173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c281ba5e-2c8c-4b89-8919-92b968c1c763 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176166 May 23 14:09:08.164894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1974/3872] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 14:09:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:09:08.241469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:08.256313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:08.258568 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:08.259774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-14003a19-ab64-4b9b-b882-8826cb2936d2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.361845 May 23 14:09:08.272090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1899/3873] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:07 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:09.281294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:09.282212 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:09.292219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:09.292939 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:09.294274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:09.294842 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:09.528075 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:09.541035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:09.542607 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:09.543800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6fdc087c-28e6-4c4c-8efe-696b91b20938 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.268366 May 23 14:09:09.544354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1975/3874] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:09 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:10.564623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:10.565389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:10.579981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:10.580477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:10.581644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:10.588231 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:10.779239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:10.798220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:10.799791 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:10.801770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a69de76b-7910-493f-b058-3a790170f5b0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.241731 May 23 14:09:10.812284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1900/3875] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:10 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:11.529891 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1684013928", "imageRef": "fa7d93f2-93a1-452a-b684-19185ba2d579", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ebb3f7b-57db-46b5-ba41-00b71beb6e1e"}], "security_groups": [{"name": "tempest-securitygroup--899749696"}], "key_name": "tempest-keypair-1724050609", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:11.670617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] validate_networks() for [('2ebb3f7b-57db-46b5-ba41-00b71beb6e1e', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 14:09:11.819439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:11.820664 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:11.828010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:11.828461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:11.829257 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:11.829696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:12.125600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:12.137259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:12.140709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:12.153235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19163cca-54bd-4846-9d17-78786df78b0b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.326831 May 23 14:09:12.153235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1901/3876] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:11 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:09:12.326149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 14:09:12.327237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 14:09:12.328052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 14:09:12.328373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 14:09:12.328851 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 14:09:12.358488 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:12.359405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:12.360514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:12.360944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:12.388299 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for project 7649fa9a0ae4411aabf060f99e691520. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:09:12.394328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Getting quotas for user cf30fa512142489a8dea40ce426a5f36 and project 7649fa9a0ae4411aabf060f99e691520. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:09:12.409269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 14:09:12.412133 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa7d93f2-93a1-452a-b684-19185ba2d579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 14:09:12.573001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bad693ca-e8f9-44a5-9c4b-0d6867c3a840 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.048272 May 23 14:09:12.575473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1976/3877] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 14:09:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 14:09:12.588305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7507068b-cc95-4c88-b487-d75b3ac5f250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:12.588966 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7507068b-cc95-4c88-b487-d75b3ac5f250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:12.654272 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7507068b-cc95-4c88-b487-d75b3ac5f250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:12.663282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7507068b-cc95-4c88-b487-d75b3ac5f250 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1242 microversion: 2.1 time: 0.079829 May 23 14:09:12.665940 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1902/3878] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:12 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:13.161802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:13.162529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:13.164714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:13.171727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:13.178620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:13.178620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:13.178620 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:13.369673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:13.377912 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:13.379626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:13.380915 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f204b84c-70fb-48e5-9d92-0b8f714a618d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.224063 May 23 14:09:13.381615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1977/3879] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:13 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:09:13.683532 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3f34f1d9-7668-4da3-95fa-dd41c4a988d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:13.684806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3f34f1d9-7668-4da3-95fa-dd41c4a988d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:13.687698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:13.753305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f34f1d9-7668-4da3-95fa-dd41c4a988d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:13.760969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3f34f1d9-7668-4da3-95fa-dd41c4a988d3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1242 microversion: 2.1 time: 0.081904 May 23 14:09:13.761559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1903/3880] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:13 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:14.399705 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:14.400444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:14.408009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:14.408527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:14.409432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:14.410443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:14.555055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:14.563760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:14.565655 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:14.567484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a8d77f5-30e5-4319-adaf-353d82bea127 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.171710 May 23 14:09:14.568157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1978/3881] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:14 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:14.779111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fac0fa41-bc32-41b9-9f60-cdf3f78e6617 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:14.779690 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fac0fa41-bc32-41b9-9f60-cdf3f78e6617 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:14.787269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fac0fa41-bc32-41b9-9f60-cdf3f78e6617 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:14.787725 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fac0fa41-bc32-41b9-9f60-cdf3f78e6617 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:14.788501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fac0fa41-bc32-41b9-9f60-cdf3f78e6617 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:14.788969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fac0fa41-bc32-41b9-9f60-cdf3f78e6617 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:14.866019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fac0fa41-bc32-41b9-9f60-cdf3f78e6617 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:14.873717 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fac0fa41-bc32-41b9-9f60-cdf3f78e6617 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1238 microversion: 2.1 time: 0.099108 May 23 14:09:14.874284 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1904/3882] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:14 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:15.594879 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:15.605228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:15.605228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:15.605228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:15.605802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:15.606440 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:15.841332 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:15.852917 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:15.854432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:15.855609 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02dd443c-1f36-4427-b88b-4b0cf342dc50 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.264977 May 23 14:09:15.856169 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1979/3883] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:15 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:15.892294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a3b7d293-f17f-4392-a216-1be43d3eea17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:15.893848 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a3b7d293-f17f-4392-a216-1be43d3eea17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:15.906974 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3b7d293-f17f-4392-a216-1be43d3eea17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:15.907428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3b7d293-f17f-4392-a216-1be43d3eea17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:15.921061 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3b7d293-f17f-4392-a216-1be43d3eea17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:15.921604 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a3b7d293-f17f-4392-a216-1be43d3eea17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:16.054057 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a3b7d293-f17f-4392-a216-1be43d3eea17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:16.084941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a3b7d293-f17f-4392-a216-1be43d3eea17 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1302 microversion: 2.1 time: 0.187589 May 23 14:09:16.087048 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1905/3884] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:15 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1302 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:16.879349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:16.879349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:16.884972 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:16.885430 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:16.886612 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:16.887069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:17.069544 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:17.086477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:17.088919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:17.090458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c4eef25f-75ce-4b37-9e8c-f4cd7c2f05f4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.220445 May 23 14:09:17.091610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1980/3885] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:16 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:17.114420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0c0a4588-b94d-490a-90c0-962fcab58f18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:17.116454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0c0a4588-b94d-490a-90c0-962fcab58f18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:17.133661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c0a4588-b94d-490a-90c0-962fcab58f18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:17.133661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c0a4588-b94d-490a-90c0-962fcab58f18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:17.133661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c0a4588-b94d-490a-90c0-962fcab58f18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:17.133661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c0a4588-b94d-490a-90c0-962fcab58f18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:17.351310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0c0a4588-b94d-490a-90c0-962fcab58f18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:17.359178 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0c0a4588-b94d-490a-90c0-962fcab58f18 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.250923 May 23 14:09:17.359753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1906/3886] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:17 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:18.113317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:18.114760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:18.121557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:18.122021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:18.122801 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:18.123243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:18.262038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:18.270682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:18.272195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:18.273384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9a8dc45-613e-4f96-82de-42d22c3acf75 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.164142 May 23 14:09:18.273932 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1981/3887] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:18 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:18.379814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4508a7b9-c04a-4f9d-ada1-2c54276aec1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:18.381044 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4508a7b9-c04a-4f9d-ada1-2c54276aec1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:18.387949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4508a7b9-c04a-4f9d-ada1-2c54276aec1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:18.388400 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4508a7b9-c04a-4f9d-ada1-2c54276aec1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:18.389196 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4508a7b9-c04a-4f9d-ada1-2c54276aec1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:18.389632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4508a7b9-c04a-4f9d-ada1-2c54276aec1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:18.528316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4508a7b9-c04a-4f9d-ada1-2c54276aec1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:18.536092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4508a7b9-c04a-4f9d-ada1-2c54276aec1c tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.163893 May 23 14:09:18.537158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1907/3888] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:18 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:19.291853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:19.292473 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:19.299601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:19.300060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:19.300990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:19.301644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:19.317446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:19.436993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:19.446490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:19.448062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:19.449244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a285261b-6593-4b51-be6c-2a31505ad1b5 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.161415 May 23 14:09:19.449803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1982/3889] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:19 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:19.553519 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55fd70c4-366a-445a-9987-f5073ae4c552 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:19.554181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55fd70c4-366a-445a-9987-f5073ae4c552 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:19.560916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55fd70c4-366a-445a-9987-f5073ae4c552 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:19.561365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55fd70c4-366a-445a-9987-f5073ae4c552 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:19.562163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55fd70c4-366a-445a-9987-f5073ae4c552 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:19.562561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55fd70c4-366a-445a-9987-f5073ae4c552 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:19.582777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:19.702143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55fd70c4-366a-445a-9987-f5073ae4c552 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:19.710555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55fd70c4-366a-445a-9987-f5073ae4c552 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.160963 May 23 14:09:19.711127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1908/3890] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:19 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:20.467978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:20.468666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:20.476699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:20.477166 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:20.477959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:20.478409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:20.672026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:20.690326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:20.691588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:20.693145 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bd124a1e-2724-4c90-9e25-aa8a3b4ea7b7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1740 microversion: 2.20 time: 0.229061 May 23 14:09:20.694100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1983/3891] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:20 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:20.729544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8e782f97-586a-48d7-93f2-999d7a1e63e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:20.730768 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8e782f97-586a-48d7-93f2-999d7a1e63e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:20.737745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e782f97-586a-48d7-93f2-999d7a1e63e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:20.738219 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e782f97-586a-48d7-93f2-999d7a1e63e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:20.742952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e782f97-586a-48d7-93f2-999d7a1e63e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:20.742952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e782f97-586a-48d7-93f2-999d7a1e63e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:20.914712 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-1a336c20-6951-4bb6-80e3-b06f404deb97 req-c0bb540a-ce75-438e-ab40-2f9946841e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720a375f-fecc-48d5-a0a5-536cc425ec01", "tag": "a13000b8-e089-4127-af45-e46e54fbaf8c"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:20.923897 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-1a336c20-6951-4bb6-80e3-b06f404deb97 req-c0bb540a-ce75-438e-ab40-2f9946841e82 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:20.924514 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-1a336c20-6951-4bb6-80e3-b06f404deb97 req-c0bb540a-ce75-438e-ab40-2f9946841e82 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:20.937604 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-1a336c20-6951-4bb6-80e3-b06f404deb97 req-c0bb540a-ce75-438e-ab40-2f9946841e82 service nova] Creating event network-changed:a13000b8-e089-4127-af45-e46e54fbaf8c for instance 720a375f-fecc-48d5-a0a5-536cc425ec01 on hv-cinder-82549 May 23 14:09:20.943594 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-1a336c20-6951-4bb6-80e3-b06f404deb97 req-c0bb540a-ce75-438e-ab40-2f9946841e82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033910 May 23 14:09:20.944707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1984/3892] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:09:20.965089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8e782f97-586a-48d7-93f2-999d7a1e63e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:20.974316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8e782f97-586a-48d7-93f2-999d7a1e63e5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.248647 May 23 14:09:20.975769 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1909/3893] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:20 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:21.717738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:21.718446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:21.726344 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:21.727003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:21.727798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:21.728247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:21.971412 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:21.986010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:21.995530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8b4d907e-c6bd-4cf9-848b-24b9c579f9f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:21.996682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8b4d907e-c6bd-4cf9-848b-24b9c579f9f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:22.000696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:22.008283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92f6f2d6-ce94-43f1-aa74-341ea2599f74 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1722 microversion: 2.20 time: 0.294758 May 23 14:09:22.012847 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1985/3894] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:21 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:22.014912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b4d907e-c6bd-4cf9-848b-24b9c579f9f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:22.015369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b4d907e-c6bd-4cf9-848b-24b9c579f9f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:22.016154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b4d907e-c6bd-4cf9-848b-24b9c579f9f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:22.016677 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8b4d907e-c6bd-4cf9-848b-24b9c579f9f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:22.227450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8b4d907e-c6bd-4cf9-848b-24b9c579f9f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:22.244021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8b4d907e-c6bd-4cf9-848b-24b9c579f9f7 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.256137 May 23 14:09:22.253635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1910/3895] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:21 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:23.029749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:23.030349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:23.032340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:23.035982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:23.039874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:23.040334 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:23.041158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:23.041627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:23.184734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:23.194122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:23.195645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:23.199034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-71dc1f2d-131c-44b3-8607-8f19466fa47a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1722 microversion: 2.20 time: 0.171169 May 23 14:09:23.199034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1986/3896] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:23 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:23.261642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-037d23fb-5fbe-40b9-b7c2-7fc22df8e09e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:23.262493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-037d23fb-5fbe-40b9-b7c2-7fc22df8e09e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:23.268985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-037d23fb-5fbe-40b9-b7c2-7fc22df8e09e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:23.270202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-037d23fb-5fbe-40b9-b7c2-7fc22df8e09e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:23.271042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-037d23fb-5fbe-40b9-b7c2-7fc22df8e09e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:23.271375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-037d23fb-5fbe-40b9-b7c2-7fc22df8e09e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:23.415832 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-037d23fb-5fbe-40b9-b7c2-7fc22df8e09e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:23.423526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-037d23fb-5fbe-40b9-b7c2-7fc22df8e09e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.165757 May 23 14:09:23.424102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1911/3897] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:23 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:24.217160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:24.217778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:24.224814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:24.225270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:24.226049 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:24.226491 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:24.373091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:24.383159 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:24.384710 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:24.385893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f1597ad3-845c-4da9-a0e8-07f81f4137db tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1722 microversion: 2.20 time: 0.172729 May 23 14:09:24.386444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1987/3898] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:24 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:24.440683 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3dd44d1d-52d2-41e2-b91a-614fc1a6d2e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:24.441286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3dd44d1d-52d2-41e2-b91a-614fc1a6d2e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:24.443754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:24.449032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dd44d1d-52d2-41e2-b91a-614fc1a6d2e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:24.449478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dd44d1d-52d2-41e2-b91a-614fc1a6d2e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:24.450226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dd44d1d-52d2-41e2-b91a-614fc1a6d2e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:24.450654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dd44d1d-52d2-41e2-b91a-614fc1a6d2e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:24.599535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3dd44d1d-52d2-41e2-b91a-614fc1a6d2e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:24.607458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3dd44d1d-52d2-41e2-b91a-614fc1a6d2e1 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.170633 May 23 14:09:24.608026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1912/3899] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:24 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:24.807628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-bab7f4e2-5c51-4296-9f5c-2b28309f6bb5 req-a8188b22-5e2c-4afd-bf20-40e32776eedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6a8553-8450-4844-96db-c1e6124148f7", "name": "network-vif-unplugged", "status": "completed", "tag": "fb68c5de-2cf4-41d5-9537-632b1b17098e"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:24.814577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-bab7f4e2-5c51-4296-9f5c-2b28309f6bb5 req-a8188b22-5e2c-4afd-bf20-40e32776eedb service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:24.815026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-bab7f4e2-5c51-4296-9f5c-2b28309f6bb5 req-a8188b22-5e2c-4afd-bf20-40e32776eedb service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:24.827472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-bab7f4e2-5c51-4296-9f5c-2b28309f6bb5 req-a8188b22-5e2c-4afd-bf20-40e32776eedb service nova] Creating event network-vif-unplugged:fb68c5de-2cf4-41d5-9537-632b1b17098e for instance ce6a8553-8450-4844-96db-c1e6124148f7 on hv-cinder-82549 May 23 14:09:24.834335 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-bab7f4e2-5c51-4296-9f5c-2b28309f6bb5 req-a8188b22-5e2c-4afd-bf20-40e32776eedb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030966 May 23 14:09:24.834960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1988/3900] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:09:25.405371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:25.405981 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:25.413367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:25.417104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:25.417104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:25.417104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:25.561362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:25.570454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:25.571969 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:25.573179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55131851-6650-4b18-8b60-e348ac7d2dd0 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1722 microversion: 2.20 time: 0.172196 May 23 14:09:25.573738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1913/3901] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:25 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:25.625213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f5c7e963-8b3d-4526-a385-dcf2381cc85a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:25.625924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f5c7e963-8b3d-4526-a385-dcf2381cc85a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:25.633061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5c7e963-8b3d-4526-a385-dcf2381cc85a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:25.633517 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5c7e963-8b3d-4526-a385-dcf2381cc85a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:25.634321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5c7e963-8b3d-4526-a385-dcf2381cc85a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:25.634761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f5c7e963-8b3d-4526-a385-dcf2381cc85a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:25.774076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f5c7e963-8b3d-4526-a385-dcf2381cc85a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:25.781630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f5c7e963-8b3d-4526-a385-dcf2381cc85a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.161171 May 23 14:09:25.782197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1989/3902] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:25 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:26.591559 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:26.592176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:26.600227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:26.600730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:26.601687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:26.602770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:26.787120 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:26.797785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:26.799651 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9157851e-2a13-4b3e-b5b0-a946c11be943 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:26.800415 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9157851e-2a13-4b3e-b5b0-a946c11be943 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:26.803312 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:26.806538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9a38306-a27b-47c0-8b07-22e3af8a7669 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1665 microversion: 2.20 time: 0.218331 May 23 14:09:26.808269 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1914/3903] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:26 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1665 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:26.811000 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9157851e-2a13-4b3e-b5b0-a946c11be943 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:26.811476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9157851e-2a13-4b3e-b5b0-a946c11be943 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:26.812273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9157851e-2a13-4b3e-b5b0-a946c11be943 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:26.812978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9157851e-2a13-4b3e-b5b0-a946c11be943 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:26.835193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65b7573f-5f99-4a74-bbd2-72ffb23ec7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aede58e4-9f1c-4784-a9a1-b632223531d4"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:26.835793 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-65b7573f-5f99-4a74-bbd2-72ffb23ec7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:26.842617 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65b7573f-5f99-4a74-bbd2-72ffb23ec7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:26.843424 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65b7573f-5f99-4a74-bbd2-72ffb23ec7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:26.844356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65b7573f-5f99-4a74-bbd2-72ffb23ec7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:26.846676 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-65b7573f-5f99-4a74-bbd2-72ffb23ec7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:26.975730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9157851e-2a13-4b3e-b5b0-a946c11be943 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:26.983810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9157851e-2a13-4b3e-b5b0-a946c11be943 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.188177 May 23 14:09:26.984388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1990/3904] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:26 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:09:27.976298 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65b7573f-5f99-4a74-bbd2-72ffb23ec7e3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.153079 May 23 14:09:27.976995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1915/3905] 10.222.0.70 () {62 vars in 1363 bytes} [Mon May 23 14:09:26 2022] POST /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/os-volume_attachments => generated 188 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 14:09:28.003337 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d595dc54-37e2-43bf-89be-87acb6308ce5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:28.004416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d595dc54-37e2-43bf-89be-87acb6308ce5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:28.016618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d595dc54-37e2-43bf-89be-87acb6308ce5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:28.017446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d595dc54-37e2-43bf-89be-87acb6308ce5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:28.018862 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d595dc54-37e2-43bf-89be-87acb6308ce5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:28.019730 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d595dc54-37e2-43bf-89be-87acb6308ce5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:28.114766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-86fad660-d3c5-489f-bdec-81abac5e9950 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:28.118111 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-86fad660-d3c5-489f-bdec-81abac5e9950 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:28.123471 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86fad660-d3c5-489f-bdec-81abac5e9950 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:28.124218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86fad660-d3c5-489f-bdec-81abac5e9950 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:28.125138 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86fad660-d3c5-489f-bdec-81abac5e9950 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:28.125977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86fad660-d3c5-489f-bdec-81abac5e9950 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:28.179008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d595dc54-37e2-43bf-89be-87acb6308ce5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:28.189465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d595dc54-37e2-43bf-89be-87acb6308ce5 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.191834 May 23 14:09:28.196905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1991/3906] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:27 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:28.829540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-86fad660-d3c5-489f-bdec-81abac5e9950 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/os-volume_attachments/aede58e4-9f1c-4784-a9a1-b632223531d4" status: 202 len: 0 microversion: 2.20 time: 0.718227 May 23 14:09:28.829540 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1916/3907] 10.222.0.70 () {60 vars in 1456 bytes} [Mon May 23 14:09:28 2022] DELETE /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/os-volume_attachments/aede58e4-9f1c-4784-a9a1-b632223531d4 => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 14:09:28.888348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-40d4900a-e1af-47b4-8fdb-f75a8e9b14f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:28.888944 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40d4900a-e1af-47b4-8fdb-f75a8e9b14f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:28.895848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40d4900a-e1af-47b4-8fdb-f75a8e9b14f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:28.896294 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40d4900a-e1af-47b4-8fdb-f75a8e9b14f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:28.897125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40d4900a-e1af-47b4-8fdb-f75a8e9b14f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:28.897566 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40d4900a-e1af-47b4-8fdb-f75a8e9b14f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:29.033680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-8f8d37c7-fd81-48e1-98f5-3ad5006494bd req-9c5c4bf0-5ede-4a11-a16a-5cd7dfe0941c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720a375f-fecc-48d5-a0a5-536cc425ec01", "name": "network-vif-plugged", "status": "completed", "tag": "a13000b8-e089-4127-af45-e46e54fbaf8c"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:29.049760 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8f8d37c7-fd81-48e1-98f5-3ad5006494bd req-9c5c4bf0-5ede-4a11-a16a-5cd7dfe0941c service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:29.050199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8f8d37c7-fd81-48e1-98f5-3ad5006494bd req-9c5c4bf0-5ede-4a11-a16a-5cd7dfe0941c service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:29.063803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-8f8d37c7-fd81-48e1-98f5-3ad5006494bd req-9c5c4bf0-5ede-4a11-a16a-5cd7dfe0941c service nova] Creating event network-vif-plugged:a13000b8-e089-4127-af45-e46e54fbaf8c for instance 720a375f-fecc-48d5-a0a5-536cc425ec01 on hv-cinder-82549 May 23 14:09:29.069229 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-8f8d37c7-fd81-48e1-98f5-3ad5006494bd req-9c5c4bf0-5ede-4a11-a16a-5cd7dfe0941c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045697 May 23 14:09:29.071329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1917/3908] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:09:29.209352 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e610f1f3-757d-475b-8998-a32d0de6a4fc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:29.210088 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e610f1f3-757d-475b-8998-a32d0de6a4fc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:29.217078 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e610f1f3-757d-475b-8998-a32d0de6a4fc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:29.217533 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e610f1f3-757d-475b-8998-a32d0de6a4fc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:29.218354 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e610f1f3-757d-475b-8998-a32d0de6a4fc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:29.218778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e610f1f3-757d-475b-8998-a32d0de6a4fc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:29.258180 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-40d4900a-e1af-47b4-8fdb-f75a8e9b14f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "POST /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/action" status: 202 len: 0 microversion: 2.20 time: 0.373607 May 23 14:09:29.263305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1992/3909] 10.222.0.70 () {62 vars in 1318 bytes} [Mon May 23 14:09:28 2022] POST /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 14:09:29.271650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:29.283692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:29.290943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:29.292192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:29.293763 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:29.294389 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:29.417608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e610f1f3-757d-475b-8998-a32d0de6a4fc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:29.427101 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e610f1f3-757d-475b-8998-a32d0de6a4fc tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.222761 May 23 14:09:29.428406 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1918/3910] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:29 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:09:29.542754 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:29.556165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:29.558136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:29.559361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-522d751d-4e68-41a8-8b67-198d36a7ac8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1673 microversion: 2.20 time: 0.294607 May 23 14:09:29.560017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1993/3911] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:29 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1673 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:30.446369 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3abaec95-2cdc-471e-835b-572f180b7720 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:30.446986 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3abaec95-2cdc-471e-835b-572f180b7720 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:30.453998 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3abaec95-2cdc-471e-835b-572f180b7720 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:30.454494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3abaec95-2cdc-471e-835b-572f180b7720 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:30.459917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3abaec95-2cdc-471e-835b-572f180b7720 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:30.459917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3abaec95-2cdc-471e-835b-572f180b7720 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:30.582844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:30.582844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:30.589129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:30.589615 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:30.590755 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:30.591265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:30.599005 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3abaec95-2cdc-471e-835b-572f180b7720 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:30.609414 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3abaec95-2cdc-471e-835b-572f180b7720 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1367 microversion: 2.1 time: 0.168017 May 23 14:09:30.618562 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1919/3912] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:30 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:30.742564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:30.750586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:30.752193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:30.753407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d0df6659-1342-4832-9b65-788035e53a5b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1673 microversion: 2.20 time: 0.179393 May 23 14:09:30.756653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1994/3913] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:30 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:09:31.627602 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-261ca5b0-f858-43c4-98ce-3df2abb04c2d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:31.628224 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-261ca5b0-f858-43c4-98ce-3df2abb04c2d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:31.636650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-261ca5b0-f858-43c4-98ce-3df2abb04c2d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:31.637105 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-261ca5b0-f858-43c4-98ce-3df2abb04c2d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:31.637922 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-261ca5b0-f858-43c4-98ce-3df2abb04c2d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:31.638357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-261ca5b0-f858-43c4-98ce-3df2abb04c2d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:31.776032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:31.776674 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:31.777031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-261ca5b0-f858-43c4-98ce-3df2abb04c2d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:31.779439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:31.783447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:31.788149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:31.788149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:31.788149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:31.788492 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-261ca5b0-f858-43c4-98ce-3df2abb04c2d tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1557 microversion: 2.1 time: 0.163994 May 23 14:09:31.798915 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1920/3914] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:09:31 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:09:31.804874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f00a74f5-00a4-4d90-a6e3-1aa4d8061d04 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:31.805699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f00a74f5-00a4-4d90-a6e3-1aa4d8061d04 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:31.811757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f00a74f5-00a4-4d90-a6e3-1aa4d8061d04 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:31.812418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f00a74f5-00a4-4d90-a6e3-1aa4d8061d04 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:31.813508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f00a74f5-00a4-4d90-a6e3-1aa4d8061d04 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:31.813935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f00a74f5-00a4-4d90-a6e3-1aa4d8061d04 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:31.898888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f00a74f5-00a4-4d90-a6e3-1aa4d8061d04 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098400 May 23 14:09:31.899481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1921/3915] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 23 14:09:31 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:09:31.929193 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:31.937757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:31.939975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:31.943800 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fe40128-8297-42e1-bf45-55d703dd2128 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.169048 May 23 14:09:31.945134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1995/3916] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:31 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:09:32.966412 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:32.967469 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:32.975542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:32.976010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:32.976900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:32.977361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:33.234382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:33.243353 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:33.245137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:33.246356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-487e3f4a-c5b0-4d2b-8d30-b523fdc68baa tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.285645 May 23 14:09:33.246938 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1922/3917] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:32 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:33.345683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-46eb4851-5e5a-40a9-87ac-6a54c6e10239 req-071fd250-6ecd-40c3-bfe6-420630e53341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720a375f-fecc-48d5-a0a5-536cc425ec01", "tag": "a13000b8-e089-4127-af45-e46e54fbaf8c"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:09:33.354737 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-46eb4851-5e5a-40a9-87ac-6a54c6e10239 req-071fd250-6ecd-40c3-bfe6-420630e53341 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:33.355743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-46eb4851-5e5a-40a9-87ac-6a54c6e10239 req-071fd250-6ecd-40c3-bfe6-420630e53341 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:33.367480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-46eb4851-5e5a-40a9-87ac-6a54c6e10239 req-071fd250-6ecd-40c3-bfe6-420630e53341 service nova] Creating event network-changed:a13000b8-e089-4127-af45-e46e54fbaf8c for instance 720a375f-fecc-48d5-a0a5-536cc425ec01 on hv-cinder-82549 May 23 14:09:33.374069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-46eb4851-5e5a-40a9-87ac-6a54c6e10239 req-071fd250-6ecd-40c3-bfe6-420630e53341 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031668 May 23 14:09:33.374989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1996/3918] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:09:34.267017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:34.268433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:34.277822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:34.282800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:34.282800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:34.282800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:34.510711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:34.524504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:34.526628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:34.528270 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3833082c-3f83-4b7b-ba57-7b26ad00db98 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.265924 May 23 14:09:34.529211 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1923/3919] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:34 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:35.549512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:35.553352 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:35.560321 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:35.561381 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:35.562758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:35.563237 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:35.745244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:35.756272 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:35.758817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:35.760121 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8dc60ab9-24c0-4fc9-9391-1f53ce743254 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.216258 May 23 14:09:35.761354 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1997/3920] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:35 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:36.780285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:36.781574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:36.791226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:36.792550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:36.793447 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:36.793887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:37.001538 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:37.011600 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:37.013292 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:37.014773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a8df954-7306-490d-bc2c-800e571a656d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.239038 May 23 14:09:37.015328 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1924/3921] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:36 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:38.036208 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:38.038016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:38.045536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:38.046005 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:38.046795 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:38.047240 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:38.260905 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:38.275864 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:38.279340 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:38.282017 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45830947-d1f8-4457-91fb-5a3d744aa40c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.250299 May 23 14:09:38.283761 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1998/3922] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:38 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:39.312979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:39.313628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:39.322701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:39.323307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:39.324197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:39.324669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:39.472323 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:39.481454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:39.483774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:39.484612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2efc9263-08d1-48c1-9306-5672127725d4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.177453 May 23 14:09:39.485184 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1925/3923] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:39 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:09:40.506810 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:40.508720 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:40.523050 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:40.523568 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:40.524729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:40.525778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:40.786205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:40.797317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:40.797317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:40.809989 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b5282a88-b5a2-437e-adea-f11261fb72e4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.308041 May 23 14:09:40.811380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1999/3924] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:40 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:41.830433 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:41.831169 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:41.840325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:41.846225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:41.846225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:41.846225 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:41.988961 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:41.997375 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:41.998890 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:42.000076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0fb4e0f0-25e4-4bd0-89cf-d8cee4a44c62 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.174264 May 23 14:09:42.000663 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1926/3925] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:41 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:43.019490 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:43.020617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:43.026734 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:43.027192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:43.027970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:43.028446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:43.032561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:43.193572 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:43.201434 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:43.203232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:43.204382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e55966c0-0c89-4878-9221-6f9deb3e71ff tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.188881 May 23 14:09:43.205041 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2000/3926] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:43 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:44.224900 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:44.228775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:44.232076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:44.232557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:44.233361 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:44.233795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:44.414967 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:44.423104 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:44.424646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:44.425855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8122e8d4-b8cf-4898-8720-80031e1687e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.207176 May 23 14:09:44.427644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1927/3927] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:44 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:45.446887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:45.447619 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:45.449628 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=50 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:45.455408 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:45.455993 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:45.456668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:45.457163 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:45.615696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:45.624582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:45.626124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:45.627401 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e27bff25-92fb-44ca-8d27-a7b5f627c014 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.185947 May 23 14:09:45.627907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2001/3928] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:45 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:46.649016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:46.649653 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:46.652026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=52 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:09:46.657007 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:46.657462 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:46.658243 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:46.658686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:46.826337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:46.835612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:46.837156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:46.840699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b6ffc564-0b98-4de5-879f-a3a620849588 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.195653 May 23 14:09:46.840699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1928/3929] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:46 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:47.856165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:47.856833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:47.863463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:47.864458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:47.865244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:47.865682 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:48.009975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:48.018124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:48.019729 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:48.021109 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb71267e-a360-4fdc-a6dd-78c95d9c4592 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.168710 May 23 14:09:48.023839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2002/3930] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:47 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:49.040773 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:49.041508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:49.048195 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:49.048683 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:49.049450 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:49.049881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:49.185526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:49.194321 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:49.195880 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:49.197076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd8677a0-abd4-4ef1-b5d7-c38fc0e94b2c tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.160531 May 23 14:09:49.197686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1929/3931] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:49 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:50.217588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:50.218224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:50.226347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:50.226813 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:50.227610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:50.228055 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:50.369078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:50.377076 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:50.378601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:50.380421 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7aca920c-99d4-46a4-a778-678a5592b0e9 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.167034 May 23 14:09:50.381213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2003/3932] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:50 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:51.399148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:51.399977 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:51.406524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:51.406971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:51.407722 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:51.408154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:51.539639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:51.547654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:51.549180 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:51.550376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d9f9c97c-875d-41fe-8cb2-8d1dcbc0262b tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.155246 May 23 14:09:51.550919 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1930/3933] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:51 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:52.568418 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:52.569034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:52.575582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:52.576025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:52.576828 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:52.577512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:52.711004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:52.719224 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:52.720794 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:52.721963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-82952b4f-9405-4699-8ea5-3ec1df0b6cd7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.158132 May 23 14:09:52.722529 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2004/3934] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:52 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:53.741777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:53.742392 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:53.749500 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:53.750136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:53.750984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:53.751428 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:53.909388 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:53.924705 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:53.928478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:53.931015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d4cb94cd-5343-4087-b6bf-43515bb288ad tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.193510 May 23 14:09:53.932487 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1931/3935] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:53 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:54.950314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:54.951233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:54.959545 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:54.965435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:54.965435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:54.965435 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:55.129323 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:55.138035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:55.139560 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:55.140778 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7603b53e-a0b0-4b93-9789-adf5719668ec tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.195072 May 23 14:09:55.141547 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2005/3936] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:54 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:56.161314 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:56.162021 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:56.168420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:56.168898 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:56.169661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:56.170094 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:56.307075 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:56.315316 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:56.316948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:56.319377 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c0be56bf-31df-4871-8771-922ac29f4487 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.161971 May 23 14:09:56.320082 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1932/3937] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:56 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:57.339501 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:57.340107 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:57.346894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:57.357908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:57.357908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:57.357908 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:57.488432 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:57.497658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:57.499156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:57.500518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8609b37c-ca92-4550-a9a5-26ba8c0be0de tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.164794 May 23 14:09:57.512696 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2006/3938] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:57 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:09:58.529909 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:58.530752 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:58.538657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:58.539113 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:58.539887 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:58.540331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:58.678527 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:58.686590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:58.688109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:58.689306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ab67bb85-657d-4517-ab5b-93574a067354 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.163447 May 23 14:09:58.689864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1933/3939] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:58 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:09:59.708008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:09:59.708650 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:09:59.716706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:59.717175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:59.718887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:09:59.718887 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:09:59.874341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:59.878721 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:59.880313 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:09:59.881561 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6d23846e-6cf3-4222-bc8a-908cf9424b5a tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.177591 May 23 14:09:59.882168 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2007/3940] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:09:59 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:10:00.902402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:10:00.903028 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:10:00.909261 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:00.909779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:00.910558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:00.912230 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:01.063383 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:01.072398 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:01.073997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:01.081025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f694cc92-3cc2-4a5d-8281-50d74b910af2 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.179647 May 23 14:10:01.081025 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1934/3941] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:10:00 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:10:01.111600 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-c082d8a1-e683-4810-9121-0f9a77aed4b7 req-d281ff75-4285-4767-8de9-7589f5a0ba27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6a8553-8450-4844-96db-c1e6124148f7", "name": "network-vif-plugged", "status": "completed", "tag": "fb68c5de-2cf4-41d5-9537-632b1b17098e"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:10:01.121346 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c082d8a1-e683-4810-9121-0f9a77aed4b7 req-d281ff75-4285-4767-8de9-7589f5a0ba27 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:01.121747 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c082d8a1-e683-4810-9121-0f9a77aed4b7 req-d281ff75-4285-4767-8de9-7589f5a0ba27 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:01.134210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-c082d8a1-e683-4810-9121-0f9a77aed4b7 req-d281ff75-4285-4767-8de9-7589f5a0ba27 service nova] Creating event network-vif-plugged:fb68c5de-2cf4-41d5-9537-632b1b17098e for instance ce6a8553-8450-4844-96db-c1e6124148f7 on hv-cinder-82549 May 23 14:10:01.146618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-c082d8a1-e683-4810-9121-0f9a77aed4b7 req-d281ff75-4285-4767-8de9-7589f5a0ba27 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031741 May 23 14:10:01.146618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2008/3942] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:10:02.094068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:10:02.094675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:10:02.101508 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:02.101951 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:02.102698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:02.103125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:02.246794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:02.256634 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:02.258181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:02.259357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-27271cea-7578-4135-942d-0d5fc771a2c7 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.169264 May 23 14:10:02.259907 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1935/3943] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:10:02 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:10:03.278196 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:10:03.278894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:10:03.285975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:03.286424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:03.287195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:03.287643 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:03.430804 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:03.438658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:03.440167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:03.441348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-15e3e213-bc12-429c-bcaa-cc3ec1bdbc25 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.167424 May 23 14:10:03.442419 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2009/3944] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:10:03 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:10:04.460541 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:10:04.462236 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:10:04.467789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:04.468234 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:04.469018 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:04.469451 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:04.473624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=90 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:10:04.631888 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:04.640480 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:04.642092 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:04.643318 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6a0169e-cdd7-4a40-ae17-d7f414875e57 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1731 microversion: 2.20 time: 0.186750 May 23 14:10:04.644097 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1936/3945] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:10:04 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:10:05.662809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:10:05.663470 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:10:05.670271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:05.670718 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:05.671480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:05.671960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:05.821671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:05.830447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:05.832032 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:10:05.833955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c341f074-ad30-4394-a1c1-947e844a4927 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1718 microversion: 2.20 time: 0.175170 May 23 14:10:05.834536 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2010/3946] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:10:05 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1718 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:10:48.815327 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f39da481-06aa-49cc-b83e-9811df3a9f9b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:10:48.815933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f39da481-06aa-49cc-b83e-9811df3a9f9b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:10:48.817806 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=17 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:10:48.818494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=5 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:10:48.823867 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f39da481-06aa-49cc-b83e-9811df3a9f9b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:48.824319 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f39da481-06aa-49cc-b83e-9811df3a9f9b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:48.825109 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f39da481-06aa-49cc-b83e-9811df3a9f9b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:48.825547 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f39da481-06aa-49cc-b83e-9811df3a9f9b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:48.849549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f39da481-06aa-49cc-b83e-9811df3a9f9b tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/ips" status: 200 len: 150 microversion: 2.1 time: 0.038217 May 23 14:10:48.850123 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1937/3947] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 14:10:48 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:10:51.542581 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f4260139-10fb-4b18-b288-d2e502d82756 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27132773-0081-47b5-8964-ab55559cfb09"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:10:51.543780 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f4260139-10fb-4b18-b288-d2e502d82756 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:10:51.545973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=19 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:10:51.546639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=61 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:10:51.551516 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4260139-10fb-4b18-b288-d2e502d82756 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:51.556348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4260139-10fb-4b18-b288-d2e502d82756 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:51.556348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4260139-10fb-4b18-b288-d2e502d82756 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:10:51.556348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4260139-10fb-4b18-b288-d2e502d82756 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:10:52.611238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f4260139-10fb-4b18-b288-d2e502d82756 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "POST /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.073306 May 23 14:10:52.612318 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2011/3948] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 23 14:10:51 2022] POST /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments => generated 194 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:01.280133 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-73803469-e231-4762-a693-64c0b033fff3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:01.280696 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-73803469-e231-4762-a693-64c0b033fff3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:01.284375 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-810bc5b7-7af2-46b9-976f-f8c8fbe8310f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:01.285451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-810bc5b7-7af2-46b9-976f-f8c8fbe8310f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:01.287693 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73803469-e231-4762-a693-64c0b033fff3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.288148 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73803469-e231-4762-a693-64c0b033fff3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.288954 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73803469-e231-4762-a693-64c0b033fff3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.289402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-73803469-e231-4762-a693-64c0b033fff3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.292593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-810bc5b7-7af2-46b9-976f-f8c8fbe8310f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.293052 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-810bc5b7-7af2-46b9-976f-f8c8fbe8310f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.293818 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-810bc5b7-7af2-46b9-976f-f8c8fbe8310f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.294249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-810bc5b7-7af2-46b9-976f-f8c8fbe8310f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.330599 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-810bc5b7-7af2-46b9-976f-f8c8fbe8310f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050867 May 23 14:11:01.331177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2012/3949] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 23 14:11:01 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:11:01.380266 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-73803469-e231-4762-a693-64c0b033fff3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lazy-loading 'services' on Instance uuid 720a375f-fecc-48d5-a0a5-536cc425ec01 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:11:01.390601 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-878fe34b-57fa-4ae8-8ed5-b4aa18b5454d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:01.395243 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-878fe34b-57fa-4ae8-8ed5-b4aa18b5454d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:01.402282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878fe34b-57fa-4ae8-8ed5-b4aa18b5454d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.402739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878fe34b-57fa-4ae8-8ed5-b4aa18b5454d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.403539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878fe34b-57fa-4ae8-8ed5-b4aa18b5454d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.403983 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-878fe34b-57fa-4ae8-8ed5-b4aa18b5454d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.433688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-878fe34b-57fa-4ae8-8ed5-b4aa18b5454d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:11:01.715990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-878fe34b-57fa-4ae8-8ed5-b4aa18b5454d tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 204 len: 0 microversion: 2.20 time: 0.329408 May 23 14:11:01.716586 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2013/3950] 10.222.0.70 () {60 vars in 1279 bytes} [Mon May 23 14:11:01 2022] DELETE /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 14:11:01.725010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:01.725829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:01.732141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.732617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.733378 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.733807 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.767789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-73803469-e231-4762-a693-64c0b033fff3 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments/27132773-0081-47b5-8964-ab55559cfb09" status: 202 len: 0 microversion: 2.1 time: 0.492606 May 23 14:11:01.768496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1938/3951] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 23 14:11:01 2022] DELETE /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments/27132773-0081-47b5-8964-ab55559cfb09 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:11:01.777655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e0684fa-879a-48e7-a3a2-72088a88b86a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:01.778745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1e0684fa-879a-48e7-a3a2-72088a88b86a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:01.784987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e0684fa-879a-48e7-a3a2-72088a88b86a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.785434 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e0684fa-879a-48e7-a3a2-72088a88b86a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.786193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e0684fa-879a-48e7-a3a2-72088a88b86a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:01.786642 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e0684fa-879a-48e7-a3a2-72088a88b86a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:01.820050 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1e0684fa-879a-48e7-a3a2-72088a88b86a tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047123 May 23 14:11:01.820886 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1939/3952] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:11:01 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:11:01.871736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:01.880151 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:01.881694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:01.883822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fdb9bc15-63eb-46f7-8574-e47006c52813 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.162041 May 23 14:11:01.883822 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2014/3953] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:11:01 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:11:02.833038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-14dfdbbf-2950-4afd-ba33-05384298b2d6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:02.834156 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-14dfdbbf-2950-4afd-ba33-05384298b2d6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:02.841016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14dfdbbf-2950-4afd-ba33-05384298b2d6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:02.841581 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14dfdbbf-2950-4afd-ba33-05384298b2d6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:02.842341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14dfdbbf-2950-4afd-ba33-05384298b2d6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:02.842766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14dfdbbf-2950-4afd-ba33-05384298b2d6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:02.877090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-14dfdbbf-2950-4afd-ba33-05384298b2d6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048204 May 23 14:11:02.877660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1940/3954] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:11:02 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:02.904319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:02.904955 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:02.911739 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:02.912192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:02.912997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:02.913437 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:03.057570 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:03.066640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:03.068205 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:03.069416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1197671-6c82-42f2-96e1-91eec5522a93 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.170905 May 23 14:11:03.070131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2015/3955] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:11:02 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:11:03.889660 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-514ce7cb-4a10-46a9-a589-e464633d5590 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:03.890925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-514ce7cb-4a10-46a9-a589-e464633d5590 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:03.900990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-514ce7cb-4a10-46a9-a589-e464633d5590 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:03.900990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-514ce7cb-4a10-46a9-a589-e464633d5590 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:03.900990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-514ce7cb-4a10-46a9-a589-e464633d5590 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:03.907030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-514ce7cb-4a10-46a9-a589-e464633d5590 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:03.936624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-514ce7cb-4a10-46a9-a589-e464633d5590 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050853 May 23 14:11:03.938235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1941/3956] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:11:03 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:11:04.091160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:04.092116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:04.099998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:04.100895 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:04.104557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:04.104557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:04.474877 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:04.484774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:04.486315 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:04.487518 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39fad24c-300a-46d7-96e6-81b5b311a990 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1724 microversion: 2.20 time: 0.401926 May 23 14:11:04.488086 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2016/3957] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:11:04 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:11:04.913167 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-1bff4564-21e1-49dd-8471-bfccb9146d54 req-24cbedbe-8510-4621-a5f8-b23e704c4878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6a8553-8450-4844-96db-c1e6124148f7", "name": "network-vif-deleted", "tag": "fb68c5de-2cf4-41d5-9537-632b1b17098e"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:11:04.921790 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-1bff4564-21e1-49dd-8471-bfccb9146d54 req-24cbedbe-8510-4621-a5f8-b23e704c4878 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:04.922408 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-1bff4564-21e1-49dd-8471-bfccb9146d54 req-24cbedbe-8510-4621-a5f8-b23e704c4878 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:04.934744 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-1bff4564-21e1-49dd-8471-bfccb9146d54 req-24cbedbe-8510-4621-a5f8-b23e704c4878 service nova] Creating event network-vif-deleted:fb68c5de-2cf4-41d5-9537-632b1b17098e for instance ce6a8553-8450-4844-96db-c1e6124148f7 on hv-cinder-82549 May 23 14:11:04.940495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-1bff4564-21e1-49dd-8471-bfccb9146d54 req-24cbedbe-8510-4621-a5f8-b23e704c4878 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 May 23 14:11:04.947731 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1942/3958] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:04.951326 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc89c6c2-ab30-40be-873b-ceee3a68d526 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:04.954244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc89c6c2-ab30-40be-873b-ceee3a68d526 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:04.967506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc89c6c2-ab30-40be-873b-ceee3a68d526 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:04.968282 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc89c6c2-ab30-40be-873b-ceee3a68d526 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:04.969597 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc89c6c2-ab30-40be-873b-ceee3a68d526 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:04.971477 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc89c6c2-ab30-40be-873b-ceee3a68d526 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:05.015265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc89c6c2-ab30-40be-873b-ceee3a68d526 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071606 May 23 14:11:05.016125 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2017/3959] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 23 14:11:04 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 14:11:05.081952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fcdafd8b-9686-4268-b49d-a04136267fed tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:05.082495 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fcdafd8b-9686-4268-b49d-a04136267fed tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:05.089799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcdafd8b-9686-4268-b49d-a04136267fed tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:05.091036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcdafd8b-9686-4268-b49d-a04136267fed tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:05.091877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcdafd8b-9686-4268-b49d-a04136267fed tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:05.092278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcdafd8b-9686-4268-b49d-a04136267fed tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:05.122992 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fcdafd8b-9686-4268-b49d-a04136267fed tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:11:05.514330 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:05.514975 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:05.521865 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:05.522317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:05.523091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:05.523533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:05.558139 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:05.558592 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:05.559062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lazy-loading 'fault' on Instance uuid ce6a8553-8450-4844-96db-c1e6124148f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:11:05.585289 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fcdafd8b-9686-4268-b49d-a04136267fed tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 204 len: 0 microversion: 2.1 time: 0.507510 May 23 14:11:05.586277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1943/3960] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:11:05 2022] DELETE /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 14:11:05.599181 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dcd6d581-33c4-496d-ac48-d878ea5795fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:05.600189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dcd6d581-33c4-496d-ac48-d878ea5795fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:05.607638 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcd6d581-33c4-496d-ac48-d878ea5795fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:05.608157 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcd6d581-33c4-496d-ac48-d878ea5795fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:05.608649 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:05.609158 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcd6d581-33c4-496d-ac48-d878ea5795fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:05.609599 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcd6d581-33c4-496d-ac48-d878ea5795fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:05.618351 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:05.620845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:05.622062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab27c115-7baf-499d-a050-6228cdda78f8 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1371 microversion: 2.20 time: 0.111673 May 23 14:11:05.623214 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2018/3961] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:11:05 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 14:11:05.770614 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcd6d581-33c4-496d-ac48-d878ea5795fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:05.779357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dcd6d581-33c4-496d-ac48-d878ea5795fd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1682 microversion: 2.1 time: 0.187512 May 23 14:11:05.779933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1944/3962] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:11:05 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:11:06.647510 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:06.648134 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:06.655675 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:06.656130 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:06.657010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:06.657452 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:06.692153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:06.692634 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:06.693104 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lazy-loading 'fault' on Instance uuid ce6a8553-8450-4844-96db-c1e6124148f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:11:06.735626 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:06.744004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:06.745534 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3eae736c69843ceadc6cbdb258b7195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611e3a80618d4d4dbfb150456f0d3502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:06.746704 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-da43ad62-7267-4504-ad5a-7005fa00e709 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 200 len: 1371 microversion: 2.20 time: 0.103236 May 23 14:11:06.747260 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2019/3963] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:11:06 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 14:11:06.797170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5adf4aee-87b7-425d-a128-8e12d4e0f80f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:06.797891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5adf4aee-87b7-425d-a128-8e12d4e0f80f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:06.804757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5adf4aee-87b7-425d-a128-8e12d4e0f80f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:06.805206 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5adf4aee-87b7-425d-a128-8e12d4e0f80f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:06.805997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5adf4aee-87b7-425d-a128-8e12d4e0f80f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:06.806811 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5adf4aee-87b7-425d-a128-8e12d4e0f80f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:06.957291 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5adf4aee-87b7-425d-a128-8e12d4e0f80f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:06.966632 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5adf4aee-87b7-425d-a128-8e12d4e0f80f tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1682 microversion: 2.1 time: 0.173479 May 23 14:11:06.967213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1945/3964] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:11:06 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:11:07.765338 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:07.765956 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:07.772539 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:07.773004 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:07.773774 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:07.774209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:07.789083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] HTTP exception thrown: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Request method failure captured: May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 HTTP/1.1 May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zHrHHgFmgMLMs7ApooaJmMPc2Tr-MEPD0dbXD4ZkDLZaE3c8xGTmuLM70WEN4Mbr9oiTSXFqAX5FVT1POteMR2fgP2wGaROhw0oRnT_tCxm8pHO5H30bA54X121zNJ5QrEntrYm1ODTDCV43tX6d4sODEbUGj2bNugv16Mr2jo8Cs May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Openstack-Nova-Api-Version: 2.20 May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:11:07.790820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}] May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: b3eae736c69843ceadc6cbdb258b7195 May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:07.792967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': 'ce6a8553-8450-4844-96db-c1e6124148f7'} May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:07.793921 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:07.795416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:07.796848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Returning 404 to user: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:07.796848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-55d8abd7-baa8-47ec-be66-698263086ce6 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 404 len: 111 microversion: 2.20 time: 0.030878 May 23 14:11:07.796848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2020/3965] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:11:07 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 14:11:07.802315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6d57c9a-7e30-4cb4-aa77-1d04084b2c41 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '.version_select at 0x7effb7928dc0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:07.917337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c6d57c9a-7e30-4cb4-aa77-1d04084b2c41 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479736767" status: 204 len: 0 microversion: 2.20 time: 0.118733 May 23 14:11:07.917920 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1946/3966] 10.222.0.70 () {60 vars in 1258 bytes} [Mon May 23 14:11:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479736767 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 14:11:07.988839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-43dd8699-2d0a-4397-8120-aa039fa6a1a8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:07.988839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-43dd8699-2d0a-4397-8120-aa039fa6a1a8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:07.992060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43dd8699-2d0a-4397-8120-aa039fa6a1a8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:07.992757 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43dd8699-2d0a-4397-8120-aa039fa6a1a8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:07.994054 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43dd8699-2d0a-4397-8120-aa039fa6a1a8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:07.994495 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43dd8699-2d0a-4397-8120-aa039fa6a1a8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:08.263564 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-43dd8699-2d0a-4397-8120-aa039fa6a1a8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:08.273388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-43dd8699-2d0a-4397-8120-aa039fa6a1a8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1682 microversion: 2.1 time: 0.290507 May 23 14:11:08.273388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2021/3967] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:11:07 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:11:08.890411 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-0e99338c-61f5-4504-ae3a-7eb261d78c57 req-94b68450-bca3-4ef5-9a80-6ba73324dc38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720a375f-fecc-48d5-a0a5-536cc425ec01", "name": "network-vif-deleted", "tag": "a13000b8-e089-4127-af45-e46e54fbaf8c"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:11:08.905557 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0e99338c-61f5-4504-ae3a-7eb261d78c57 req-94b68450-bca3-4ef5-9a80-6ba73324dc38 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:08.908550 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0e99338c-61f5-4504-ae3a-7eb261d78c57 req-94b68450-bca3-4ef5-9a80-6ba73324dc38 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:08.936684 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-0e99338c-61f5-4504-ae3a-7eb261d78c57 req-94b68450-bca3-4ef5-9a80-6ba73324dc38 service nova] Creating event network-vif-deleted:a13000b8-e089-4127-af45-e46e54fbaf8c for instance 720a375f-fecc-48d5-a0a5-536cc425ec01 on hv-cinder-82549 May 23 14:11:08.947702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-0e99338c-61f5-4504-ae3a-7eb261d78c57 req-94b68450-bca3-4ef5-9a80-6ba73324dc38 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060627 May 23 14:11:08.949403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1947/3968] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:11:09.293997 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9294914b-a20e-436a-bbee-7e38c1d5e6c9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:09.295152 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9294914b-a20e-436a-bbee-7e38c1d5e6c9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:09.310285 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9294914b-a20e-436a-bbee-7e38c1d5e6c9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:09.314549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9294914b-a20e-436a-bbee-7e38c1d5e6c9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:09.314549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9294914b-a20e-436a-bbee-7e38c1d5e6c9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:09.314549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9294914b-a20e-436a-bbee-7e38c1d5e6c9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:09.420557 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9294914b-a20e-436a-bbee-7e38c1d5e6c9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf30fa512142489a8dea40ce426a5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649fa9a0ae4411aabf060f99e691520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:11:09.432926 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9294914b-a20e-436a-bbee-7e38c1d5e6c9 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 200 len: 1327 microversion: 2.1 time: 0.147030 May 23 14:11:09.433684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2022/3969] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:11:09 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 1327 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:11:10.427748 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:10.428770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:10.436265 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:10.436650 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:10.437728 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:10.438276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:10.453273 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] HTTP exception thrown: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Request method failure captured: May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 HTTP/1.1 May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zHrHHgFmgMLMs7ApooaJmMPc2Tr-MEPD0dbXD4ZkDLZaE3c8xGTmuLM70WEN4Mbr9oiTSXFqAX5FVT1POteMR2fgP2wGaROhw0oRnT_tCxm8pHO5H30bA54X121zNJ5QrEntrYm1ODTDCV43tX6d4sODEbUGj2bNugv16Mr2jo8Cs May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Openstack-Nova-Api-Version: 2.20 May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:11:10.455232 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}] May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: b3eae736c69843ceadc6cbdb258b7195 May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.457276 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'ce6a8553-8450-4844-96db-c1e6124148f7'} May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:10.458256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.459727 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.461245 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Returning 404 to user: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:10.461347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:10.461794 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04e31652-069c-4dae-b351-67384ca9e1a3 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 404 len: 111 microversion: 2.20 time: 0.033913 May 23 14:11:10.461902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:10.461993 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1948/3970] 10.222.0.70 () {60 vars in 1279 bytes} [Mon May 23 14:11:10 2022] DELETE /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 14:11:10.465684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:10.465995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:10.466124 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:10.466612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: ce6a8553-8450-4844-96db-c1e6124148f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:10.466882 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:10.467312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:10.473038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:10.473494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:10.474259 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:10.474721 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:10.481267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 HTTP/1.1 May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:11:10.482817 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:10.484692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '720a375f-fecc-48d5-a0a5-536cc425ec01'} May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:10.485856 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:10.487506 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:10.489365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:10.489365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc0cf559-0113-4b3a-9160-0ded39edcdfd tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 404 len: 111 microversion: 2.1 time: 0.032659 May 23 14:11:10.489365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2023/3971] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:11:10 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 14:11:10.489662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] HTTP exception thrown: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Request method failure captured: May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 HTTP/1.1 May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zHrHHgFmgMLMs7ApooaJmMPc2Tr-MEPD0dbXD4ZkDLZaE3c8xGTmuLM70WEN4Mbr9oiTSXFqAX5FVT1POteMR2fgP2wGaROhw0oRnT_tCxm8pHO5H30bA54X121zNJ5QrEntrYm1ODTDCV43tX6d4sODEbUGj2bNugv16Mr2jo8Cs May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Openstack-Nova-Api-Version: 2.20 May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:11:10.490478 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}] May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: b3eae736c69843ceadc6cbdb258b7195 May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.492307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'ce6a8553-8450-4844-96db-c1e6124148f7'} May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:10.497142 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. May 23 14:11:10.498809 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:10.501255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Returning 404 to user: Instance ce6a8553-8450-4844-96db-c1e6124148f7 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:10.501255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-453258e3-cdfe-46e9-a12d-14539ce7cb8f tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7" status: 404 len: 111 microversion: 2.20 time: 0.030359 May 23 14:11:10.501255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1949/3972] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:11:10 2022] GET /compute/v2.1/servers/ce6a8553-8450-4844-96db-c1e6124148f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 14:11:10.501652 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b692ab97-8024-487c-b3a7-d12343633535 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '.version_select at 0x7effb1d061f0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:10.624871 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b692ab97-8024-487c-b3a7-d12343633535 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724050609" status: 202 len: 0 microversion: 2.1 time: 0.135564 May 23 14:11:10.625480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2024/3973] 10.222.0.70 () {58 vars in 1220 bytes} [Mon May 23 14:11:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724050609 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:11:11.966978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:11.967635 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:11.975356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:11.975875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:11.976762 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:11.977277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:11.996840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] HTTP exception thrown: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Request method failure captured: May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 HTTP/1.1 May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zHrHHgFmgMLMs7ApooaJmMPc2Tr-MEPD0dbXD4ZkDLZaE3c8xGTmuLM70WEN4Mbr9oiTSXFqAX5FVT1POteMR2fgP2wGaROhw0oRnT_tCxm8pHO5H30bA54X121zNJ5QrEntrYm1ODTDCV43tX6d4sODEbUGj2bNugv16Mr2jo8Cs May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Openstack-Nova-Api-Version: 2.20 May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:11:11.999415 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}] May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: b3eae736c69843ceadc6cbdb258b7195 May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:12.002916 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '4f011172-f0cf-4b8a-9791-2535bb8bcaa4'} May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:12.004882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:12.008396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:12.012222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Returning 404 to user: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:12.012222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a31fddf8-44ab-48ef-8bb6-fe9ba9e091ef tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 404 len: 111 microversion: 2.20 time: 0.039148 May 23 14:11:12.012222 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1950/3974] 10.222.0.70 () {60 vars in 1279 bytes} [Mon May 23 14:11:11 2022] DELETE /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 14:11:12.015702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:12.016974 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] [instance: 4f011172-f0cf-4b8a-9791-2535bb8bcaa4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:12.027053 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:12.027502 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:12.028392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:12.028868 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:12.044038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] HTTP exception thrown: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Request method failure captured: May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 HTTP/1.1 May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zHrHHgFmgMLMs7ApooaJmMPc2Tr-MEPD0dbXD4ZkDLZaE3c8xGTmuLM70WEN4Mbr9oiTSXFqAX5FVT1POteMR2fgP2wGaROhw0oRnT_tCxm8pHO5H30bA54X121zNJ5QrEntrYm1ODTDCV43tX6d4sODEbUGj2bNugv16Mr2jo8Cs May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Openstack-Nova-Api-Version: 2.20 May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:11:12.045732 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611e3a80618d4d4dbfb150456f0d3502"}]}] May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 611e3a80618d4d4dbfb150456f0d3502 May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1713002713 May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: b3eae736c69843ceadc6cbdb258b7195 May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1713002713-project May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:12.047666 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '4f011172-f0cf-4b8a-9791-2535bb8bcaa4'} May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:12.048878 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. May 23 14:11:12.050533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:12.052279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] Returning 404 to user: Instance 4f011172-f0cf-4b8a-9791-2535bb8bcaa4 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:12.052279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b746d77d-a78b-4cf4-b3bf-9c74899ebab4 tempest-AttachVolumeShelveTestJSON-1713002713 tempest-AttachVolumeShelveTestJSON-1713002713-project] 10.222.0.70 "GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4" status: 404 len: 111 microversion: 2.20 time: 0.039396 May 23 14:11:12.052279 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2025/3975] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 23 14:11:12 2022] GET /compute/v2.1/servers/4f011172-f0cf-4b8a-9791-2535bb8bcaa4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 23 14:11:13.055595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:13.056789 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:13.065649 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:13.067207 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:13.068264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:13.068753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:13.086486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 HTTP/1.1 May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:11:13.088159 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.090139 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '720a375f-fecc-48d5-a0a5-536cc425ec01'} May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:13.091086 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.092754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:13.095685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:13.095685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8fb67205-3109-41d3-a894-aaf6e33346f8 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 404 len: 111 microversion: 2.1 time: 0.039049 May 23 14:11:13.095685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1951/3976] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:11:13 2022] DELETE /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:11:13.098549 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:13.099689 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 720a375f-fecc-48d5-a0a5-536cc425ec01] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:13.107064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:13.109616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:13.109616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:13.109616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:13.124316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 HTTP/1.1 May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:11:13.126011 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.128099 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '720a375f-fecc-48d5-a0a5-536cc425ec01'} May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:13.129275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. May 23 14:11:13.131458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:13.144726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance 720a375f-fecc-48d5-a0a5-536cc425ec01 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:13.144726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9f668be-b1c9-48bf-bacf-ae6cb983e86e tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01" status: 404 len: 111 microversion: 2.1 time: 0.032884 May 23 14:11:13.144726 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2026/3977] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:11:13 2022] GET /compute/v2.1/servers/720a375f-fecc-48d5-a0a5-536cc425ec01 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:11:14.447373 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:14.448503 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:14.456295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:14.456778 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:14.457564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:14.458202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:14.475800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e HTTP/1.1 May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:11:14.477281 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.480282 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '90125c19-518a-4c0d-a38d-49062d11796e'} May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:14.481777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.483882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.485574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:14.485574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ca138b62-e786-46db-a179-341b940987c6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 404 len: 111 microversion: 2.1 time: 0.035808 May 23 14:11:14.485574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1952/3978] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:11:14 2022] DELETE /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:11:14.492377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:14.493062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 90125c19-518a-4c0d-a38d-49062d11796e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:14.501640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:14.502102 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:14.502898 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:14.503341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:14.526255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e HTTP/1.1 May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:11:14.527886 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.529829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '90125c19-518a-4c0d-a38d-49062d11796e'} May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:14.530846 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. May 23 14:11:14.532276 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.533743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance 90125c19-518a-4c0d-a38d-49062d11796e could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:14.533743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f50e1d8a-643d-46e1-a9c3-0f9c7f77e0e6 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e" status: 404 len: 111 microversion: 2.1 time: 0.042361 May 23 14:11:14.533743 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2027/3979] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:11:14 2022] GET /compute/v2.1/servers/90125c19-518a-4c0d-a38d-49062d11796e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:11:14.538154 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:14.538729 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:14.545735 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:14.547385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:14.547385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:14.547757 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:14.564014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 HTTP/1.1 May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:11:14.565820 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.567639 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'fb5275ae-cf1f-40bb-8971-dc5c99868bc6'} May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:14.568662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.570155 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:14.572477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:14.572477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fdf02b9b-a1aa-4a4c-abd2-1cd07f197301 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 404 len: 111 microversion: 2.1 time: 0.033553 May 23 14:11:14.572477 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1953/3980] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:11:14 2022] DELETE /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:11:14.579319 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:14.581806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: fb5275ae-cf1f-40bb-8971-dc5c99868bc6] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:14.586663 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:14.587122 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:14.588530 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:14.589232 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:14.594034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:11:14.606526 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 HTTP/1.1 May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:11:14.608085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.610048 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': 'fb5275ae-cf1f-40bb-8971-dc5c99868bc6'} May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:14.611031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. May 23 14:11:14.612692 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:14.614341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance fb5275ae-cf1f-40bb-8971-dc5c99868bc6 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:14.614341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2f27d302-005a-4911-a575-25df5f59ded0 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6" status: 404 len: 111 microversion: 2.1 time: 0.034420 May 23 14:11:14.614341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2028/3981] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:11:14 2022] GET /compute/v2.1/servers/fb5275ae-cf1f-40bb-8971-dc5c99868bc6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:11:15.926535 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:15.927376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:15.938126 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:15.939496 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:15.941173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:15.942233 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:15.973484 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa HTTP/1.1 May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:11:15.975103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:15.977062 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '81f051b3-679a-43af-909b-a4edda1984fa'} May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:15.979160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:15.987612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:15.989860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:15.989860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2cbc1875-a87d-4e76-8b47-452a09260389 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "DELETE /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 404 len: 111 microversion: 2.1 time: 0.055452 May 23 14:11:15.989860 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1954/3982] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:11:15 2022] DELETE /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:11:15.993465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:15.995289 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] [instance: 81f051b3-679a-43af-909b-a4edda1984fa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:11:16.003571 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:16.004040 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:16.004853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:11:16.005361 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:11:16.021684 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] HTTP exception thrown: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Request method failure captured: May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa HTTP/1.1 May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii4zIQXWg8qnffSFHh_BFcm33veckSWf415X4raNrhEqxjaCu6nfVlXvbjAp96jdn4w5mh0-t3v8K46ZvWLAM8U8J5mO9upLLjC3-FHkZXPSGtfUNNQiXVedpsAY5TP-JRNRNbJkB6iGhRw5ASam0H-EHgOU9x3o8tQnEhA_6BurKh4M May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:11:16.026894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7649fa9a0ae4411aabf060f99e691520"}]}] May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 7649fa9a0ae4411aabf060f99e691520 May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1857796413 May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: cf30fa512142489a8dea40ce426a5f36 May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1857796413-project May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:16.029303 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '81f051b3-679a-43af-909b-a4edda1984fa'} May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:16.031425 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. May 23 14:11:16.035003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:11:16.038551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] Returning 404 to user: Instance 81f051b3-679a-43af-909b-a4edda1984fa could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:16.038551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8c0c9bf8-b451-4045-9e15-09ffb1e7b889 tempest-AttachVolumeNegativeTest-1857796413 tempest-AttachVolumeNegativeTest-1857796413-project] 10.222.0.70 "GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa" status: 404 len: 111 microversion: 2.1 time: 0.043162 May 23 14:11:16.038551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2029/3983] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:11:15 2022] GET /compute/v2.1/servers/81f051b3-679a-43af-909b-a4edda1984fa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:11:18.513051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-de75c8b1-5d77-45a2-8b74-a005b9c14c2b tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] Action: 'create', calling method: .version_select at 0x7effb7901dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1302709460", "metadata": {"Type": "work"}}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:11:19.314320 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-de75c8b1-5d77-45a2-8b74-a005b9c14c2b tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.960208 May 23 14:11:19.315099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1955/3984] 10.222.0.70 () {60 vars in 1155 bytes} [Mon May 23 14:11:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 962 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 23 14:11:19.327131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97c0706a-d3c2-4bae-9167-503f8b0d1e10 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] Calling method '.version_select at 0x7effb1d06a60>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:19.385834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97c0706a-d3c2-4bae-9167-503f8b0d1e10 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe" status: 200 len: 353 microversion: 2.1 time: 0.062606 May 23 14:11:19.386480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2030/3985] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:11:19 2022] GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:20.408552 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-37b4d9dd-6612-4f72-87bb-056796bde930 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] Calling method '.version_select at 0x7effb29960d0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:20.471555 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-37b4d9dd-6612-4f72-87bb-056796bde930 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe" status: 200 len: 354 microversion: 2.1 time: 0.068705 May 23 14:11:20.472136 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1956/3986] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:11:20 2022] GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:20.484167 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5916e6e8-ffd6-4102-833f-cabd40143881 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] Calling method '.version_select at 0x7effb3af50d0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:20.536978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5916e6e8-ffd6-4102-833f-cabd40143881 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe" status: 200 len: 354 microversion: 2.1 time: 0.056994 May 23 14:11:20.537925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2031/3987] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:11:20 2022] GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:20.554035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5a134e4-1398-4a53-a356-2864702d95c8 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] Calling method '.version_select at 0x7effb7901e50>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:20.763049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5a134e4-1398-4a53-a356-2864702d95c8 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe" status: 202 len: 0 microversion: 2.1 time: 0.212725 May 23 14:11:20.766691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1957/3988] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 23 14:11:20 2022] DELETE /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:11:20.775348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b414b615-5fab-4c3a-ace0-919febd64c03 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] Calling method '.version_select at 0x7effb7944430>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:20.827127 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b414b615-5fab-4c3a-ace0-919febd64c03 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe" status: 200 len: 353 microversion: 2.1 time: 0.055618 May 23 14:11:20.827713 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2032/3989] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:11:20 2022] GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:21.839666 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8ad47985-a3b9-4504-8838-8e31dbc7d807 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] Calling method '.version_select at 0x7effb447e1f0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:21.869751 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-8ad47985-a3b9-4504-8838-8e31dbc7d807 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] HTTP exception thrown: Volume 4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe could not be found. May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8ad47985-a3b9-4504-8838-8e31dbc7d807 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] Request method failure captured: May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe HTTP/1.1 May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii5YGxsKdww3D6GCmA28LyXHMTvusztLQtPg-f3aAwILHW5mjuV9WEQ9bl-WeAGOZh-1I1Pd-rHw3utus2R8lVjahjUtg2oAaN1jJK8bS2UKfuGITZBDmEAbr0e7rXL9V2wWhsi8Rfn1TrB3gm8Bp2LvuZT1lTgykQp8ZUt79ASZnb64 May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: dcc56cd45b8c4628a780d19b2dacf4b7 May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesGetTestJSON-1585396224 May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:11:21.871949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dcc56cd45b8c4628a780d19b2dacf4b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dcc56cd45b8c4628a780d19b2dacf4b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dcc56cd45b8c4628a780d19b2dacf4b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dcc56cd45b8c4628a780d19b2dacf4b7"}]}] May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesGetTestJSON-1585396224 May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: dcc56cd45b8c4628a780d19b2dacf4b7 May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesGetTestJSON-1585396224 May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesGetTestJSON-1585396224-project May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 94730ef714c448b49005bbf2e3cba47a May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesGetTestJSON-1585396224-project May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Volume 4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe could not be found. May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': '4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe'} May 23 14:11:21.873389 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe could not be found. (HTTP 404) (Request-ID: req-e90c5395-ca07-4bd7-b67e-8da9762d435b) May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:21.874102 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 14:11:21.875053 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe could not be found. May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 14:11:21.875883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe could not be found. May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe could not be found. May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8ad47985-a3b9-4504-8838-8e31dbc7d807 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] Returning 404 to user: Volume 4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8ad47985-a3b9-4504-8838-8e31dbc7d807 tempest-VolumesGetTestJSON-1585396224 tempest-VolumesGetTestJSON-1585396224-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe" status: 404 len: 109 microversion: 2.1 time: 0.038261 May 23 14:11:21.876774 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1958/3990] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:11:21 2022] GET /compute/v2.1/os-volumes/4015a1a9-91c8-4c1c-bcab-d15b2d1cfbbe => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:11:24.851963 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-823b3523-2bc7-4e2c-8bad-9e6e55da5a2d tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb4d963a0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:24.914608 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-823b3523-2bc7-4e2c-8bad-9e6e55da5a2d tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/cda7f49b-8743-4920-9c88-f48d7326301b" status: 200 len: 351 microversion: 2.1 time: 0.066853 May 23 14:11:24.917176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2033/3991] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:11:24 2022] GET /compute/v2.1/os-volumes/cda7f49b-8743-4920-9c88-f48d7326301b => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:27.788315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:11:27.789108 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:11:27.793166 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77263f2d-49d1-4d3b-a712-3d91246e6822 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb7928310>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:27.852262 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-77263f2d-49d1-4d3b-a712-3d91246e6822 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/eb685bd0-0f22-4c17-b77b-855b3475a623" status: 200 len: 349 microversion: 2.1 time: 0.066738 May 23 14:11:27.852928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1959/3992] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:11:27 2022] GET /compute/v2.1/os-volumes/eb685bd0-0f22-4c17-b77b-855b3475a623 => generated 349 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:30.676943 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:11:30.677698 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:11:30.681910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e84361d4-7acf-4f44-acd8-411861079677 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb1d81940>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:30.737901 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e84361d4-7acf-4f44-acd8-411861079677 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/c466b4ab-aa19-41f8-b2a0-aed55652e465" status: 200 len: 351 microversion: 2.1 time: 0.062040 May 23 14:11:30.738471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2034/3993] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 23 14:11:30 2022] GET /compute/v2.1/os-volumes/c466b4ab-aa19-41f8-b2a0-aed55652e465 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:30.750730 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb592cf7-ae27-477c-8fa5-8b1b51cea66f tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb2782670>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:30.836098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb592cf7-ae27-477c-8fa5-8b1b51cea66f tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090166 May 23 14:11:30.836708 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1960/3994] 10.222.0.70 () {58 vars in 1133 bytes} [Mon May 23 14:11:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:11:30.850855 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c87d730c-0d54-4f8a-a755-f3c68d1eb2a9 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb2014040>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:30.951033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c87d730c-0d54-4f8a-a755-f3c68d1eb2a9 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.104607 May 23 14:11:30.951610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2035/3995] 10.222.0.70 () {58 vars in 1148 bytes} [Mon May 23 14:11:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:30.965855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cdd573f6-cf62-44f2-81f3-eea222d7072c tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb78443a0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:31.052131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cdd573f6-cf62-44f2-81f3-eea222d7072c tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091118 May 23 14:11:31.053235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1961/3996] 10.222.0.70 () {58 vars in 1133 bytes} [Mon May 23 14:11:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:11:31.064830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f38e8531-2293-44fc-b0f8-9a29a0cf304c tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb2014670>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:31.152221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f38e8531-2293-44fc-b0f8-9a29a0cf304c tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.091201 May 23 14:11:31.153034 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2036/3997] 10.222.0.70 () {58 vars in 1166 bytes} [Mon May 23 14:11:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:31.165278 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cba798d5-ba7e-4b95-b164-67ab78b01e1c tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb2782a60>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:31.248396 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cba798d5-ba7e-4b95-b164-67ab78b01e1c tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086890 May 23 14:11:31.248984 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1962/3998] 10.222.0.70 () {58 vars in 1169 bytes} [Mon May 23 14:11:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:31.263593 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-28c0f8a7-9961-444a-85f7-879a9201254b tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb1d06ca0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:31.348792 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-28c0f8a7-9961-444a-85f7-879a9201254b tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089796 May 23 14:11:31.349446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2037/3999] 10.222.0.70 () {58 vars in 1154 bytes} [Mon May 23 14:11:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:11:31.361376 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0389c027-4606-4f52-9bb9-5106e5084d25 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb79285e0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:31.453286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0389c027-4606-4f52-9bb9-5106e5084d25 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.095876 May 23 14:11:31.453871 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1963/4000] 10.222.0.70 () {58 vars in 1187 bytes} [Mon May 23 14:11:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:11:31.465960 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-317a7689-5ee9-4ab9-b8d9-195bd14a8d06 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] Calling method '.version_select at 0x7effb7944550>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:11:31.556105 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-317a7689-5ee9-4ab9-b8d9-195bd14a8d06 tempest-VolumesTestJSON-1862581064 tempest-VolumesTestJSON-1862581064-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.094080 May 23 14:11:31.557369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2038/4001] 10.222.0.70 () {58 vars in 1154 bytes} [Mon May 23 14:11:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:11:42.533089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:11:42.533902 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:11:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:12:09.822003 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:12:09.822585 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:12:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:12:22.174753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bde40201-4ac8-4c57-b345-330311fa8ddc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Action: 'create', calling method: .version_select at 0x7effb7844e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-491265647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoykZ3yjiYf64aR6GfxEU8aUo+kAXdpzXxqLFGcWQUL6Ne2xFtsfcrPcaNtMnF0dwe6y0uNRvhHUEnfwTeqnHbY/0B2XJRwxMf4RMXmCE1TJ8ejGkspzXQxH5UefXg+BA=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:12:22.190163 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-bde40201-4ac8-4c57-b345-330311fa8ddc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Getting quotas for project aee15038cdf945a594437e83a34e1afe. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:12:22.194421 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-bde40201-4ac8-4c57-b345-330311fa8ddc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Getting quotas for user 7b6534d42be64c3cb311d384458bfae3 and project aee15038cdf945a594437e83a34e1afe. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:12:22.284595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bde40201-4ac8-4c57-b345-330311fa8ddc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.298640 May 23 14:12:22.287545 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1964/4002] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 23 14:12:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:13:00.160178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d99802af-0360-4776-b3d1-809701f10a0b] AMQP server on 10.222.0.70:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 23 14:13:00.164889 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-661390721", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-491265647", "security_groups": [{"name": "tempest-secgroup-smoke-181117543"}], "block_device_mapping_v2": [{"uuid": "bd10eeab-4920-459e-bf3a-39e3b837027d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "873c118a-6ead-44a8-b517-3d571f85940c"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:13:00.281317 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] validate_networks() for [('873c118a-6ead-44a8-b517-3d571f85940c', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 14:13:00.679890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 14:13:00.680320 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 14:13:00.680844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 14:13:00.681266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 14:13:00.681688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 14:13:00.691680 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:00.692095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:00.692938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:00.693417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:00.711191 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Getting quotas for project aee15038cdf945a594437e83a34e1afe. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:13:00.715402 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Getting quotas for user 7b6534d42be64c3cb311d384458bfae3 and project aee15038cdf945a594437e83a34e1afe. Resources: {'cores', 'instances', 'ram'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:13:00.776497 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 14:13:00.778614 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd10eeab-4920-459e-bf3a-39e3b837027d',volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 14:13:01.173848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d99802af-0360-4776-b3d1-809701f10a0b] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 45786. May 23 14:13:01.237717 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5beb9f4a-bf8e-4dd6-a9a8-989c87467af0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.072573 May 23 14:13:01.238471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2039/4003] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 14:13:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 14:13:01.247779 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:13:01.250371 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:13:01.257814 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4633c7f3-2e7f-44a0-b8b7-296d4efe895f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:01.258610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4633c7f3-2e7f-44a0-b8b7-296d4efe895f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:01.529524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4633c7f3-2e7f-44a0-b8b7-296d4efe895f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:01.538417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4633c7f3-2e7f-44a0-b8b7-296d4efe895f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1093 microversion: 2.1 time: 0.293271 May 23 14:13:01.539103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1965/4004] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:01 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1093 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:02.556752 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fc330979-821f-48ec-9aa9-117ec6fcc919 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:02.557424 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fc330979-821f-48ec-9aa9-117ec6fcc919 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:02.563830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc330979-821f-48ec-9aa9-117ec6fcc919 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:02.564286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc330979-821f-48ec-9aa9-117ec6fcc919 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:02.565827 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc330979-821f-48ec-9aa9-117ec6fcc919 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:02.566328 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc330979-821f-48ec-9aa9-117ec6fcc919 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:02.632520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fc330979-821f-48ec-9aa9-117ec6fcc919 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:02.640380 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fc330979-821f-48ec-9aa9-117ec6fcc919 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1143 microversion: 2.1 time: 0.088133 May 23 14:13:02.641691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2040/4005] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:02 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:03.658971 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b7ae1cd-0bc8-4e7c-8133-2af88457ed7e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:03.660215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b7ae1cd-0bc8-4e7c-8133-2af88457ed7e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:03.667382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b7ae1cd-0bc8-4e7c-8133-2af88457ed7e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:03.667834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b7ae1cd-0bc8-4e7c-8133-2af88457ed7e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:03.668654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b7ae1cd-0bc8-4e7c-8133-2af88457ed7e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:03.669096 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b7ae1cd-0bc8-4e7c-8133-2af88457ed7e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:03.740014 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b7ae1cd-0bc8-4e7c-8133-2af88457ed7e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:03.750306 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b7ae1cd-0bc8-4e7c-8133-2af88457ed7e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1199 microversion: 2.1 time: 0.095577 May 23 14:13:03.751331 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1966/4006] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:03 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:13:04.770068 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ef47c939-42bd-4b83-bcae-fe2e63e8532a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:04.771268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ef47c939-42bd-4b83-bcae-fe2e63e8532a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:04.779057 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef47c939-42bd-4b83-bcae-fe2e63e8532a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:04.779661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef47c939-42bd-4b83-bcae-fe2e63e8532a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:04.780559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef47c939-42bd-4b83-bcae-fe2e63e8532a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:04.781431 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ef47c939-42bd-4b83-bcae-fe2e63e8532a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:05.057927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ef47c939-42bd-4b83-bcae-fe2e63e8532a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:05.066138 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ef47c939-42bd-4b83-bcae-fe2e63e8532a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1276 microversion: 2.1 time: 0.302086 May 23 14:13:05.067688 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2041/4007] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:04 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1276 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:05.716711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-7f0c2a61-35a4-4984-853d-d25d237ffffc req-486175b4-4366-4bf5-b58e-f13ff315ad98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0", "tag": "d05ad0c7-b90d-4d75-ba28-0b141f6cc853"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:13:05.729143 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7f0c2a61-35a4-4984-853d-d25d237ffffc req-486175b4-4366-4bf5-b58e-f13ff315ad98 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:05.729521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7f0c2a61-35a4-4984-853d-d25d237ffffc req-486175b4-4366-4bf5-b58e-f13ff315ad98 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:05.744215 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-7f0c2a61-35a4-4984-853d-d25d237ffffc req-486175b4-4366-4bf5-b58e-f13ff315ad98 service nova] Creating event network-changed:d05ad0c7-b90d-4d75-ba28-0b141f6cc853 for instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 on hv-cinder-82549 May 23 14:13:05.750017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-7f0c2a61-35a4-4984-853d-d25d237ffffc req-486175b4-4366-4bf5-b58e-f13ff315ad98 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037408 May 23 14:13:05.750633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1967/4008] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:13:06.086035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c7ce24e8-21e7-4223-83e1-6a980ace4309 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:06.086656 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7ce24e8-21e7-4223-83e1-6a980ace4309 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:06.093309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7ce24e8-21e7-4223-83e1-6a980ace4309 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:06.094028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7ce24e8-21e7-4223-83e1-6a980ace4309 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:06.094986 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7ce24e8-21e7-4223-83e1-6a980ace4309 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:06.095423 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7ce24e8-21e7-4223-83e1-6a980ace4309 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:06.347007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7ce24e8-21e7-4223-83e1-6a980ace4309 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:06.357083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c7ce24e8-21e7-4223-83e1-6a980ace4309 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.276352 May 23 14:13:06.357670 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2042/4009] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:06 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:07.377657 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c8fddb99-d20d-4112-8a5f-83370e37076d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:07.378587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c8fddb99-d20d-4112-8a5f-83370e37076d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:07.385315 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8fddb99-d20d-4112-8a5f-83370e37076d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:07.385777 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8fddb99-d20d-4112-8a5f-83370e37076d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:07.386623 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8fddb99-d20d-4112-8a5f-83370e37076d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:07.387199 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8fddb99-d20d-4112-8a5f-83370e37076d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:07.529106 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8fddb99-d20d-4112-8a5f-83370e37076d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:07.540103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c8fddb99-d20d-4112-8a5f-83370e37076d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.164231 May 23 14:13:07.540103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1968/4010] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:07 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:08.554725 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5304ba4a-aee4-4ba8-914d-68da5d9eecd9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:08.555512 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5304ba4a-aee4-4ba8-914d-68da5d9eecd9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:08.562259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5304ba4a-aee4-4ba8-914d-68da5d9eecd9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:08.562858 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5304ba4a-aee4-4ba8-914d-68da5d9eecd9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:08.563474 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5304ba4a-aee4-4ba8-914d-68da5d9eecd9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:08.563916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5304ba4a-aee4-4ba8-914d-68da5d9eecd9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:08.978758 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5304ba4a-aee4-4ba8-914d-68da5d9eecd9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:08.987906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5304ba4a-aee4-4ba8-914d-68da5d9eecd9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.435592 May 23 14:13:08.988589 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2043/4011] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:08 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:10.005413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b90e9bf2-5455-482d-8311-ecf0a0867cd8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:10.006012 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b90e9bf2-5455-482d-8311-ecf0a0867cd8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:10.012766 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b90e9bf2-5455-482d-8311-ecf0a0867cd8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:10.013213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b90e9bf2-5455-482d-8311-ecf0a0867cd8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:10.013988 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b90e9bf2-5455-482d-8311-ecf0a0867cd8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:10.014417 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b90e9bf2-5455-482d-8311-ecf0a0867cd8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:10.156843 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b90e9bf2-5455-482d-8311-ecf0a0867cd8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:10.165087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b90e9bf2-5455-482d-8311-ecf0a0867cd8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.163911 May 23 14:13:10.169443 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1969/4012] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:09 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:11.182310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5c9938fb-2c0c-4b51-b609-8573efb86187 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:11.182929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5c9938fb-2c0c-4b51-b609-8573efb86187 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:11.185349 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:13:11.186019 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:13:11.191629 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c9938fb-2c0c-4b51-b609-8573efb86187 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:11.192207 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c9938fb-2c0c-4b51-b609-8573efb86187 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:11.193016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c9938fb-2c0c-4b51-b609-8573efb86187 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:11.193453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5c9938fb-2c0c-4b51-b609-8573efb86187 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:11.336372 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5c9938fb-2c0c-4b51-b609-8573efb86187 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:11.344288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5c9938fb-2c0c-4b51-b609-8573efb86187 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.165940 May 23 14:13:11.344890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2044/4013] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:11 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:12.361427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cf97eca8-ae83-4159-9b9d-1141eb351896 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:12.362137 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cf97eca8-ae83-4159-9b9d-1141eb351896 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:12.365985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:13:12.373643 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf97eca8-ae83-4159-9b9d-1141eb351896 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:12.374103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf97eca8-ae83-4159-9b9d-1141eb351896 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:12.375027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf97eca8-ae83-4159-9b9d-1141eb351896 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:12.375491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cf97eca8-ae83-4159-9b9d-1141eb351896 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:12.524481 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cf97eca8-ae83-4159-9b9d-1141eb351896 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:12.533193 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cf97eca8-ae83-4159-9b9d-1141eb351896 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.175486 May 23 14:13:12.533770 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1970/4014] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:12 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:13.550845 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-21a978ba-125a-4dcf-87c8-b4f7095e977d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:13.551443 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-21a978ba-125a-4dcf-87c8-b4f7095e977d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:13.557799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21a978ba-125a-4dcf-87c8-b4f7095e977d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:13.558249 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21a978ba-125a-4dcf-87c8-b4f7095e977d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:13.559009 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21a978ba-125a-4dcf-87c8-b4f7095e977d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:13.559451 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21a978ba-125a-4dcf-87c8-b4f7095e977d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:13.702333 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-21a978ba-125a-4dcf-87c8-b4f7095e977d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:13.710350 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-21a978ba-125a-4dcf-87c8-b4f7095e977d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.163489 May 23 14:13:13.710965 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2045/4015] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:13 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:14.727783 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7dcd5884-f4a1-47d5-9b1d-1b244dfd716f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:14.735032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7dcd5884-f4a1-47d5-9b1d-1b244dfd716f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:14.735370 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dcd5884-f4a1-47d5-9b1d-1b244dfd716f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:14.735825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dcd5884-f4a1-47d5-9b1d-1b244dfd716f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:14.736613 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dcd5884-f4a1-47d5-9b1d-1b244dfd716f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:14.737058 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dcd5884-f4a1-47d5-9b1d-1b244dfd716f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:14.876746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7dcd5884-f4a1-47d5-9b1d-1b244dfd716f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:14.891910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7dcd5884-f4a1-47d5-9b1d-1b244dfd716f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.161699 May 23 14:13:14.891910 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1971/4016] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:14 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:15.903550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-86b42bb2-fcd0-4d48-b11b-b5d9809b2e58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:15.904178 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-86b42bb2-fcd0-4d48-b11b-b5d9809b2e58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:15.915602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86b42bb2-fcd0-4d48-b11b-b5d9809b2e58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:15.916008 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86b42bb2-fcd0-4d48-b11b-b5d9809b2e58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:15.916840 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86b42bb2-fcd0-4d48-b11b-b5d9809b2e58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:15.917278 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-86b42bb2-fcd0-4d48-b11b-b5d9809b2e58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:16.084173 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-86b42bb2-fcd0-4d48-b11b-b5d9809b2e58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:16.095393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-86b42bb2-fcd0-4d48-b11b-b5d9809b2e58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.195826 May 23 14:13:16.095976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2046/4017] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:15 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:13:17.112616 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19386914-e241-4015-9a62-578198e3352b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:17.113941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19386914-e241-4015-9a62-578198e3352b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:17.120792 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19386914-e241-4015-9a62-578198e3352b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:17.121250 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19386914-e241-4015-9a62-578198e3352b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:17.122030 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19386914-e241-4015-9a62-578198e3352b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:17.122463 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19386914-e241-4015-9a62-578198e3352b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:17.279582 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19386914-e241-4015-9a62-578198e3352b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:17.287084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19386914-e241-4015-9a62-578198e3352b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.178352 May 23 14:13:17.287641 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1972/4018] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:17 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:18.234892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-72967e9c-0859-4e5f-ba26-4ede8a182441 req-2efe17bc-377a-49e7-8380-10d2e7255bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0", "name": "network-vif-plugged", "status": "completed", "tag": "d05ad0c7-b90d-4d75-ba28-0b141f6cc853"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:13:18.244091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-72967e9c-0859-4e5f-ba26-4ede8a182441 req-2efe17bc-377a-49e7-8380-10d2e7255bb9 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:18.244540 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-72967e9c-0859-4e5f-ba26-4ede8a182441 req-2efe17bc-377a-49e7-8380-10d2e7255bb9 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:18.256210 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-72967e9c-0859-4e5f-ba26-4ede8a182441 req-2efe17bc-377a-49e7-8380-10d2e7255bb9 service nova] Creating event network-vif-plugged:d05ad0c7-b90d-4d75-ba28-0b141f6cc853 for instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 on hv-cinder-82549 May 23 14:13:18.261644 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-72967e9c-0859-4e5f-ba26-4ede8a182441 req-2efe17bc-377a-49e7-8380-10d2e7255bb9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030457 May 23 14:13:18.262238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2047/4019] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:13:18.303841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af9e9186-caf0-40da-b03f-b7696292f936 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:18.304637 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-af9e9186-caf0-40da-b03f-b7696292f936 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:18.311435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af9e9186-caf0-40da-b03f-b7696292f936 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:18.311889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af9e9186-caf0-40da-b03f-b7696292f936 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:18.312892 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af9e9186-caf0-40da-b03f-b7696292f936 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:18.313325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af9e9186-caf0-40da-b03f-b7696292f936 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:18.473925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af9e9186-caf0-40da-b03f-b7696292f936 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:18.481422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-af9e9186-caf0-40da-b03f-b7696292f936 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.181858 May 23 14:13:18.481980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1973/4020] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:18 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:19.499691 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b7fa7c03-9c8e-4dd3-89bd-35713194e92f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:19.500316 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b7fa7c03-9c8e-4dd3-89bd-35713194e92f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:19.506979 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7fa7c03-9c8e-4dd3-89bd-35713194e92f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:19.507436 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7fa7c03-9c8e-4dd3-89bd-35713194e92f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:19.508203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7fa7c03-9c8e-4dd3-89bd-35713194e92f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:19.508667 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b7fa7c03-9c8e-4dd3-89bd-35713194e92f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:19.641353 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b7fa7c03-9c8e-4dd3-89bd-35713194e92f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:19.649902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b7fa7c03-9c8e-4dd3-89bd-35713194e92f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1264 microversion: 2.1 time: 0.154936 May 23 14:13:19.650471 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2048/4021] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:19 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:20.667605 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-308159f0-27f3-4543-9703-99c83579c59e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:20.668125 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-308159f0-27f3-4543-9703-99c83579c59e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:20.674479 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-308159f0-27f3-4543-9703-99c83579c59e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:20.674962 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-308159f0-27f3-4543-9703-99c83579c59e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:20.675803 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-308159f0-27f3-4543-9703-99c83579c59e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:20.676305 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-308159f0-27f3-4543-9703-99c83579c59e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:20.813775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-308159f0-27f3-4543-9703-99c83579c59e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:20.822610 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-308159f0-27f3-4543-9703-99c83579c59e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1451 microversion: 2.1 time: 0.159533 May 23 14:13:20.823192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1974/4022] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:20 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:20.841171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7cbce65a-0a2c-47e2-97b4-78fdeea939b5 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:13:20.841803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7cbce65a-0a2c-47e2-97b4-78fdeea939b5 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:13:20.848802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cbce65a-0a2c-47e2-97b4-78fdeea939b5 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:20.849259 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cbce65a-0a2c-47e2-97b4-78fdeea939b5 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:20.850035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cbce65a-0a2c-47e2-97b4-78fdeea939b5 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:20.850504 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7cbce65a-0a2c-47e2-97b4-78fdeea939b5 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:20.991091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7cbce65a-0a2c-47e2-97b4-78fdeea939b5 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:13:20.999288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7cbce65a-0a2c-47e2-97b4-78fdeea939b5 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1451 microversion: 2.1 time: 0.163249 May 23 14:13:20.999892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2049/4023] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:13:20 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:13:23.210246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-4e68b983-534e-4c37-9da1-d4dcf0ee20c3 req-ba38e93f-a19a-498b-b667-d82de4c4cac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0", "tag": "d05ad0c7-b90d-4d75-ba28-0b141f6cc853"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:13:23.218763 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4e68b983-534e-4c37-9da1-d4dcf0ee20c3 req-ba38e93f-a19a-498b-b667-d82de4c4cac8 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:13:23.219494 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4e68b983-534e-4c37-9da1-d4dcf0ee20c3 req-ba38e93f-a19a-498b-b667-d82de4c4cac8 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:13:23.231226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-4e68b983-534e-4c37-9da1-d4dcf0ee20c3 req-ba38e93f-a19a-498b-b667-d82de4c4cac8 service nova] Creating event network-changed:d05ad0c7-b90d-4d75-ba28-0b141f6cc853 for instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 on hv-cinder-82549 May 23 14:13:23.236210 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-4e68b983-534e-4c37-9da1-d4dcf0ee20c3 req-ba38e93f-a19a-498b-b667-d82de4c4cac8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030091 May 23 14:13:23.237080 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1975/4024] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:14:37.450520 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:14:37.451274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=58 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:14:37.455131 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8023174a-0b13-4311-84ca-868bbd71abdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:37.455753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8023174a-0b13-4311-84ca-868bbd71abdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:37.463029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8023174a-0b13-4311-84ca-868bbd71abdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:37.463484 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8023174a-0b13-4311-84ca-868bbd71abdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:37.464446 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8023174a-0b13-4311-84ca-868bbd71abdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:37.464929 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8023174a-0b13-4311-84ca-868bbd71abdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:37.493363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8023174a-0b13-4311-84ca-868bbd71abdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:14:37.810267 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8023174a-0b13-4311-84ca-868bbd71abdf tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 204 len: 0 microversion: 2.1 time: 0.361188 May 23 14:14:37.810835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2050/4025] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:14:37 2022] DELETE /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 14:14:37.818027 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18ee348b-6862-4ade-8023-ce106aeb85cc] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 14:14:37.818834 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=24 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:14:37.819355 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=52 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:14:37.823719 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4c9d75c5-7ffb-43fa-87d9-755a90c80909 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:37.824444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4c9d75c5-7ffb-43fa-87d9-755a90c80909 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:37.830862 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c9d75c5-7ffb-43fa-87d9-755a90c80909 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:37.831574 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c9d75c5-7ffb-43fa-87d9-755a90c80909 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:37.832341 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c9d75c5-7ffb-43fa-87d9-755a90c80909 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:37.832865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c9d75c5-7ffb-43fa-87d9-755a90c80909 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:37.979661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4c9d75c5-7ffb-43fa-87d9-755a90c80909 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:14:37.987399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4c9d75c5-7ffb-43fa-87d9-755a90c80909 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1507 microversion: 2.1 time: 0.172063 May 23 14:14:37.987970 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1976/4026] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:14:37 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:14:39.007558 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c560ca88-7ed3-47b8-b661-36f7e6a6bc3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:39.008265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c560ca88-7ed3-47b8-b661-36f7e6a6bc3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:39.015388 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c560ca88-7ed3-47b8-b661-36f7e6a6bc3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:39.015843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c560ca88-7ed3-47b8-b661-36f7e6a6bc3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:39.016653 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c560ca88-7ed3-47b8-b661-36f7e6a6bc3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:39.017100 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c560ca88-7ed3-47b8-b661-36f7e6a6bc3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:39.247834 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c560ca88-7ed3-47b8-b661-36f7e6a6bc3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:14:39.256092 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c560ca88-7ed3-47b8-b661-36f7e6a6bc3d tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1507 microversion: 2.1 time: 0.253319 May 23 14:14:39.256694 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2051/4027] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:14:39 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:14:39.611444 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] [18ee348b-6862-4ade-8023-ce106aeb85cc] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 46250. May 23 14:14:39.747439 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-4b3eb278-8eb2-4b54-b1d6-a098105b759d req-1d34b158-8a47-4e7b-85c3-699efc93399a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fed39b-8380-4717-a760-06079bdfd66d", "name": "network-vif-deleted", "tag": "28defdb2-721b-4ae7-81e4-a7844f3e0baa"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:14:39.755985 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4b3eb278-8eb2-4b54-b1d6-a098105b759d req-1d34b158-8a47-4e7b-85c3-699efc93399a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:39.756436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4b3eb278-8eb2-4b54-b1d6-a098105b759d req-1d34b158-8a47-4e7b-85c3-699efc93399a service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:39.773188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-4b3eb278-8eb2-4b54-b1d6-a098105b759d req-1d34b158-8a47-4e7b-85c3-699efc93399a service nova] Creating event network-vif-deleted:28defdb2-721b-4ae7-81e4-a7844f3e0baa for instance b6fed39b-8380-4717-a760-06079bdfd66d on hv-cinder-82549 May 23 14:14:39.774254 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-4b3eb278-8eb2-4b54-b1d6-a098105b759d req-1d34b158-8a47-4e7b-85c3-699efc93399a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181643 May 23 14:14:39.774876 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1977/4028] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:14:40.273790 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:40.274411 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:40.280978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:40.281438 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:40.283715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:40.283715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:40.313957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:40.314416 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:40.314874 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'fault' on Instance uuid b6fed39b-8380-4717-a760-06079bdfd66d {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:14:40.356311 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:14:40.364377 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7561e19d-8305-4b0f-a490-4eb08f1c53c6 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 200 len: 1311 microversion: 2.1 time: 0.094679 May 23 14:14:40.365038 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2052/4029] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:14:40 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:14:41.382851 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:41.383578 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: b6fed39b-8380-4717-a760-06079bdfd66d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:41.390390 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:41.390842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:41.391606 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:41.392043 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:41.406536 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Instance b6fed39b-8380-4717-a760-06079bdfd66d could not be found. May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d HTTP/1.1 May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:14:41.408197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance b6fed39b-8380-4717-a760-06079bdfd66d could not be found. May 23 14:14:41.409459 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'b6fed39b-8380-4717-a760-06079bdfd66d'} May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fed39b-8380-4717-a760-06079bdfd66d could not be found. May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:14:41.410251 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fed39b-8380-4717-a760-06079bdfd66d could not be found. May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fed39b-8380-4717-a760-06079bdfd66d could not be found. May 23 14:14:41.413098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:41.415365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 404 to user: Instance b6fed39b-8380-4717-a760-06079bdfd66d could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:14:41.415365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-736cac61-5952-49ea-a41f-4b5e7b9b8f6c tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d" status: 404 len: 111 microversion: 2.1 time: 0.031742 May 23 14:14:41.415365 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1978/4030] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:14:41 2022] GET /compute/v2.1/servers/b6fed39b-8380-4717-a760-06079bdfd66d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:14:41.420392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5818fb7e-fefc-4223-8b18-968240f993c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:41.420919 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5818fb7e-fefc-4223-8b18-968240f993c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:41.428287 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5818fb7e-fefc-4223-8b18-968240f993c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:41.428958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5818fb7e-fefc-4223-8b18-968240f993c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:41.429736 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5818fb7e-fefc-4223-8b18-968240f993c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:41.430172 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5818fb7e-fefc-4223-8b18-968240f993c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:41.456686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5818fb7e-fefc-4223-8b18-968240f993c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:14:41.781535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5818fb7e-fefc-4223-8b18-968240f993c8 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 204 len: 0 microversion: 2.1 time: 0.364598 May 23 14:14:41.782064 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2053/4031] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:14:41 2022] DELETE /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 14:14:41.790698 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db7e345b-4c54-48fb-b952-8573354a5b68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:41.791330 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db7e345b-4c54-48fb-b952-8573354a5b68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:41.805084 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db7e345b-4c54-48fb-b952-8573354a5b68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:41.805530 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db7e345b-4c54-48fb-b952-8573354a5b68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:41.806309 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db7e345b-4c54-48fb-b952-8573354a5b68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:41.806742 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db7e345b-4c54-48fb-b952-8573354a5b68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:41.943422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db7e345b-4c54-48fb-b952-8573354a5b68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:14:41.950960 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db7e345b-4c54-48fb-b952-8573354a5b68 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.164341 May 23 14:14:41.951594 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1979/4032] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:14:41 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:14:42.968582 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68063cab-b38b-498c-96a5-c7808df977bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:42.969290 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-68063cab-b38b-498c-96a5-c7808df977bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:42.977230 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68063cab-b38b-498c-96a5-c7808df977bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:42.977617 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68063cab-b38b-498c-96a5-c7808df977bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:42.978400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68063cab-b38b-498c-96a5-c7808df977bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:42.978844 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68063cab-b38b-498c-96a5-c7808df977bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:43.147715 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68063cab-b38b-498c-96a5-c7808df977bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:14:43.155275 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68063cab-b38b-498c-96a5-c7808df977bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1522 microversion: 2.1 time: 0.190904 May 23 14:14:43.155833 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2054/4033] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:14:42 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:14:43.260749 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-a342bf91-379e-433c-b8b6-4f5ba755dc30 req-a6db544a-ff15-4b00-a081-b1c53b21c0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc07d7d-03f3-4b89-ae8e-5b898db04e3d", "name": "network-vif-deleted", "tag": "1be92243-68d7-42e8-a7dd-2ed34f166ca6"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:14:43.270596 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a342bf91-379e-433c-b8b6-4f5ba755dc30 req-a6db544a-ff15-4b00-a081-b1c53b21c0c9 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:43.271256 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a342bf91-379e-433c-b8b6-4f5ba755dc30 req-a6db544a-ff15-4b00-a081-b1c53b21c0c9 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:43.283197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-a342bf91-379e-433c-b8b6-4f5ba755dc30 req-a6db544a-ff15-4b00-a081-b1c53b21c0c9 service nova] Creating event network-vif-deleted:1be92243-68d7-42e8-a7dd-2ed34f166ca6 for instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d on hv-cinder-82549 May 23 14:14:43.289218 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-a342bf91-379e-433c-b8b6-4f5ba755dc30 req-a6db544a-ff15-4b00-a081-b1c53b21c0c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032289 May 23 14:14:43.289882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1980/4034] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:14:44.176033 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:44.177331 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:44.184026 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:44.184793 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:44.185635 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:44.186085 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:44.224160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:44.225060 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:44.225930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lazy-loading 'fault' on Instance uuid ebc07d7d-03f3-4b89-ae8e-5b898db04e3d {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:14:44.279192 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af29f227080147a1a157f88842d39483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fb50a6ddee45278948b5fed215597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:14:44.287195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-468a1c09-a575-4b62-9033-d793ca00b4e7 tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 200 len: 1311 microversion: 2.1 time: 0.117832 May 23 14:14:44.291063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2055/4035] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:14:44 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:14:45.304736 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:14:45.305448 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] [instance: ebc07d7d-03f3-4b89-ae8e-5b898db04e3d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:14:45.312329 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:45.312813 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:45.313587 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:14:45.314032 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:14:45.328747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] HTTP exception thrown: Instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d could not be found. May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Request method failure captured: May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d HTTP/1.1 May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii4zOawITv3HA-Ci_sBirTtVIhddK4xSMDMHyWWIjQUsow74eIdDcKRwbc275Gk0udOR0xoQkDYSW6zpqdqogTp1rMjemZrA7VHiJQO46B5lX5iIYe-nFYCawiH51XPcc365JIQD7vryMxvuWMy5QzyMdqt1wifHGQyDYaws7Efftg6I May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: c4fb50a6ddee45278948b5fed215597b May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:14:45.330402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4fb50a6ddee45278948b5fed215597b"}]}] May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: c4fb50a6ddee45278948b5fed215597b May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1724716004 May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: af29f227080147a1a157f88842d39483 May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1724716004-project May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d could not be found. May 23 14:14:45.331885 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'ebc07d7d-03f3-4b89-ae8e-5b898db04e3d'} May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d could not be found. May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:14:45.333695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d could not be found. May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d could not be found. May 23 14:14:45.334979 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:14:45.336122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] Returning 404 to user: Instance ebc07d7d-03f3-4b89-ae8e-5b898db04e3d could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:14:45.336122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-043300e5-601c-4160-983a-be18c294f0bb tempest-ServerRescueNegativeTestJSON-1724716004 tempest-ServerRescueNegativeTestJSON-1724716004-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d" status: 404 len: 111 microversion: 2.1 time: 0.031628 May 23 14:14:45.336122 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1981/4036] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:14:45 2022] GET /compute/v2.1/servers/ebc07d7d-03f3-4b89-ae8e-5b898db04e3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:15:02.544857 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:15:02.545567 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:15:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:15:29.830363 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:15:29.831189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:15:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:15:38.367045 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1a9a40be-41d4-4838-88a9-8feace72d34a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:38.367706 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a9a40be-41d4-4838-88a9-8feace72d34a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:38.369836 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:15:38.370480 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:15:38.375630 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a9a40be-41d4-4838-88a9-8feace72d34a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:38.376116 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a9a40be-41d4-4838-88a9-8feace72d34a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:38.376935 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a9a40be-41d4-4838-88a9-8feace72d34a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:38.377384 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1a9a40be-41d4-4838-88a9-8feace72d34a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:38.403244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1a9a40be-41d4-4838-88a9-8feace72d34a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:15:38.718465 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1a9a40be-41d4-4838-88a9-8feace72d34a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 204 len: 0 microversion: 2.1 time: 0.354997 May 23 14:15:38.719183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2056/4037] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:15:38 2022] DELETE /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 14:15:38.727597 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31700df3-60ae-4824-b7c8-36e954ca0152 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:38.728132 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31700df3-60ae-4824-b7c8-36e954ca0152 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:38.730160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=12 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:15:38.730805 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=20 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:15:38.735720 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31700df3-60ae-4824-b7c8-36e954ca0152 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:38.736170 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31700df3-60ae-4824-b7c8-36e954ca0152 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:38.736983 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31700df3-60ae-4824-b7c8-36e954ca0152 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:38.737420 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31700df3-60ae-4824-b7c8-36e954ca0152 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:38.878932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31700df3-60ae-4824-b7c8-36e954ca0152 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:38.886853 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31700df3-60ae-4824-b7c8-36e954ca0152 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1576 microversion: 2.1 time: 0.163433 May 23 14:15:38.888680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1982/4038] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:38 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:39.905524 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2f5d1db-763c-4be1-88c1-248cf813ba2c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:39.906225 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2f5d1db-763c-4be1-88c1-248cf813ba2c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:39.914035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f5d1db-763c-4be1-88c1-248cf813ba2c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:39.914494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f5d1db-763c-4be1-88c1-248cf813ba2c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:39.915310 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f5d1db-763c-4be1-88c1-248cf813ba2c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:39.915839 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f5d1db-763c-4be1-88c1-248cf813ba2c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:40.050799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2f5d1db-763c-4be1-88c1-248cf813ba2c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:40.058248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2f5d1db-763c-4be1-88c1-248cf813ba2c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1576 microversion: 2.1 time: 0.156910 May 23 14:15:40.058798 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2057/4039] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:39 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:41.075458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8fef58f2-0b68-425a-a7fd-38ab8a5f68da tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:41.076059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8fef58f2-0b68-425a-a7fd-38ab8a5f68da tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:41.083238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fef58f2-0b68-425a-a7fd-38ab8a5f68da tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:41.083675 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fef58f2-0b68-425a-a7fd-38ab8a5f68da tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:41.084422 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fef58f2-0b68-425a-a7fd-38ab8a5f68da tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:41.084874 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8fef58f2-0b68-425a-a7fd-38ab8a5f68da tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:41.216525 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8fef58f2-0b68-425a-a7fd-38ab8a5f68da tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:41.225131 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8fef58f2-0b68-425a-a7fd-38ab8a5f68da tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1576 microversion: 2.1 time: 0.153489 May 23 14:15:41.225688 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1983/4040] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:41 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:42.241393 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-803c9df9-efd2-47a5-b624-8451c5fb007d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:42.242007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-803c9df9-efd2-47a5-b624-8451c5fb007d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:42.249724 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-803c9df9-efd2-47a5-b624-8451c5fb007d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:42.250182 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-803c9df9-efd2-47a5-b624-8451c5fb007d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:42.250959 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-803c9df9-efd2-47a5-b624-8451c5fb007d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:42.251399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-803c9df9-efd2-47a5-b624-8451c5fb007d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:42.387699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-803c9df9-efd2-47a5-b624-8451c5fb007d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:42.394369 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-803c9df9-efd2-47a5-b624-8451c5fb007d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1576 microversion: 2.1 time: 0.156646 May 23 14:15:42.395079 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2058/4041] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:42 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:43.411987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d8d9f406-f45c-44ad-8c37-fbe59a830267 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:43.412526 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d8d9f406-f45c-44ad-8c37-fbe59a830267 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:43.418737 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8d9f406-f45c-44ad-8c37-fbe59a830267 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:43.419255 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8d9f406-f45c-44ad-8c37-fbe59a830267 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:43.420023 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8d9f406-f45c-44ad-8c37-fbe59a830267 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:43.420454 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8d9f406-f45c-44ad-8c37-fbe59a830267 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:43.561996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d8d9f406-f45c-44ad-8c37-fbe59a830267 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:43.571304 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d8d9f406-f45c-44ad-8c37-fbe59a830267 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1576 microversion: 2.1 time: 0.164538 May 23 14:15:43.571877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1984/4042] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:43 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:15:44.056683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-54c66037-b13d-40bc-9240-129bf717dc23 req-4cb3af4e-9e08-4b81-8ac0-3df64d38994e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0", "name": "network-vif-deleted", "tag": "d05ad0c7-b90d-4d75-ba28-0b141f6cc853"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:15:44.066018 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-54c66037-b13d-40bc-9240-129bf717dc23 req-4cb3af4e-9e08-4b81-8ac0-3df64d38994e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:44.066481 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-54c66037-b13d-40bc-9240-129bf717dc23 req-4cb3af4e-9e08-4b81-8ac0-3df64d38994e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:44.079407 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-54c66037-b13d-40bc-9240-129bf717dc23 req-4cb3af4e-9e08-4b81-8ac0-3df64d38994e service nova] Creating event network-vif-deleted:d05ad0c7-b90d-4d75-ba28-0b141f6cc853 for instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 on hv-cinder-82549 May 23 14:15:44.087769 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-54c66037-b13d-40bc-9240-129bf717dc23 req-4cb3af4e-9e08-4b81-8ac0-3df64d38994e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 May 23 14:15:44.091492 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2059/4043] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:15:44.588227 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0722b2ec-5395-4373-a292-573a2663d2fc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:44.590019 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0722b2ec-5395-4373-a292-573a2663d2fc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:44.598927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0722b2ec-5395-4373-a292-573a2663d2fc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:44.602738 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0722b2ec-5395-4373-a292-573a2663d2fc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:44.609345 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0722b2ec-5395-4373-a292-573a2663d2fc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:44.611295 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0722b2ec-5395-4373-a292-573a2663d2fc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:44.694016 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0722b2ec-5395-4373-a292-573a2663d2fc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:44.703455 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0722b2ec-5395-4373-a292-573a2663d2fc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 200 len: 1224 microversion: 2.1 time: 0.119272 May 23 14:15:44.704680 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1985/4044] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:44 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:45.721144 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:45.721894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:45.728820 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:45.729266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:45.730028 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:45.730463 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:45.744621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] HTTP exception thrown: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Request method failure captured: May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 HTTP/1.1 May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii5Y-hFcnxClFLCXYNJRHjEcon61HpzBm5p8XPRM04C5zwaxsdPiovQfv24bM7_uBX130R6h3KH-pihhL0naKjUgIdjrXPvTJBp7vecz7GwBCx4gzEE-pFC7saA2q_C4r8UsYNLHgM9jkdqs4-DxnANHm9vaCsGmiOnnCLXgvG1Cr9Aw May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: aee15038cdf945a594437e83a34e1afe May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:15:45.746266 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aee15038cdf945a594437e83a34e1afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}] May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestVolumeBootPattern-741075917 May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: aee15038cdf945a594437e83a34e1afe May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-TestVolumeBootPattern-741075917-project May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 7b6534d42be64c3cb311d384458bfae3 May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestVolumeBootPattern-741075917-project May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:15:45.747742 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': 'dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0'} May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:15:45.748590 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:15:45.749964 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:15:45.751031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Returning 404 to user: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:15:45.751031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f9a6fcd3-7ec8-41e8-aec7-82650e14b901 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 404 len: 111 microversion: 2.1 time: 0.030713 May 23 14:15:45.751031 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2060/4045] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:45 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:15:45.844743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-280176867", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-491265647", "security_groups": [{"name": "tempest-secgroup-smoke-181117543"}], "block_device_mapping_v2": [{"uuid": "bd10eeab-4920-459e-bf3a-39e3b837027d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "873c118a-6ead-44a8-b517-3d571f85940c"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:15:45.957881 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] validate_networks() for [('873c118a-6ead-44a8-b517-3d571f85940c', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 14:15:46.450543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 14:15:46.450964 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 14:15:46.451436 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 14:15:46.451864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 14:15:46.452293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 14:15:46.461427 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:46.461873 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:46.462646 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:46.463079 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:46.479989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Getting quotas for project aee15038cdf945a594437e83a34e1afe. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:15:46.484241 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Getting quotas for user 7b6534d42be64c3cb311d384458bfae3 and project aee15038cdf945a594437e83a34e1afe. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:15:46.542949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 14:15:46.545344 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd10eeab-4920-459e-bf3a-39e3b837027d',volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 14:15:47.059504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5ad62e7-fefd-42ee-8273-d3858a17333b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.218480 May 23 14:15:47.060147 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1986/4046] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 14:15:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 14:15:47.071265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9b9ac06c-3fc3-4fd8-9493-a2f93ff83c5b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:47.072093 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9b9ac06c-3fc3-4fd8-9493-a2f93ff83c5b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:47.162760 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9b9ac06c-3fc3-4fd8-9493-a2f93ff83c5b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:47.183373 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9b9ac06c-3fc3-4fd8-9493-a2f93ff83c5b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1093 microversion: 2.1 time: 0.115854 May 23 14:15:47.185494 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2061/4047] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:47 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1093 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:48.201237 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8514224-5244-4a5d-88cc-3f182b442ce1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:48.201875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8514224-5244-4a5d-88cc-3f182b442ce1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:48.208991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8514224-5244-4a5d-88cc-3f182b442ce1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:48.209437 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8514224-5244-4a5d-88cc-3f182b442ce1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:48.210194 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8514224-5244-4a5d-88cc-3f182b442ce1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:48.210626 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8514224-5244-4a5d-88cc-3f182b442ce1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:48.292775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8514224-5244-4a5d-88cc-3f182b442ce1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:48.302418 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8514224-5244-4a5d-88cc-3f182b442ce1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1143 microversion: 2.1 time: 0.105415 May 23 14:15:48.311889 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1987/4048] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:48 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1143 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:49.319616 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-720d38d0-9666-4287-8e1c-108507ca89a3 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:49.320274 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-720d38d0-9666-4287-8e1c-108507ca89a3 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:49.327219 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-720d38d0-9666-4287-8e1c-108507ca89a3 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:49.327676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-720d38d0-9666-4287-8e1c-108507ca89a3 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:49.328453 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-720d38d0-9666-4287-8e1c-108507ca89a3 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:49.328930 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-720d38d0-9666-4287-8e1c-108507ca89a3 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:49.434238 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-720d38d0-9666-4287-8e1c-108507ca89a3 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:49.443265 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-720d38d0-9666-4287-8e1c-108507ca89a3 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1199 microversion: 2.1 time: 0.127982 May 23 14:15:49.445296 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2062/4049] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:49 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1199 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:15:50.462917 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a2927091-1870-4163-8340-b06d31b13cf1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:50.464356 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a2927091-1870-4163-8340-b06d31b13cf1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:50.471502 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2927091-1870-4163-8340-b06d31b13cf1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:50.472754 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2927091-1870-4163-8340-b06d31b13cf1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:50.473608 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2927091-1870-4163-8340-b06d31b13cf1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:50.474286 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a2927091-1870-4163-8340-b06d31b13cf1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:50.654695 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a2927091-1870-4163-8340-b06d31b13cf1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:50.670165 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a2927091-1870-4163-8340-b06d31b13cf1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1276 microversion: 2.1 time: 0.211035 May 23 14:15:50.670865 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1988/4050] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:50 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:51.352902 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-9ea35ce3-dc04-45c9-a6ee-7854f71a6791 req-e1f9fdeb-a945-4be6-b835-221cfc58a288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4255c2-050e-4983-8133-8a61d7092761", "tag": "91c3a64d-17b0-4208-a9ce-f3124190c577"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:15:51.361896 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9ea35ce3-dc04-45c9-a6ee-7854f71a6791 req-e1f9fdeb-a945-4be6-b835-221cfc58a288 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:51.362347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9ea35ce3-dc04-45c9-a6ee-7854f71a6791 req-e1f9fdeb-a945-4be6-b835-221cfc58a288 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:51.378382 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-9ea35ce3-dc04-45c9-a6ee-7854f71a6791 req-e1f9fdeb-a945-4be6-b835-221cfc58a288 service nova] Creating event network-changed:91c3a64d-17b0-4208-a9ce-f3124190c577 for instance da4255c2-050e-4983-8133-8a61d7092761 on hv-cinder-82549 May 23 14:15:51.386355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-9ea35ce3-dc04-45c9-a6ee-7854f71a6791 req-e1f9fdeb-a945-4be6-b835-221cfc58a288 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036812 May 23 14:15:51.386355 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2063/4051] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:15:51.687997 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd00c764-cbcf-49e8-9b18-dd66c862b516 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:51.688633 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd00c764-cbcf-49e8-9b18-dd66c862b516 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:51.695173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd00c764-cbcf-49e8-9b18-dd66c862b516 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:51.695912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd00c764-cbcf-49e8-9b18-dd66c862b516 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:51.696912 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd00c764-cbcf-49e8-9b18-dd66c862b516 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:51.697381 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd00c764-cbcf-49e8-9b18-dd66c862b516 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:51.846624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd00c764-cbcf-49e8-9b18-dd66c862b516 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:51.858325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd00c764-cbcf-49e8-9b18-dd66c862b516 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.172156 May 23 14:15:51.858325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1989/4052] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:51 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:52.874108 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb30a2e8-0aab-4234-b299-f234efb15172 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:52.874831 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb30a2e8-0aab-4234-b299-f234efb15172 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:52.881916 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb30a2e8-0aab-4234-b299-f234efb15172 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:52.882367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb30a2e8-0aab-4234-b299-f234efb15172 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:52.883136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb30a2e8-0aab-4234-b299-f234efb15172 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:52.883579 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb30a2e8-0aab-4234-b299-f234efb15172 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:53.187498 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb30a2e8-0aab-4234-b299-f234efb15172 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:53.194247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb30a2e8-0aab-4234-b299-f234efb15172 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.324954 May 23 14:15:53.194835 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2064/4053] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:52 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:54.212631 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a64bf606-fcfd-4a51-8689-52545199679e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:54.213317 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a64bf606-fcfd-4a51-8689-52545199679e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:54.220197 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a64bf606-fcfd-4a51-8689-52545199679e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:54.220687 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a64bf606-fcfd-4a51-8689-52545199679e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:54.221470 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a64bf606-fcfd-4a51-8689-52545199679e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:54.221989 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a64bf606-fcfd-4a51-8689-52545199679e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:54.388785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a64bf606-fcfd-4a51-8689-52545199679e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:54.397904 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a64bf606-fcfd-4a51-8689-52545199679e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.189164 May 23 14:15:54.402347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1990/4054] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:54 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:55.415405 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-93b1cab7-3337-4a04-ac20-37eae7c77843 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:55.416047 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-93b1cab7-3337-4a04-ac20-37eae7c77843 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:55.423799 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93b1cab7-3337-4a04-ac20-37eae7c77843 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:55.424257 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93b1cab7-3337-4a04-ac20-37eae7c77843 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:55.425347 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93b1cab7-3337-4a04-ac20-37eae7c77843 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:55.425995 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93b1cab7-3337-4a04-ac20-37eae7c77843 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:55.578062 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93b1cab7-3337-4a04-ac20-37eae7c77843 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:55.587467 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-93b1cab7-3337-4a04-ac20-37eae7c77843 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.175976 May 23 14:15:55.588248 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2065/4055] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:55 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:56.605017 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b4d44c7b-0010-44dd-9842-595b5f4040fe tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:56.605655 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b4d44c7b-0010-44dd-9842-595b5f4040fe tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:56.608271 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:15:56.609010 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:15:56.613987 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4d44c7b-0010-44dd-9842-595b5f4040fe tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:56.622659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4d44c7b-0010-44dd-9842-595b5f4040fe tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:56.622659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4d44c7b-0010-44dd-9842-595b5f4040fe tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:56.622659 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4d44c7b-0010-44dd-9842-595b5f4040fe tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:56.758941 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4d44c7b-0010-44dd-9842-595b5f4040fe tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:56.766438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b4d44c7b-0010-44dd-9842-595b5f4040fe tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.165297 May 23 14:15:56.766882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1991/4056] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:56 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:57.783753 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-82c371a5-1a98-4d95-8d12-555ede20e0be tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:57.785283 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-82c371a5-1a98-4d95-8d12-555ede20e0be tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:57.787907 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:15:57.800128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82c371a5-1a98-4d95-8d12-555ede20e0be tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:57.800128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82c371a5-1a98-4d95-8d12-555ede20e0be tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:57.800128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82c371a5-1a98-4d95-8d12-555ede20e0be tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:57.800128 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-82c371a5-1a98-4d95-8d12-555ede20e0be tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:57.942165 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-82c371a5-1a98-4d95-8d12-555ede20e0be tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:57.950194 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-82c371a5-1a98-4d95-8d12-555ede20e0be tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.170442 May 23 14:15:57.950982 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2066/4057] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:57 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:15:58.967609 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-df193ae0-d35c-40ca-9f86-d4ffce10dfeb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:15:58.968162 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-df193ae0-d35c-40ca-9f86-d4ffce10dfeb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:15:58.975461 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df193ae0-d35c-40ca-9f86-d4ffce10dfeb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:58.975914 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df193ae0-d35c-40ca-9f86-d4ffce10dfeb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:58.976702 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df193ae0-d35c-40ca-9f86-d4ffce10dfeb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:15:58.977144 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-df193ae0-d35c-40ca-9f86-d4ffce10dfeb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:15:59.149612 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-df193ae0-d35c-40ca-9f86-d4ffce10dfeb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:15:59.158893 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-df193ae0-d35c-40ca-9f86-d4ffce10dfeb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.195286 May 23 14:15:59.161379 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1992/4058] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:15:58 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:16:00.180814 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ba74fa09-97de-481d-89f8-07a14e38c656 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:16:00.182508 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ba74fa09-97de-481d-89f8-07a14e38c656 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:16:00.190252 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba74fa09-97de-481d-89f8-07a14e38c656 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:00.191078 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba74fa09-97de-481d-89f8-07a14e38c656 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:00.192029 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba74fa09-97de-481d-89f8-07a14e38c656 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:00.192476 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba74fa09-97de-481d-89f8-07a14e38c656 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:00.327957 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ba74fa09-97de-481d-89f8-07a14e38c656 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:16:00.337410 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ba74fa09-97de-481d-89f8-07a14e38c656 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.164543 May 23 14:16:00.338271 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2067/4059] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:16:00 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:16:01.357882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-affa9d38-dc62-40de-b05e-8095a4de1207 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:16:01.358825 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-affa9d38-dc62-40de-b05e-8095a4de1207 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:16:01.366416 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-affa9d38-dc62-40de-b05e-8095a4de1207 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:01.366861 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-affa9d38-dc62-40de-b05e-8095a4de1207 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:01.367674 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-affa9d38-dc62-40de-b05e-8095a4de1207 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:01.368114 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-affa9d38-dc62-40de-b05e-8095a4de1207 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:01.515325 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-affa9d38-dc62-40de-b05e-8095a4de1207 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:16:01.524374 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-affa9d38-dc62-40de-b05e-8095a4de1207 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.170713 May 23 14:16:01.525475 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1993/4060] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:16:01 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:16:02.542286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d83c009a-0d11-42b3-a288-dcfaf80a911e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:16:02.542924 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d83c009a-0d11-42b3-a288-dcfaf80a911e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:16:02.549610 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d83c009a-0d11-42b3-a288-dcfaf80a911e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:02.550305 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d83c009a-0d11-42b3-a288-dcfaf80a911e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:02.551661 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d83c009a-0d11-42b3-a288-dcfaf80a911e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:02.552112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d83c009a-0d11-42b3-a288-dcfaf80a911e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:02.711952 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d83c009a-0d11-42b3-a288-dcfaf80a911e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:16:02.721554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d83c009a-0d11-42b3-a288-dcfaf80a911e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.184111 May 23 14:16:02.722702 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2068/4061] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:16:02 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:16:03.135841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-a96f139c-3d33-4414-b74e-f2332a49f2c3 req-dd4a3b37-254d-422e-afb0-397a24bb8bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4255c2-050e-4983-8133-8a61d7092761", "name": "network-vif-plugged", "status": "completed", "tag": "91c3a64d-17b0-4208-a9ce-f3124190c577"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:16:03.145855 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a96f139c-3d33-4414-b74e-f2332a49f2c3 req-dd4a3b37-254d-422e-afb0-397a24bb8bdc service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:03.146580 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-a96f139c-3d33-4414-b74e-f2332a49f2c3 req-dd4a3b37-254d-422e-afb0-397a24bb8bdc service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:03.163015 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-a96f139c-3d33-4414-b74e-f2332a49f2c3 req-dd4a3b37-254d-422e-afb0-397a24bb8bdc service nova] Creating event network-vif-plugged:91c3a64d-17b0-4208-a9ce-f3124190c577 for instance da4255c2-050e-4983-8133-8a61d7092761 on hv-cinder-82549 May 23 14:16:03.179661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-a96f139c-3d33-4414-b74e-f2332a49f2c3 req-dd4a3b37-254d-422e-afb0-397a24bb8bdc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184518 May 23 14:16:03.179661 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1994/4062] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:16:03.741414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ec9353de-06c4-4abc-b91a-ebf76105257b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:16:03.742061 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ec9353de-06c4-4abc-b91a-ebf76105257b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:16:03.748779 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec9353de-06c4-4abc-b91a-ebf76105257b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:03.749231 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec9353de-06c4-4abc-b91a-ebf76105257b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:03.750007 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec9353de-06c4-4abc-b91a-ebf76105257b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:03.750447 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ec9353de-06c4-4abc-b91a-ebf76105257b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:03.889714 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ec9353de-06c4-4abc-b91a-ebf76105257b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:16:03.897853 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ec9353de-06c4-4abc-b91a-ebf76105257b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.160432 May 23 14:16:03.898621 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2069/4063] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:16:03 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:16:04.916996 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cc2b654b-a2c6-4b58-8ab6-3e88db5c5a2e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:16:04.917699 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cc2b654b-a2c6-4b58-8ab6-3e88db5c5a2e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:16:04.924089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc2b654b-a2c6-4b58-8ab6-3e88db5c5a2e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:04.924607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc2b654b-a2c6-4b58-8ab6-3e88db5c5a2e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:04.925978 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc2b654b-a2c6-4b58-8ab6-3e88db5c5a2e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:04.926523 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc2b654b-a2c6-4b58-8ab6-3e88db5c5a2e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:05.073745 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc2b654b-a2c6-4b58-8ab6-3e88db5c5a2e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:16:05.086239 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cc2b654b-a2c6-4b58-8ab6-3e88db5c5a2e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1264 microversion: 2.1 time: 0.173807 May 23 14:16:05.086841 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1995/4064] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:16:04 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:16:06.104174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6fe8cb44-66a4-4681-a4a8-25bf6ece6d52 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:16:06.104823 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6fe8cb44-66a4-4681-a4a8-25bf6ece6d52 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:16:06.111640 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fe8cb44-66a4-4681-a4a8-25bf6ece6d52 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:06.112095 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fe8cb44-66a4-4681-a4a8-25bf6ece6d52 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:06.113829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fe8cb44-66a4-4681-a4a8-25bf6ece6d52 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:06.114269 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6fe8cb44-66a4-4681-a4a8-25bf6ece6d52 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:06.264273 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6fe8cb44-66a4-4681-a4a8-25bf6ece6d52 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:16:06.272662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6fe8cb44-66a4-4681-a4a8-25bf6ece6d52 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1450 microversion: 2.1 time: 0.172430 May 23 14:16:06.273250 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2070/4065] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:16:06 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:16:06.289402 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0c0401da-1952-421a-9c36-20e75a6f4298 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:16:06.290011 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0c0401da-1952-421a-9c36-20e75a6f4298 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:16:06.296595 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c0401da-1952-421a-9c36-20e75a6f4298 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:06.297068 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c0401da-1952-421a-9c36-20e75a6f4298 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:06.297828 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c0401da-1952-421a-9c36-20e75a6f4298 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:06.298264 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c0401da-1952-421a-9c36-20e75a6f4298 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:06.439435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0c0401da-1952-421a-9c36-20e75a6f4298 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:16:06.447347 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0c0401da-1952-421a-9c36-20e75a6f4298 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1450 microversion: 2.1 time: 0.161855 May 23 14:16:06.447925 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1996/4066] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:16:06 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:16:08.900083 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-22bb9122-9482-48da-b7c9-77c3ecb314f6 req-07051ffe-5a82-468b-bd5d-588d2c009ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4255c2-050e-4983-8133-8a61d7092761", "tag": "91c3a64d-17b0-4208-a9ce-f3124190c577"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:16:08.903580 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:16:08.909429 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-22bb9122-9482-48da-b7c9-77c3ecb314f6 req-07051ffe-5a82-468b-bd5d-588d2c009ac6 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:16:08.912218 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-22bb9122-9482-48da-b7c9-77c3ecb314f6 req-07051ffe-5a82-468b-bd5d-588d2c009ac6 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:16:08.914527 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:16:08.923802 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-22bb9122-9482-48da-b7c9-77c3ecb314f6 req-07051ffe-5a82-468b-bd5d-588d2c009ac6 service nova] Creating event network-changed:91c3a64d-17b0-4208-a9ce-f3124190c577 for instance da4255c2-050e-4983-8133-8a61d7092761 on hv-cinder-82549 May 23 14:16:08.930829 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-22bb9122-9482-48da-b7c9-77c3ecb314f6 req-07051ffe-5a82-468b-bd5d-588d2c009ac6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114423 May 23 14:16:08.934890 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2071/4067] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:16:56.904021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:16:56.904991 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:16:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:18:22.343349 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:18:22.344116 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=82 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:18:22.348267 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-716400925", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-491265647", "security_groups": [{"name": "tempest-secgroup-smoke-181117543"}], "block_device_mapping_v2": [{"uuid": "d97c3426-4d46-4068-b229-edfe1dddb451", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "873c118a-6ead-44a8-b517-3d571f85940c"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:18:22.553486 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:18:22.553710 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.70) !!! May 23 14:18:22.615624 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] validate_networks() for [('873c118a-6ead-44a8-b517-3d571f85940c', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 14:18:23.001927 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 14:18:23.002357 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 14:18:23.002883 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 14:18:23.003277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 14:18:23.003691 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 14:18:23.013192 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:23.013870 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:23.014627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:23.015067 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:23.031935 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Getting quotas for project aee15038cdf945a594437e83a34e1afe. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 14:18:23.036042 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Getting quotas for user 7b6534d42be64c3cb311d384458bfae3 and project aee15038cdf945a594437e83a34e1afe. Resources: {'cores', 'instances', 'ram'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 14:18:23.096168 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 14:18:23.098283 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d97c3426-4d46-4068-b229-edfe1dddb451',volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 14:18:23.532363 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e36bd973-8079-4fcc-abd0-250edbedff2d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.192362 May 23 14:18:23.533307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1997/4068] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 23 14:18:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 14:18:23.541764 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d99802af-0360-4776-b3d1-809701f10a0b] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 23 14:18:23.546888 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-302ef6f0-7ec3-49b1-b7ce-e81d29d7075f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:23.548183 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-302ef6f0-7ec3-49b1-b7ce-e81d29d7075f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:23.607668 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-302ef6f0-7ec3-49b1-b7ce-e81d29d7075f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:23.615803 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-302ef6f0-7ec3-49b1-b7ce-e81d29d7075f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1093 microversion: 2.1 time: 0.076298 May 23 14:18:23.616587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2072/4069] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:23 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:24.634531 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-35f3df73-8497-4cba-9ae1-aa094016cbcb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:24.635549 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-35f3df73-8497-4cba-9ae1-aa094016cbcb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:24.692179 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-35f3df73-8497-4cba-9ae1-aa094016cbcb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:24.699560 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-35f3df73-8497-4cba-9ae1-aa094016cbcb tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1093 microversion: 2.1 time: 0.069495 May 23 14:18:24.700333 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1998/4070] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:24 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:25.717676 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c0438141-2359-4d04-939d-123bb766e31d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:25.718286 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c0438141-2359-4d04-939d-123bb766e31d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:25.728687 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0438141-2359-4d04-939d-123bb766e31d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:25.729137 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0438141-2359-4d04-939d-123bb766e31d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:25.729927 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0438141-2359-4d04-939d-123bb766e31d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:25.730400 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0438141-2359-4d04-939d-123bb766e31d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:25.746268 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d99802af-0360-4776-b3d1-809701f10a0b] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 47376. May 23 14:18:25.794925 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0438141-2359-4d04-939d-123bb766e31d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:25.802893 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c0438141-2359-4d04-939d-123bb766e31d tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1143 microversion: 2.1 time: 0.090349 May 23 14:18:25.803485 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2073/4071] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:25 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:26.820013 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e43e3922-d037-4b7a-b347-53406873b178 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:26.820544 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e43e3922-d037-4b7a-b347-53406873b178 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:26.828337 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e43e3922-d037-4b7a-b347-53406873b178 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:26.832493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e43e3922-d037-4b7a-b347-53406873b178 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:26.832493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e43e3922-d037-4b7a-b347-53406873b178 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:26.832493 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e43e3922-d037-4b7a-b347-53406873b178 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:26.896035 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e43e3922-d037-4b7a-b347-53406873b178 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:26.904524 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e43e3922-d037-4b7a-b347-53406873b178 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1143 microversion: 2.1 time: 0.088386 May 23 14:18:26.905090 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1999/4072] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:26 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:27.921973 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6efc7494-4cdd-40ef-906d-327ff8756dc0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:27.922627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6efc7494-4cdd-40ef-906d-327ff8756dc0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:27.929314 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6efc7494-4cdd-40ef-906d-327ff8756dc0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:27.929773 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6efc7494-4cdd-40ef-906d-327ff8756dc0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:27.930550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6efc7494-4cdd-40ef-906d-327ff8756dc0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:27.931002 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6efc7494-4cdd-40ef-906d-327ff8756dc0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:28.004417 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6efc7494-4cdd-40ef-906d-327ff8756dc0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:28.012063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6efc7494-4cdd-40ef-906d-327ff8756dc0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1199 microversion: 2.1 time: 0.094600 May 23 14:18:28.016910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2074/4073] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:27 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:29.028753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d1920fda-9f5e-404e-a3e1-d2f1634efb00 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:29.029382 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d1920fda-9f5e-404e-a3e1-d2f1634efb00 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:29.036277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1920fda-9f5e-404e-a3e1-d2f1634efb00 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:29.036771 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1920fda-9f5e-404e-a3e1-d2f1634efb00 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:29.037682 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1920fda-9f5e-404e-a3e1-d2f1634efb00 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:29.037990 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1920fda-9f5e-404e-a3e1-d2f1634efb00 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:29.191435 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d1920fda-9f5e-404e-a3e1-d2f1634efb00 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:29.199359 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d1920fda-9f5e-404e-a3e1-d2f1634efb00 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1276 microversion: 2.1 time: 0.174486 May 23 14:18:29.200087 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2000/4074] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:29 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:29.872933 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-3d77cbd1-5c48-49f3-bf99-0d50eae66a29 req-daa4878a-9b81-49d0-bfe6-990f2f8f379d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bd1729-37f9-4e9f-85ae-777381adb51d", "tag": "c04a238d-65ce-4a22-a89f-d5134a28f4a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:18:29.891953 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-3d77cbd1-5c48-49f3-bf99-0d50eae66a29 req-daa4878a-9b81-49d0-bfe6-990f2f8f379d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:29.892379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-3d77cbd1-5c48-49f3-bf99-0d50eae66a29 req-daa4878a-9b81-49d0-bfe6-990f2f8f379d service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:29.905197 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-3d77cbd1-5c48-49f3-bf99-0d50eae66a29 req-daa4878a-9b81-49d0-bfe6-990f2f8f379d service nova] Creating event network-changed:c04a238d-65ce-4a22-a89f-d5134a28f4a1 for instance 98bd1729-37f9-4e9f-85ae-777381adb51d on hv-cinder-82549 May 23 14:18:29.910390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-3d77cbd1-5c48-49f3-bf99-0d50eae66a29 req-daa4878a-9b81-49d0-bfe6-990f2f8f379d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046684 May 23 14:18:29.911157 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2075/4075] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:18:30.218413 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bd119b09-4b1c-4a08-a84b-ef5157a6553b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:30.219038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd119b09-4b1c-4a08-a84b-ef5157a6553b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:30.226212 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd119b09-4b1c-4a08-a84b-ef5157a6553b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:30.226662 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd119b09-4b1c-4a08-a84b-ef5157a6553b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:30.227432 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd119b09-4b1c-4a08-a84b-ef5157a6553b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:30.227864 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd119b09-4b1c-4a08-a84b-ef5157a6553b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:30.364959 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bd119b09-4b1c-4a08-a84b-ef5157a6553b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:30.373024 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bd119b09-4b1c-4a08-a84b-ef5157a6553b tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.159409 May 23 14:18:30.373590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2001/4076] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:30 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:31.391970 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-87eaf96d-c13a-441e-9b60-bec228827f58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:31.392707 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-87eaf96d-c13a-441e-9b60-bec228827f58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:31.398938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87eaf96d-c13a-441e-9b60-bec228827f58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:31.399397 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87eaf96d-c13a-441e-9b60-bec228827f58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:31.400160 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87eaf96d-c13a-441e-9b60-bec228827f58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:31.400627 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-87eaf96d-c13a-441e-9b60-bec228827f58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:31.533513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-87eaf96d-c13a-441e-9b60-bec228827f58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:31.540987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-87eaf96d-c13a-441e-9b60-bec228827f58 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.154573 May 23 14:18:31.541554 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2076/4077] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:31 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:32.533669 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:18:32.534190 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:18:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:18:32.557603 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a5d8e698-bf0e-4576-b66b-24993382a7b1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:32.558220 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a5d8e698-bf0e-4576-b66b-24993382a7b1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:32.564882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5d8e698-bf0e-4576-b66b-24993382a7b1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:32.565335 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5d8e698-bf0e-4576-b66b-24993382a7b1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:32.566099 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5d8e698-bf0e-4576-b66b-24993382a7b1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:32.566539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a5d8e698-bf0e-4576-b66b-24993382a7b1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:32.701882 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a5d8e698-bf0e-4576-b66b-24993382a7b1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:32.709403 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a5d8e698-bf0e-4576-b66b-24993382a7b1 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.155592 May 23 14:18:32.709963 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2002/4078] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:32 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:33.726987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eeeb6160-19e1-4910-92f3-cad8909ee8e0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:33.727671 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eeeb6160-19e1-4910-92f3-cad8909ee8e0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:33.730069 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:18:33.735683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eeeb6160-19e1-4910-92f3-cad8909ee8e0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:33.750186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eeeb6160-19e1-4910-92f3-cad8909ee8e0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:33.750186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eeeb6160-19e1-4910-92f3-cad8909ee8e0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:33.750186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eeeb6160-19e1-4910-92f3-cad8909ee8e0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:33.877379 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eeeb6160-19e1-4910-92f3-cad8909ee8e0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:33.884806 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eeeb6160-19e1-4910-92f3-cad8909ee8e0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.161692 May 23 14:18:33.885365 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2077/4079] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:33 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:34.901701 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57bcebed-8ed5-44a2-b164-d89ba3014ccf tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:34.902310 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57bcebed-8ed5-44a2-b164-d89ba3014ccf tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:34.904489 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:18:34.905711 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:18:34.910709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57bcebed-8ed5-44a2-b164-d89ba3014ccf tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:34.911172 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57bcebed-8ed5-44a2-b164-d89ba3014ccf tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:34.912026 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57bcebed-8ed5-44a2-b164-d89ba3014ccf tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:34.912458 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57bcebed-8ed5-44a2-b164-d89ba3014ccf tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:35.049098 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57bcebed-8ed5-44a2-b164-d89ba3014ccf tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:35.056592 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57bcebed-8ed5-44a2-b164-d89ba3014ccf tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.158947 May 23 14:18:35.061077 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2003/4080] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:34 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:36.073403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f3dd71b2-f8cf-49ab-8b56-1a614312d346 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:36.074013 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f3dd71b2-f8cf-49ab-8b56-1a614312d346 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:36.084697 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3dd71b2-f8cf-49ab-8b56-1a614312d346 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:36.085154 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3dd71b2-f8cf-49ab-8b56-1a614312d346 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:36.085938 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3dd71b2-f8cf-49ab-8b56-1a614312d346 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:36.086403 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3dd71b2-f8cf-49ab-8b56-1a614312d346 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:36.226149 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f3dd71b2-f8cf-49ab-8b56-1a614312d346 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:36.234894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f3dd71b2-f8cf-49ab-8b56-1a614312d346 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.165379 May 23 14:18:36.235461 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2078/4081] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:36 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:18:37.251293 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55543812-de1a-40b6-bf34-66c0def36ffd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:37.251840 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55543812-de1a-40b6-bf34-66c0def36ffd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:37.258280 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55543812-de1a-40b6-bf34-66c0def36ffd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:37.258732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55543812-de1a-40b6-bf34-66c0def36ffd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:37.259510 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55543812-de1a-40b6-bf34-66c0def36ffd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:37.259952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55543812-de1a-40b6-bf34-66c0def36ffd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:37.398709 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55543812-de1a-40b6-bf34-66c0def36ffd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:37.407367 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55543812-de1a-40b6-bf34-66c0def36ffd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.160488 May 23 14:18:37.407946 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2004/4082] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:37 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:38.423821 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6786cf53-ff39-4bec-92de-69f68d47ee92 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:38.424456 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6786cf53-ff39-4bec-92de-69f68d47ee92 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:38.431567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6786cf53-ff39-4bec-92de-69f68d47ee92 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:38.432025 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6786cf53-ff39-4bec-92de-69f68d47ee92 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:38.432848 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6786cf53-ff39-4bec-92de-69f68d47ee92 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:38.433343 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6786cf53-ff39-4bec-92de-69f68d47ee92 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:38.599861 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6786cf53-ff39-4bec-92de-69f68d47ee92 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:38.608958 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6786cf53-ff39-4bec-92de-69f68d47ee92 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.189221 May 23 14:18:38.609550 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2079/4083] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:38 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:39.626564 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c69fe7f6-1e50-4b3f-8bd1-7991373bead6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:39.627173 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c69fe7f6-1e50-4b3f-8bd1-7991373bead6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:39.633302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c69fe7f6-1e50-4b3f-8bd1-7991373bead6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:39.633747 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c69fe7f6-1e50-4b3f-8bd1-7991373bead6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:39.634504 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c69fe7f6-1e50-4b3f-8bd1-7991373bead6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:39.634939 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c69fe7f6-1e50-4b3f-8bd1-7991373bead6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:39.772937 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c69fe7f6-1e50-4b3f-8bd1-7991373bead6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:39.781065 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c69fe7f6-1e50-4b3f-8bd1-7991373bead6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.159172 May 23 14:18:39.781629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2005/4084] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:39 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:40.799270 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39281de4-f44b-4c0f-9c17-291103328c1f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:40.799843 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39281de4-f44b-4c0f-9c17-291103328c1f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:40.806479 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39281de4-f44b-4c0f-9c17-291103328c1f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:40.806934 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39281de4-f44b-4c0f-9c17-291103328c1f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:40.807699 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39281de4-f44b-4c0f-9c17-291103328c1f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:40.808141 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39281de4-f44b-4c0f-9c17-291103328c1f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:40.944195 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39281de4-f44b-4c0f-9c17-291103328c1f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:40.951719 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39281de4-f44b-4c0f-9c17-291103328c1f tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.156502 May 23 14:18:40.952625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2080/4085] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:40 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:41.759734 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-e71bdbc8-68f0-4419-a56b-11b0413ecb79 req-bdaca105-fc81-4819-a1de-3a61da0081e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd1729-37f9-4e9f-85ae-777381adb51d", "name": "network-vif-plugged", "status": "completed", "tag": "c04a238d-65ce-4a22-a89f-d5134a28f4a1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:18:41.769627 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-e71bdbc8-68f0-4419-a56b-11b0413ecb79 req-bdaca105-fc81-4819-a1de-3a61da0081e8 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:41.770076 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-e71bdbc8-68f0-4419-a56b-11b0413ecb79 req-bdaca105-fc81-4819-a1de-3a61da0081e8 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:41.780994 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-e71bdbc8-68f0-4419-a56b-11b0413ecb79 req-bdaca105-fc81-4819-a1de-3a61da0081e8 service nova] Creating event network-vif-plugged:c04a238d-65ce-4a22-a89f-d5134a28f4a1 for instance 98bd1729-37f9-4e9f-85ae-777381adb51d on hv-cinder-82549 May 23 14:18:41.784378 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR oslo.messaging._drivers.impl_rabbit [req-e71bdbc8-68f0-4419-a56b-11b0413ecb79 req-bdaca105-fc81-4819-a1de-3a61da0081e8 service nova] [868b367e-5abe-4d9d-b959-283a6685c657] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 14:18:41.968894 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c21ba62-80b5-45bb-90e2-0158d1f5821c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:41.969535 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c21ba62-80b5-45bb-90e2-0158d1f5821c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:41.975928 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c21ba62-80b5-45bb-90e2-0158d1f5821c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:41.976472 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c21ba62-80b5-45bb-90e2-0158d1f5821c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:41.977184 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c21ba62-80b5-45bb-90e2-0158d1f5821c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:41.977618 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c21ba62-80b5-45bb-90e2-0158d1f5821c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:42.119091 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c21ba62-80b5-45bb-90e2-0158d1f5821c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:42.131228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c21ba62-80b5-45bb-90e2-0158d1f5821c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.166403 May 23 14:18:42.131809 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2081/4086] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:41 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:18:42.790875 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [req-e71bdbc8-68f0-4419-a56b-11b0413ecb79 req-bdaca105-fc81-4819-a1de-3a61da0081e8 service nova] [868b367e-5abe-4d9d-b959-283a6685c657] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 47414. May 23 14:18:42.795213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-e71bdbc8-68f0-4419-a56b-11b0413ecb79 req-bdaca105-fc81-4819-a1de-3a61da0081e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.039407 May 23 14:18:42.795842 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2006/4087] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:18:43.147233 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1fc3e83a-2d5a-40e8-ba20-a3dd1dbcde1a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:43.147910 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1fc3e83a-2d5a-40e8-ba20-a3dd1dbcde1a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:43.155245 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1fc3e83a-2d5a-40e8-ba20-a3dd1dbcde1a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:43.157120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1fc3e83a-2d5a-40e8-ba20-a3dd1dbcde1a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:43.157120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1fc3e83a-2d5a-40e8-ba20-a3dd1dbcde1a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:43.157120 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1fc3e83a-2d5a-40e8-ba20-a3dd1dbcde1a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:43.342976 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1fc3e83a-2d5a-40e8-ba20-a3dd1dbcde1a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:43.351186 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1fc3e83a-2d5a-40e8-ba20-a3dd1dbcde1a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.207825 May 23 14:18:43.351749 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2082/4088] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:43 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:44.369051 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9c69297e-98df-4c42-905f-e336dfd269f6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:44.369746 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9c69297e-98df-4c42-905f-e336dfd269f6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:44.376593 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c69297e-98df-4c42-905f-e336dfd269f6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:44.377058 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c69297e-98df-4c42-905f-e336dfd269f6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:44.377836 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c69297e-98df-4c42-905f-e336dfd269f6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:44.378275 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9c69297e-98df-4c42-905f-e336dfd269f6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:44.514202 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9c69297e-98df-4c42-905f-e336dfd269f6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:44.521686 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9c69297e-98df-4c42-905f-e336dfd269f6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1264 microversion: 2.1 time: 0.157309 May 23 14:18:44.522246 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2007/4089] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:44 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:18:45.539341 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-09201d54-453e-4d2f-85ca-ed81de40401c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:45.540059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09201d54-453e-4d2f-85ca-ed81de40401c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:45.547001 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09201d54-453e-4d2f-85ca-ed81de40401c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:45.547450 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09201d54-453e-4d2f-85ca-ed81de40401c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:45.548213 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09201d54-453e-4d2f-85ca-ed81de40401c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:45.548673 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09201d54-453e-4d2f-85ca-ed81de40401c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:45.689309 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-09201d54-453e-4d2f-85ca-ed81de40401c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:45.696998 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-09201d54-453e-4d2f-85ca-ed81de40401c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1450 microversion: 2.1 time: 0.161527 May 23 14:18:45.697587 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2083/4090] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:45 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:45.712921 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-544d834a-cd70-4faa-a8da-c98d4f5b98bc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:18:45.713539 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-544d834a-cd70-4faa-a8da-c98d4f5b98bc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:18:45.721089 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-544d834a-cd70-4faa-a8da-c98d4f5b98bc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:45.721543 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-544d834a-cd70-4faa-a8da-c98d4f5b98bc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:45.722302 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-544d834a-cd70-4faa-a8da-c98d4f5b98bc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:45.722743 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-544d834a-cd70-4faa-a8da-c98d4f5b98bc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:45.859975 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-544d834a-cd70-4faa-a8da-c98d4f5b98bc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:18:45.867928 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-544d834a-cd70-4faa-a8da-c98d4f5b98bc tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1450 microversion: 2.1 time: 0.158779 May 23 14:18:45.868491 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2008/4091] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:18:45 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:18:48.117439 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-8e631eb1-3eb8-4cda-a0c6-1f3c7c0a2857 req-798bb4c3-72e3-4e36-b698-b92ca12d00c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bd1729-37f9-4e9f-85ae-777381adb51d", "tag": "c04a238d-65ce-4a22-a89f-d5134a28f4a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:18:48.126685 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8e631eb1-3eb8-4cda-a0c6-1f3c7c0a2857 req-798bb4c3-72e3-4e36-b698-b92ca12d00c1 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:18:48.127136 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8e631eb1-3eb8-4cda-a0c6-1f3c7c0a2857 req-798bb4c3-72e3-4e36-b698-b92ca12d00c1 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:18:48.139645 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-8e631eb1-3eb8-4cda-a0c6-1f3c7c0a2857 req-798bb4c3-72e3-4e36-b698-b92ca12d00c1 service nova] Creating event network-changed:c04a238d-65ce-4a22-a89f-d5134a28f4a1 for instance 98bd1729-37f9-4e9f-85ae-777381adb51d on hv-cinder-82549 May 23 14:18:48.145080 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-8e631eb1-3eb8-4cda-a0c6-1f3c7c0a2857 req-798bb4c3-72e3-4e36-b698-b92ca12d00c1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031374 May 23 14:18:48.145683 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2084/4092] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:18:49.839158 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:18:49.839841 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:18:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:20:16.914551 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:20:16.915414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:20:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:20:35.403384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:20:35.404485 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=58 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:20:35.404906 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d99802af-0360-4776-b3d1-809701f10a0b] AMQP server on 10.222.0.70:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 23 14:20:35.405596 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=29 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:20:35.406458 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=65 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 14:20:35.409031 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fdf2c118-b99e-4f61-ac9d-c67bc1685b1e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:35.409607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fdf2c118-b99e-4f61-ac9d-c67bc1685b1e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:35.418980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdf2c118-b99e-4f61-ac9d-c67bc1685b1e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:35.418980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdf2c118-b99e-4f61-ac9d-c67bc1685b1e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:35.418980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdf2c118-b99e-4f61-ac9d-c67bc1685b1e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:35.418980 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdf2c118-b99e-4f61-ac9d-c67bc1685b1e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:35.445652 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fdf2c118-b99e-4f61-ac9d-c67bc1685b1e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:20:35.480150 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-34fc5861-b393-4a7f-9849-d947d9c618e9 req-3db28b53-d2ef-45c7-a3f8-823837c1ae1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bd1729-37f9-4e9f-85ae-777381adb51d", "tag": "c04a238d-65ce-4a22-a89f-d5134a28f4a1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:20:35.489978 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-34fc5861-b393-4a7f-9849-d947d9c618e9 req-3db28b53-d2ef-45c7-a3f8-823837c1ae1b service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:35.490567 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-34fc5861-b393-4a7f-9849-d947d9c618e9 req-3db28b53-d2ef-45c7-a3f8-823837c1ae1b service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:35.503228 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-34fc5861-b393-4a7f-9849-d947d9c618e9 req-3db28b53-d2ef-45c7-a3f8-823837c1ae1b service nova] Creating event network-changed:c04a238d-65ce-4a22-a89f-d5134a28f4a1 for instance 98bd1729-37f9-4e9f-85ae-777381adb51d on hv-cinder-82549 May 23 14:20:35.508399 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-34fc5861-b393-4a7f-9849-d947d9c618e9 req-3db28b53-d2ef-45c7-a3f8-823837c1ae1b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109384 May 23 14:20:35.509312 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2085/4093] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:20:35.846188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fdf2c118-b99e-4f61-ac9d-c67bc1685b1e tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 204 len: 0 microversion: 2.1 time: 0.449043 May 23 14:20:35.846929 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2009/4094] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:20:35 2022] DELETE /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 14:20:35.857288 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6737afc5-69b6-4e8a-9ce3-f2308094485c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:35.858010 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6737afc5-69b6-4e8a-9ce3-f2308094485c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:35.864444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6737afc5-69b6-4e8a-9ce3-f2308094485c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:35.864941 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6737afc5-69b6-4e8a-9ce3-f2308094485c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:35.865727 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6737afc5-69b6-4e8a-9ce3-f2308094485c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:35.866177 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6737afc5-69b6-4e8a-9ce3-f2308094485c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:36.018189 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6737afc5-69b6-4e8a-9ce3-f2308094485c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:20:36.026690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6737afc5-69b6-4e8a-9ce3-f2308094485c tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1574 microversion: 2.1 time: 0.174335 May 23 14:20:36.026690 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2086/4095] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:35 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:20:37.044932 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d06ef889-19ab-4f8d-953a-61b64220a6a9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:37.045654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d06ef889-19ab-4f8d-953a-61b64220a6a9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:37.052668 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d06ef889-19ab-4f8d-953a-61b64220a6a9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:37.053182 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d06ef889-19ab-4f8d-953a-61b64220a6a9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:37.053991 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d06ef889-19ab-4f8d-953a-61b64220a6a9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:37.054385 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d06ef889-19ab-4f8d-953a-61b64220a6a9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:37.200438 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d06ef889-19ab-4f8d-953a-61b64220a6a9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:20:37.210226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d06ef889-19ab-4f8d-953a-61b64220a6a9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1574 microversion: 2.1 time: 0.169745 May 23 14:20:37.210226 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2010/4096] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:37 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:20:38.233112 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f432023-e6e2-4d51-ad8a-03b6b2b694b2 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:38.233738 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f432023-e6e2-4d51-ad8a-03b6b2b694b2 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:38.241788 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f432023-e6e2-4d51-ad8a-03b6b2b694b2 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:38.242348 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f432023-e6e2-4d51-ad8a-03b6b2b694b2 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:38.243129 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f432023-e6e2-4d51-ad8a-03b6b2b694b2 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:38.243662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f432023-e6e2-4d51-ad8a-03b6b2b694b2 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:38.250679 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d99802af-0360-4776-b3d1-809701f10a0b] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 47488. May 23 14:20:38.432952 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-68ad80ad-4b36-4461-8d95-636ff165531a req-96225c80-ebf2-4ff1-8967-e6fb58572837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd1729-37f9-4e9f-85ae-777381adb51d", "name": "network-vif-deleted", "tag": "c04a238d-65ce-4a22-a89f-d5134a28f4a1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:20:38.441826 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-68ad80ad-4b36-4461-8d95-636ff165531a req-96225c80-ebf2-4ff1-8967-e6fb58572837 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:38.442362 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-68ad80ad-4b36-4461-8d95-636ff165531a req-96225c80-ebf2-4ff1-8967-e6fb58572837 service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:38.455501 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-68ad80ad-4b36-4461-8d95-636ff165531a req-96225c80-ebf2-4ff1-8967-e6fb58572837 service nova] Creating event network-vif-deleted:c04a238d-65ce-4a22-a89f-d5134a28f4a1 for instance 98bd1729-37f9-4e9f-85ae-777381adb51d on hv-cinder-82549 May 23 14:20:38.457588 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f432023-e6e2-4d51-ad8a-03b6b2b694b2 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:20:38.461188 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-68ad80ad-4b36-4461-8d95-636ff165531a req-96225c80-ebf2-4ff1-8967-e6fb58572837 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 May 23 14:20:38.461795 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2011/4097] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:20:38.466513 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f432023-e6e2-4d51-ad8a-03b6b2b694b2 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1456 microversion: 2.1 time: 0.238743 May 23 14:20:38.467077 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2087/4098] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:38 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1456 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:20:39.484607 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:39.485313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:39.491590 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:39.492038 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:39.492822 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:39.493285 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:39.524103 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:39.524521 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:39.525022 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lazy-loading 'fault' on Instance uuid 98bd1729-37f9-4e9f-85ae-777381adb51d {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:20:39.578788 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:20:39.582410 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-82c39421-fd70-4c2a-a46d-4fe7dce94ec4 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 200 len: 1229 microversion: 2.1 time: 0.102603 May 23 14:20:39.583036 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2012/4099] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:39 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:20:40.600639 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:40.601187 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: 98bd1729-37f9-4e9f-85ae-777381adb51d] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:40.609990 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:40.610448 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:40.611390 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:40.612546 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:40.634913 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] HTTP exception thrown: Instance 98bd1729-37f9-4e9f-85ae-777381adb51d could not be found. May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Request method failure captured: May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d HTTP/1.1 May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii5Y-hFcnxClFLCXYNJRHjEcon61HpzBm5p8XPRM04C5zwaxsdPiovQfv24bM7_uBX130R6h3KH-pihhL0naKjUgIdjrXPvTJBp7vecz7GwBCx4gzEE-pFC7saA2q_C4r8UsYNLHgM9jkdqs4-DxnANHm9vaCsGmiOnnCLXgvG1Cr9Aw May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: aee15038cdf945a594437e83a34e1afe May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:20:40.637156 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aee15038cdf945a594437e83a34e1afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}] May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestVolumeBootPattern-741075917 May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: aee15038cdf945a594437e83a34e1afe May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-TestVolumeBootPattern-741075917-project May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 7b6534d42be64c3cb311d384458bfae3 May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestVolumeBootPattern-741075917-project May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance 98bd1729-37f9-4e9f-85ae-777381adb51d could not be found. May 23 14:20:40.638633 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': '98bd1729-37f9-4e9f-85ae-777381adb51d'} May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98bd1729-37f9-4e9f-85ae-777381adb51d could not be found. May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:20:40.639987 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98bd1729-37f9-4e9f-85ae-777381adb51d could not be found. May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98bd1729-37f9-4e9f-85ae-777381adb51d could not be found. May 23 14:20:40.641367 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:40.643209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Returning 404 to user: Instance 98bd1729-37f9-4e9f-85ae-777381adb51d could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:20:40.643209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d6707fc9-568c-4d6f-b103-e932a2c6b5d0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d" status: 404 len: 111 microversion: 2.1 time: 0.041979 May 23 14:20:40.643209 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2088/4100] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:40 2022] GET /compute/v2.1/servers/98bd1729-37f9-4e9f-85ae-777381adb51d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:20:44.075146 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c5c1ca03-430a-457c-b9ce-93b6f53a4af6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:44.075703 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5c1ca03-430a-457c-b9ce-93b6f53a4af6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:44.078741 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-cf5e9400-b87d-4ced-bfc1-70d0f90b625f req-f4b65fdb-ed0f-4b98-842c-a9874d94e74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4255c2-050e-4983-8133-8a61d7092761", "tag": "91c3a64d-17b0-4208-a9ce-f3124190c577"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:20:44.082948 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5c1ca03-430a-457c-b9ce-93b6f53a4af6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:44.083399 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5c1ca03-430a-457c-b9ce-93b6f53a4af6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:44.084175 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5c1ca03-430a-457c-b9ce-93b6f53a4af6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:44.084644 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5c1ca03-430a-457c-b9ce-93b6f53a4af6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:44.087654 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-cf5e9400-b87d-4ced-bfc1-70d0f90b625f req-f4b65fdb-ed0f-4b98-842c-a9874d94e74e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:44.088175 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-cf5e9400-b87d-4ced-bfc1-70d0f90b625f req-f4b65fdb-ed0f-4b98-842c-a9874d94e74e service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:44.100784 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-cf5e9400-b87d-4ced-bfc1-70d0f90b625f req-f4b65fdb-ed0f-4b98-842c-a9874d94e74e service nova] Creating event network-changed:91c3a64d-17b0-4208-a9ce-f3124190c577 for instance da4255c2-050e-4983-8133-8a61d7092761 on hv-cinder-82549 May 23 14:20:44.107063 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-cf5e9400-b87d-4ced-bfc1-70d0f90b625f req-f4b65fdb-ed0f-4b98-842c-a9874d94e74e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033466 May 23 14:20:44.108255 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2089/4101] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 14:20:44.123628 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5c1ca03-430a-457c-b9ce-93b6f53a4af6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 14:20:44.464066 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c5c1ca03-430a-457c-b9ce-93b6f53a4af6 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 204 len: 0 microversion: 2.1 time: 0.393276 May 23 14:20:44.466419 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2013/4102] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:20:44 2022] DELETE /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 14:20:44.474967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a560b51a-dbdf-4de3-a9a6-cdcbd34b5a9a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:44.477021 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a560b51a-dbdf-4de3-a9a6-cdcbd34b5a9a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:44.482642 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a560b51a-dbdf-4de3-a9a6-cdcbd34b5a9a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:44.483106 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a560b51a-dbdf-4de3-a9a6-cdcbd34b5a9a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:44.483892 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a560b51a-dbdf-4de3-a9a6-cdcbd34b5a9a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:44.484509 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a560b51a-dbdf-4de3-a9a6-cdcbd34b5a9a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:44.655969 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a560b51a-dbdf-4de3-a9a6-cdcbd34b5a9a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:20:44.663791 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a560b51a-dbdf-4de3-a9a6-cdcbd34b5a9a tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1575 microversion: 2.1 time: 0.192847 May 23 14:20:44.664658 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2090/4103] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:44 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:20:45.688006 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1f36ff01-8598-4c8a-bc4c-ae54592376b7 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:45.688782 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1f36ff01-8598-4c8a-bc4c-ae54592376b7 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:45.695542 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f36ff01-8598-4c8a-bc4c-ae54592376b7 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:45.696000 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f36ff01-8598-4c8a-bc4c-ae54592376b7 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:45.696869 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f36ff01-8598-4c8a-bc4c-ae54592376b7 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:45.697313 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f36ff01-8598-4c8a-bc4c-ae54592376b7 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:45.839127 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1f36ff01-8598-4c8a-bc4c-ae54592376b7 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:20:45.848277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1f36ff01-8598-4c8a-bc4c-ae54592376b7 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1575 microversion: 2.1 time: 0.166017 May 23 14:20:45.848891 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2014/4104] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:45 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 14:20:46.866174 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a289e9d-a60b-4003-9773-7e1727d215b8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:46.866881 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a289e9d-a60b-4003-9773-7e1727d215b8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:46.874176 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a289e9d-a60b-4003-9773-7e1727d215b8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:46.874625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a289e9d-a60b-4003-9773-7e1727d215b8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:46.875392 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a289e9d-a60b-4003-9773-7e1727d215b8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:46.875830 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a289e9d-a60b-4003-9773-7e1727d215b8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:47.085213 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-c659e7ba-5b22-4c49-9289-27c10f571bdf req-f6c08a0f-b988-4475-914d-2ff32144075f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4255c2-050e-4983-8133-8a61d7092761", "name": "network-vif-deleted", "tag": "91c3a64d-17b0-4208-a9ce-f3124190c577"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 14:20:47.087161 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a289e9d-a60b-4003-9773-7e1727d215b8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:20:47.095238 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c659e7ba-5b22-4c49-9289-27c10f571bdf req-f6c08a0f-b988-4475-914d-2ff32144075f service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:47.095800 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c659e7ba-5b22-4c49-9289-27c10f571bdf req-f6c08a0f-b988-4475-914d-2ff32144075f service nova] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:47.095918 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a289e9d-a60b-4003-9773-7e1727d215b8 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1456 microversion: 2.1 time: 0.233399 May 23 14:20:47.096409 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2091/4105] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:46 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1456 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:20:47.108277 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-c659e7ba-5b22-4c49-9289-27c10f571bdf req-f6c08a0f-b988-4475-914d-2ff32144075f service nova] Creating event network-vif-deleted:91c3a64d-17b0-4208-a9ce-f3124190c577 for instance da4255c2-050e-4983-8133-8a61d7092761 on hv-cinder-82549 May 23 14:20:47.113095 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-c659e7ba-5b22-4c49-9289-27c10f571bdf req-f6c08a0f-b988-4475-914d-2ff32144075f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 May 23 14:20:47.113685 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2015/4106] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 23 14:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 14:20:48.115825 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:48.116455 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:48.123171 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:48.123625 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:48.124404 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:48.124872 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:48.158153 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:48.158602 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:48.159059 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lazy-loading 'fault' on Instance uuid da4255c2-050e-4983-8133-8a61d7092761 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 14:20:48.210759 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6534d42be64c3cb311d384458bfae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee15038cdf945a594437e83a34e1afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} May 23 14:20:48.219247 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d9c50274-a64f-4e9a-8145-b4cdb58df181 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 200 len: 1229 microversion: 2.1 time: 0.107379 May 23 14:20:48.219826 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2092/4107] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:48 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 14:20:49.237520 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:49.238216 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: da4255c2-050e-4983-8133-8a61d7092761] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:49.244409 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:49.244897 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:49.246209 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:49.246785 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:49.260130 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] HTTP exception thrown: Instance da4255c2-050e-4983-8133-8a61d7092761 could not be found. May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Request method failure captured: May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 HTTP/1.1 May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii5Y-hFcnxClFLCXYNJRHjEcon61HpzBm5p8XPRM04C5zwaxsdPiovQfv24bM7_uBX130R6h3KH-pihhL0naKjUgIdjrXPvTJBp7vecz7GwBCx4gzEE-pFC7saA2q_C4r8UsYNLHgM9jkdqs4-DxnANHm9vaCsGmiOnnCLXgvG1Cr9Aw May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: aee15038cdf945a594437e83a34e1afe May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:20:49.262654 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aee15038cdf945a594437e83a34e1afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}] May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestVolumeBootPattern-741075917 May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: aee15038cdf945a594437e83a34e1afe May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestVolumeBootPattern-741075917-project May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 7b6534d42be64c3cb311d384458bfae3 May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestVolumeBootPattern-741075917-project May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance da4255c2-050e-4983-8133-8a61d7092761 could not be found. May 23 14:20:49.264049 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'da4255c2-050e-4983-8133-8a61d7092761'} May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4255c2-050e-4983-8133-8a61d7092761 could not be found. May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:20:49.264732 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4255c2-050e-4983-8133-8a61d7092761 could not be found. May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4255c2-050e-4983-8133-8a61d7092761 could not be found. May 23 14:20:49.265799 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.266775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Returning 404 to user: Instance da4255c2-050e-4983-8133-8a61d7092761 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:20:49.266775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1eeaef30-041a-49ab-9731-997698f60eb0 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761" status: 404 len: 111 microversion: 2.1 time: 0.031301 May 23 14:20:49.266775 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2016/4108] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:49 2022] GET /compute/v2.1/servers/da4255c2-050e-4983-8133-8a61d7092761 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:20:49.795533 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:49.796073 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:49.802559 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:49.803016 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:49.803786 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:49.804221 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:49.818542 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] HTTP exception thrown: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Request method failure captured: May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 HTTP/1.1 May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept: application/json May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Connection: close May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Length: 0 May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Content-Type: application/json May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Host: 10.222.0.70 May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABii5Y-hFcnxClFLCXYNJRHjEcon61HpzBm5p8XPRM04C5zwaxsdPiovQfv24bM7_uBX130R6h3KH-pihhL0naKjUgIdjrXPvTJBp7vecz7GwBCx4gzEE-pFC7saA2q_C4r8UsYNLHgM9jkdqs4-DxnANHm9vaCsGmiOnnCLXgvG1Cr9Aw May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Id: None May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Domain-Name: None May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Id: aee15038cdf945a594437e83a34e1afe May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Role: member,reader May 23 14:20:49.820251 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Roles: member,reader May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aee15038cdf945a594437e83a34e1afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}] May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestVolumeBootPattern-741075917 May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Id: aee15038cdf945a594437e83a34e1afe May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User: tempest-TestVolumeBootPattern-741075917-project May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Id: 7b6534d42be64c3cb311d384458bfae3 May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestVolumeBootPattern-741075917-project May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: method: > May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: exception: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.821662 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: action_args: {'id': 'dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0'} May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:20:49.822444 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.823967 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi May 23 14:20:49.825553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Returning 404 to user: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:20:49.825553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-91d8f92a-eeac-4c16-bb18-dcc456155a51 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 404 len: 111 microversion: 2.1 time: 0.030633 May 23 14:20:49.825553 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2093/4109] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 23 14:20:49 2022] DELETE /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 14:20:49.831384 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:49.831995 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] [instance: dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 14:20:49.838343 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:49.840877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:49.840877 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 14:20:49.841129 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Lock "4dc388de-d5ca-467c-ab01-a163e12270ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 14:20:49.855933 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] HTTP exception thrown: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Request method failure captured: May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 HTTP/1.1 May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept: application/json May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Connection: close May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Length: 0 May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Content-Type: application/json May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Host: 10.222.0.70 May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABii5Y-hFcnxClFLCXYNJRHjEcon61HpzBm5p8XPRM04C5zwaxsdPiovQfv24bM7_uBX130R6h3KH-pihhL0naKjUgIdjrXPvTJBp7vecz7GwBCx4gzEE-pFC7saA2q_C4r8UsYNLHgM9jkdqs4-DxnANHm9vaCsGmiOnnCLXgvG1Cr9Aw May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Id: None May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Domain-Name: None May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Id: aee15038cdf945a594437e83a34e1afe May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Role: member,reader May 23 14:20:49.857561 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Roles: member,reader May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aee15038cdf945a594437e83a34e1afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aee15038cdf945a594437e83a34e1afe"}]}] May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestVolumeBootPattern-741075917 May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Id: aee15038cdf945a594437e83a34e1afe May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestVolumeBootPattern-741075917 May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User: tempest-TestVolumeBootPattern-741075917-project May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Id: 7b6534d42be64c3cb311d384458bfae3 May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestVolumeBootPattern-741075917-project May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: method: > May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: exception: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.859176 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: action_args: {'id': 'dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0'} May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 14:20:49.860640 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. May 23 14:20:49.862949 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi May 23 14:20:49.865187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Returning 404 to user: Instance dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 14:20:49.865187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d5011f91-ce8c-40a8-b993-98df9cb653dd tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0" status: 404 len: 111 microversion: 2.1 time: 0.032011 May 23 14:20:49.865187 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2017/4110] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 23 14:20:49 2022] GET /compute/v2.1/servers/dc59fdeb-82a0-41cf-b3a2-10cb7582f8b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 14:20:51.384244 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-44fd894b-c5a0-4272-83ba-80d37777aef9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] Calling method '.version_select at 0x7effb1c97e50>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 14:20:51.489414 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-44fd894b-c5a0-4272-83ba-80d37777aef9 tempest-TestVolumeBootPattern-741075917 tempest-TestVolumeBootPattern-741075917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-491265647" status: 202 len: 0 microversion: 2.1 time: 0.108922 May 23 14:20:51.490035 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2094/4111] 10.222.0.70 () {58 vars in 1259 bytes} [Mon May 23 14:20:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-491265647 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 14:21:42.569160 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:21:42.569753 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:21:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:21:52.543059 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:21:52.544189 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:21:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:22:09.849577 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:22:09.850203 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:22:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:23:36.922947 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:23:36.923722 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:23:43.515022 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 23 14:23:43.515686 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:24:03.860294 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:24:03.860923 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:25:02.580629 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:25:02.581307 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:25:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:25:12.552558 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:25:12.553235 dv-cinder-825492-14-iscsi devstack@n-api.service[124830]: Mon May 23 14:25:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 14:25:29.858015 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 14:25:29.858837 dv-cinder-825492-14-iscsi devstack@n-api.service[124831]: Mon May 23 14:25:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!